Ibn ‘Umar said I have not seen the Apostle of Allaah(ﷺ) touching anything in the House (the Ka’bah) but the two Yamani corners.
Sunan Abi Dawud Book 11, Hadith 154
← Previous Hadith Abis bin Rabi’ah said on the authority of ‘Umar He(‘Umar) came to the (Black) Stone and said “ I know for sure that you are a stone which can neither benefit nor injure and had I not seen the Apostle of Allaah(ﷺ) kissing you, I would not have kissed you.”

Sunan Abi Dawud Book 11, Hadith 153 Next Hadith → By Allah, I think that she must have heard it from the Messenger of Allah (ﷺ). I think that the Messenger of Allah (ﷺ) had not given up touching both of them but for the reason that they were not on the foundation of the House (the Ka'bah), nor did the people circumambulate (the House) beyond al-Hijr for this reason.

Sunan Abi Dawud Book 11, Hadith 155