The Prophet used to touch only the Stone and the Yemeni Corner. (Sahih) Chatper 157. Touching The Two Yemeni Corners
Sunan an-Nasa'i Book 24, Hadith 331