"I said: 'O Messenger of Allah! Can I not enter the House?' He said: 'Enter the Hijr for it is part of the House.'"
Sunan an-Nasa'i Book 24, Hadith 294