I asked Abdullah b. Abu Aufa (Allah be pleased with him), a Companion of Allah's Messenger (ﷺ), whether Allah's Apostle (ﷺ) had entered the House, while performing 'Umra, He said: NO.
Sahih Muslim Book 15, Hadith 443