AbdurRahman reported on the authority of his mother: When the Messenger of Allah (ﷺ) passed any place from the house of Ya'la,--the narrator Ubaydullah forgot its name--he faced the House (the Ka'bah) and supplicated.
Sunan Abi Dawud Book 11, Hadith 287