The Prophet (ﷺ) said: When one of you is invited to take meals and comes along with the messenger, that serves as permission for him to enter.

Abu 'Ali al-Lu'lu said: I heard Abu Dawud say: Qatadah did not hear anything from Abu Rafi'.