when one of you is invited to a meal, he must accept. If he wishes he may eat, but if he wishes(to leave), he may leave.
Sunan Abi Dawud Book 28, Hadith 5