If the Prophet wanted to eat when he was sexually impure, he would wash his hands.
Sunan Ibn Majah Book 1, Hadith 327