It is sufficient sin for a man that he neglects him whom he maintains.
Sunan Abi Dawud Book 9, Hadith 137