The Prophet (ﷺ) disliked that one should go to one's family at night (on returning from a journey).
Sahih al-Bukhari Book 67, Hadith 176