The Prophet (ﷺ) forbade going to one's family at night (on arrival from a journey).

Sahih al-Bukhari Book 26, Hadith 26