The Prophet (ﷺ) said, "The Wala' is for the manumitted (of the slave).
Sahih al-Bukhari Book 85, Hadith 29