Abu Hurairah said: "I heard the Messenger of Allah (ﷺ) say: 'If you say to your companion: Listen attentively on a Friday when the Imam is delivering the khutbah, then you have engaged in idle talk.'"
Sunan an-Nasa'i Book 14, Hadith 39