The Messenger of Allah (ﷺ) said: "Whoever says to his companion on Friday, when the imam is delivering the khutbah: 'Listen attentively,' has engaged in idle talk."
Sunan an-Nasa'i Book 14, Hadith 38