“If you say to your companions: ‘Be quiet’ on a Friday while the Imam is delivering the sermon, you have engaged in Laghw (idle talk or behaviour).”
Sunan Ibn Majah Book 5, Hadith 308