Allah's Messenger said: "Whoever said: 'Be quiet' while the Imam is giving the Khutbah then he has committed Laghw (useless activity)."
Jami` at-Tirmidhi Book 4, Hadith 25