Usamah bin Sharik said “I went out with the Prophet (ﷺ) to perform Hajj, and the people were coming to him. One would say “Apostle of Allaah(ﷺ) I ran between Al Safa’ and Al Marwah before going round the Ka’bah or I did something before the its proper time or did something after its proper time. He would reply “No harm will come; no harm will come except to one who defames a Muslim acting wrongfully. That is the one who will be in trouble and will perish.
Sunan Abi Dawud Book 11, Hadith 295