“If a man stays among a people, he should not fast without their permission.”
Sunan Ibn Majah Book 7, Hadith 126