“They said: ‘O Messenger of Allah, is Hajj (required) every year?’ He said: ‘If I were to say yes, it would have become obligatory, and if it were to become obligatory, you would not (be able to) do it, and if you did not do it you would be punished.’”

Sunan Ibn Majah Book 25, Hadith 4