The Prophet (ﷺ) said: Islam does not allow for failure to perform the hajj.
Sunan Abi Dawud Book 11, Hadith 9