It was narrated from Anas bin Malik that the Prophet (ﷺ) prayed Zuhr in Al-Madinah, four Rak'ahs, and he prayed 'Asr in Dhul-Hulaifah, two Rak'ahs.
Sunan an-Nasa'i Book 5, Hadith 30