"We prayed Zuhr as four with the Prophet in Al-Madinah, and Asr as two Rak'ah in Dhil-Hulaifah."
Jami` at-Tirmidhi Book 6, Hadith 3