Ibn Az-Zubair said to him: "Narrated to me from what the Mother of the Believers used to (secretly) inform you about" - meaning Aishah - so he said: "She narrated to me that the Messenger of Allah said: 'Had your people not been still close to the pre-Islamic period of ignorance, then I would demolish the Ka'bah and rebuild it with two doors.'" He said: "So when Ibn Az-Zubair came to power he demolished it and rebuilt it with two doors."
Jami` at-Tirmidhi Book 9, Hadith 68