"When Allah's Messenger would lead us in Salat he would turn (to leave) from both sides, on his right and on his left."
Jami` at-Tirmidhi Book 2, Hadith 153