"The messenger of Allah (peace be upon him) used to pray atop his mount while travelling, facing whatever direction it was facing." (One of the narrators) Malik said: "Abdullah bin Dinar said: and Ibn Umar used to do likewise".
Sunan an-Nasa'i Book 9, Hadith 2