“We were with the Prophet (ﷺ), and we were in Ihram. When a rider met us we would lower our garments from the top of our heads, and when he has gone, we would lift them up again.”

Another chain reports a similar hadith.
Sunan Ibn Majah Book 25, Hadith 54