In a time when fashion in general looked pretty uncomfortable, and rather hot. I discovered that there was specific fashion for riding a bicycle:
Bicycling ensemble, black WOOL (yikes), circa 1888, USA, Photography by Eileen Costa. 2011 – Museum of FIT
If you get a chance check out their Flickr site, it is absolutely wonderful, or if you are in NY, go to the museum.
Then there were actual boots:
All leather circa, 1895–1900 found at the MET museum