Accounts are contradictory, but it appears that Joseph Taylor recorded twelve songs for the Gramophone Company. Ten of these were issued on 31 July 1908 as "English Folk-Songs sung by Genuine Peasant Performers". The Gramophone Company reportedly gave Joseph Taylor a set of the records, as well as a gramophone on which to play them.

All ten songs plus two more - Rufford Park Poachers and Gipsy's Wedding - were included on Unto Brigg Fair (1972), together with songs recorded on wax cylinders in Brigg by Percy Grainger. These included two songs by Joseph Taylor, Landlord and Tenant and Bold Nevison. Two of the Gramophone Company songs appeared on Hidden English (1996) and five more on The Voice of the People series (1999).