I have an LP "My Very Favourite Nursery Rhyme Record" Tim Hart and Friends. Songs on that are:

Oh The Grand Old Duke Of York
Sing a Song of Sixpence
Once I Caught a Fish Alive
Hey Diddle Diddle
Little Jack Horner
Little Miss Muffet
Little Bo Peep
Mary, Mary Quite Contrary
Old MacDonald had a Farm
There was an Old Woman Tossed up in a Basket
Twinkle, Twinkle Little Star
Boys and Girls Come Out to Play
Nick Nack Paddy Wack
Baa, Baa Black Sheep
Bobby Shaftoe
Hush-a-Bye Baby
Humpty Dumpty
Lavender's Blue (Dilly Dilly)
London Bridge is Falling Down
Oranges and Lemons
Oh Dear What Can the Matter Be

It really is an excellent LP for pre-school children and all words are provided.