> when the rhyme is identical (in which case it can't really be said to
> be a rhyme)

I got confused by this in primary school (in The Grand Old Duke Of York). My eventual solution to this conundrum is that a word always rhymes with itself: I call it the "identity rhyme", by analogy to the function of 0 in addition, and 1 in multiplication.