A version I heard ended

All the rest have thirty-one,
But February stands alone
With only twenty-eight.

If "one" actually rhymed with "alone" at the time of composition, that puts it back to the 17th century or earlier, according to the OED s.v. "one numeral a., pron.".