The man who taught WW2 fighter ace Douglas Bader to fly, used to say "Rules are for the guidance of wise men, and the obedience of fools".
Good advice! If something sounds good, and says what you intended, then rhyme is of secondary importance. It matters not that some listeners will criticise. Others will hail it as innovative, imaginative, and fresh.
There are hundreds of books of blank verse, poetry without rhyme, which sell very well, so why should song be any different?