While sometimes band membership *feels* like marriage, it's not ;D

You mention that others have come and gone...sounds like they have dealt in past with folks leaving well enough to welcome them back into the fold. I'd say you shouldn't have anything to worry about.

If it were me, I'd make my regrets, tell them I needed to follow another path musically, and hope we could still be friends.