"I use F sharp a fair bit or Ebminor"

Why not just ask others not to join in instead of singing in obscure keys? Sooner or later you will come across someone who can play in that key then you are scuppered.

At the singarounds I go to the norm is not to join in unless invited by the singer invites it.