I thought Groucho actually said "I would not want to join a club that would have me as a member."

I have used it a time or two - always acknowledging its origin.