You must remember that a banjo player spends half his time tuning and the other half playing out of tune. Welcome to the club.
One other thing that you might try after you run out of bridge adjustment ideas is buying a new set of strings. Quality and age of strings can be a real factor.