You'll find a little screw on the bit you turn - gently tighten it until the problem goes away (or the peg breaks!!).

Cheaper than new pegs!

Most banjo pegs are 'friction' rather than 'machine' - it pays to strip them down, clean them, and put them back together. Not only don't they slip (when correctly adjusted), but they tune more easily.