As far as I've known, a 49-er is one who was seeking fortune, adventure or simply employment by going west to work the California gold rush of 1849. This can easliy make sense here following the line about pilgrims. But I would of course bow to someone who knows definitely.