Pickpockets typically pass their swag immediately to an accomplice,   who's supposed to make a quick exit. If confronted by the victim, the actual pickpocket looks to be innocent.

In the song, the singer is made an unwilling accomplice. Next stop, Van Dieman's Land.