If you read "starving" as an adjective rather than as a verb then it could be "me and my brother Charlie" who are the (metaphorical) starving slaves -not a great line but possibly having some sense in a colloquial way of speaking.