Hi Earl, I agree with you that, given the context, it most likely simply means that he is leaving. Putting 'dust my broom' in the forum search box gives heaps of hits, including one that may be the one refer to - nothing definitive on this expression there either, but a very interesting thread:--Stewie.