1887 Edwards, George Wharton. "The Figurehead of the James Starbuck." _St. Nicholas_ vol. 14(10) (August 1887) 742-746.

An imagined scene of older times. Not an eyewitness account. Just using the chanty text for literary effect:

//
...Beneath, through the open door of the shed, we can see long lines of men sitting on low benches and sewing away on huge strips of new canvas; singing in chorus, as they ply the short, thick sail-needle and waxed thread, some old-time ditty of the sea. Hark!

'' 'Where are you going, my own pretty maid?'
    Hey-ho! Blow a man down!
    'I'm going a-sailing, sir,' she said.
    Give a man time to blow a man down!"
//

So, BLOW THE MAN DOWN is becoming popularly known in the 1880s?