I've only read about the velvet ant (wasp), Dan, I've never encountered them. Your description matches what I've heard from others, though.

Velvet Ant

http://pestworld.org/velvet-ant

http://bugguide.net/node/view/159/