Don't think I've ever knowingly drunk Vodka of any nationality, and I've certainly never heard the 'fish' thing. Sounds fishy to me.
However, when I was a drinker, I was very fond of a drop of Highland Park, or Pusser's Rum. Those definitely don't taste of fish!