Could it be "Bateau d'amour" by Charles Trenet, the chorus of which begins "L'amour est un petit bateau / Qui s´en va, tout joyeux, sur l´onde"?
YouTube: Reda Caire (1937): http://www.youtube.com/watch?v=rsqXzMQtNPI
Lyrics can be found on several sites.