There are LOTS of songs called "Caroline." For example, see these search results at AMG and CDNOW. (Hope these links work; if not you can do your own search.)

I think the song LouisLee had in mind is most likely this one: Caroline (click to hear a sound sample). (I found the link to the sound file on this page.) I have no idea who the performer is, but his guitar work is magnificent, and he has a beautiful voice, too! The lyrics in the 50-second sound sample are:

Tell me where you been last night, Caroline.
Tell me where you been last night, Caroline.
Last night by Piccadilly
If it weren't you, who could it be?
So tell me where you been last night, Caroline.