In fact, the name Palestine (Greek Παλαιστίνη Palaistinē) appears as far back as the 5th century BC in the famous historical writings of Herodotus, who says that its inhabitants were circumcised.

from a website somewhere. I think that the Romans were not around that long ago...