Hmmmmmmmm....not played or seen this Game, DtG, but I've played a LOT of Age of Empires (though not online aginst a live opponent).

Do you have much in the way of troops yourself to provide at least some cover for the areas your peasants are working in? Are you able to build those fighting units quick enough with the resources your peasants are gathering? Are you getting overwhelmed with attacks comiing all at once, or constantly/quick succession? (there are times in AoE when I have to slow the speed of the game down so I can react fast enough).

I dunno if this is any help or not