Why is "cultural appropriation" a bad thing?

If I sing a peasant song, I'm not stealing it: the peasants can still sing it any way they like.

Cultural appropriation has been going on since the beginnings of civilization, if not longer.

Or am I missing something?