It just strikes me as a very judgemental label that often seems to be applied to patterns of behaviour that can be quite appropriate. It's prescriptive, not descriptive. The question "is this song passive aggressive?" Isn't like "what does this song tell us about the people involved", it's more like "is this song racist?"