It's especially difficult when you're not separated from the givers by an ocean. They expect to see you wearing the items of clothing! I still have not found an occasion to wear one particularly expensive sweater I was given last year.
I tell myself to accept graciously, say thank you, and then do whatever I can with the gift, either returning it, giving it away or putting it away. It is much easier to give than to receive sometimes, and I try to remember that those folks are trying to do something nice for people they care about.