For anything you buy from a poor country, there is probably going to be some way you can buy the same stuff from the same kind of community, but without helping exploit people.

Boycotting can be as selective as you like, and to be effective, it needs to be.

Here is a relevant site.Traidcraft is based in England, but it's got lots of advice about this, and links to people doing the same kind of stuff in other countries.