That no doubt can be an issue. But what represents cheap labor here in the U.S. isn't necessarily the same as what represents cheap labor somewhere else. In other words, the reason something is cheaper if it is produced somewhere else isn't necessarily that someone there is being taken advantage of whereas that wouldn't be the case if it was produced here.
Paying someone a fair wage for the work they do in, e.g., rural China may mean paying them considerably less than would be needed to pay someone a fair wage to do the same work in, e.g., Los Angeles, CA. The costs of living are different and the expected standards of living are different (and that wouldn't change if a given bit of production wasn't done there). If anything, China doing a great deal of production for people in the U.S. and Europe increases opportunities and standards of living for people in China. That's why they are willing to do it. Our choice not to have them produce stuff for us wouldn't help them, it would hurt them.
I'd add that, paying something much greater than what the market dictates is a fair wage in a given area (i.e. doing so for altruistic, not prudent business reasons) wouldn't necessarily help those currently receiving what would otherwise be considered a fair wage. It would, to some extent, push lower skill workers out in favor of higher skill workers willing to accept those higher wages.
The point, I suppose, is this: To the extent we'd like to see an increasing standard of living in other areas of the world, our outsourcing of production to those areas is likely helping on that front - at least it's helping in general. But it can't effect a sudden massive change on that front without being disruptive in ways that might ultimately prove problematic for them. It has to gradually help pull them toward a higher standard of living. People in China choose to do work for us fairly cheaply - cheaply from our perspective, not necessarily from theirs. They do that not because they think it harms them, but because they think it helps them.
