The ideas of "superiority" and "inferiority" have been in the minds of humans for ages. This is not something that suddenly came to light through Darwin. Traditionally, there has always been a group (almost always white) which felt it was better than other groups, and used its power and religion to dominate weaker groups. We have seen this for thousands of years, from the Inquisition to to the extermination of Native Americans (at the hands of the Spanish/British/Americans) to slavery. Darwin did not create this problem, just as GTA did not create youth violence. If anything, Darwin put a scientific face on the issue. Don't get me wrong - he did not justifiy the extermination of inferior races - Hilter and others took Darwin's work and applied it in ways he never intended.
In many of his writings Darwin expressed racist beliefs, comparing blacks to apes and calling some races savage. This is a fact that cannot be erased by those who would try to discredit it. It is also a fact that Darwin's theories were used as the basis of eugenics. Eugenics were indeed used in the US as well as Nazi Germany in the 2oth century. But as far as I understand, Darwin and Galton never advocated government involvement in the process of "survival of the fittest", IE what Hitler and others attempted to do.
In the end, I do believe there is a dirty side to Darwin that his followers are not willing to acknoledge, but still he himself never advocated the kinds of acts some took to speed up the processes he coined. Is there a connection between the theories of "survival of the fittest", eugenics, and Hitler? Yes. But I think it's safe to say Hitler took things much farther and warped Darwin's ideas.