The way I understand it is that even if we omit any ancestral blame for what happened, the Native Americans are still dealing with the impact while European descendants benefit from it. It's kind of like if I went to school with a very bright kid that was horribly abused and kicked out into the streets, so they performed poorly and dropped out, allowing me to get into the best college possible and have a great career. Why should I have any compassion for this kid if I didn't abuse them myself? Why would I help them get housed and into college? Why would I even acknowledge that they were abused and forced out of their home? I'm one that earned it by working hard to get into college and graduate.

This omits the possibility that this kid might have outperformed me and taken the college spot, leaving me to be in a worse off situation.