The disconnect comes from the fact that being a fascist and being a progressive are mutually exclusive. A lot of people think that as long as you're a progressive you can't possibly be a nazi, not realizing that's literally what the nazis were all about. It's why eugenicists always say that ethics "get in the way of progress" and why decimating cultures is always framed as "civilizing" them.