Autism

To me, it feels like it is some sort of desperate attempt to not say 'autistic'/'autism', but I don't fully understand why. Most people I've seen using 'on the spectrum' are either actively questioning whether they or someone they are close with are autistic, or think it but don't care all that much. Personally, I find referring to autism as 'the spectrum' a bit offensive, as the only reason I can find to use the term is to forcibly emphasize that whoever is referred to (hereafter: 'me', although sometimes I am a spectator) is not like other (higher needs, lower perceived status) autistics. They suggest that they think badly of autism this way, and ungroup me from that group so it's not insulting (but it is, to the entire group and thus to me, who is, could be argued, also insulted directly). Although I know that basically everyone perceives people unalike themselves as 'worse' (human nature sadly) and it isn't on purpose, it is still very insulting to me. I already knew I was a joke to most people, so please don't make fun of me for things I have trouble with. Am I wrong about the reason people use the term? Do you agree or disagree and most importantly: why?