The term "neurodiverse" (or as a friend calls it "neurospicy") came about because of this. It turns out that ASD blurs into a lot of other "conditions". They also tend to blur into each other.

Rather than deal with explaining the details of how your weird, neurodiverse is used to indicate your weird, but not broken. E.g. high functioning autism isn't naturally a disorder. Instead it makes you better at some things, but worse at others. Unfortunately, one of those happens to be social skills.

Neurodiverse people tend to have a lot more in common than average. It's both from social conditioning, and commonality of interests. We also often find "normal" to be uninteresting, if not boring. We seem to naturally gather and seek out like minded people. It also runs in families. This makes it seem that it's disproportionately common. We're not actually that common, we just tend to just concentrate into a few areas.

ASD etc have there uses, but as clinical terms, for problem management. It's annoying when it's overused in media, as a catch all term.