There are more than you might think, just not the loud ones that give everyone else a bad name.

Edit: Note that this is true for almost every group. The stereotypes from people outside the group will almost always represent the worst of that group, because humans have a tendency to overemphasize and overrepresent negativity.

A completely benign example: convincing my friend to watch Doctor Who was difficult because his perception of the fan base was that they were obnoxious and obsessed with how hot David Tennant is. Which…I mean, look at the man. But also, no, the loudest part of the fan base isn’t representative of the show.