It does mess up their storytelling time during trumped up investigations that rely on unhinged witnesses and made up evidence. Plus it wastes more of their time so they can't do awful things quickly, always a good thing. Having to tolerate a non-submissive woman (moreso if she isn't lily white) speaking and existing in their spaces as an equal annoys misogynists too.