The portion of muslims with the most harmful and intolerant ideas are the sunnis (who accept the hadiths as legitimate scripture), who also make up the majority of muslims.

In a british questionaire a couple years back, 0% of muslims participating said homosexuality should be accepted.

If tolerance is a social contract, then for what reason do we accept it to be one-sided with the radically religious? At what portion of muslims acting/voting to bring sharia to western countries would people agree that it is necessary to act? 10%? 20%? 50%? Never?

No one ever claimed that one label accurately describes the sum of a people. But if it's the only label that captures anywhere close to 100% of the problematic people, then that's the one you use.