Aren't the Olympics about finding the most capable athlete from whatever category the sport is separated into? Not even every event is gender segregated, there is no "female Olympics", there are simply gender segregated Olympic events.

And for those events, if the categories are separated by gender, wouldn't "rare people" like Caster Semenya be the most deserving female athletes to win Gold in those events?

And if that's a problem, maybe we need to find a different way to categorize athletes other than the current system that sorts them by their genitals.