That is your assumption. You cannot know that across all sports. It would most certainly be true for sports limited or focused on physical strength, but beyond that, there's no way to know for certain.

If you've played any sport, you'll know that brute strength isn't the sole determining factor for success. Technique is very important too. Tactics cannot be ignored either. In football for example, just play "try to get the ball" in a square where one chases the ball. You might be the fastest player on the team but never catch the ball even against players who don't move.

Also, competing against stronger opponents is how people learn and "level up". You learn how to deal with different, faster, slower, more technical, stronger, even more intelligent opponents. Again, if you've ever played sports (or just games), you'll know what it feels like to think you're the best, then get decimated by an opponent, but in doing so realize what you were doing wrong - especially when competing against that opponent multiple times. Women and men might have a higher ceiling than they think, but unless they compete against each other continuously, they won't know.