Ask Science
Ask a science question, get a science answer.
Community Rules
Rule 1: Be respectful and inclusive.
Treat others with respect, and maintain a positive atmosphere.
Rule 2: No harassment, hate speech, bigotry, or trolling.
Avoid any form of harassment, hate speech, bigotry, or offensive behavior.
Rule 3: Engage in constructive discussions.
Contribute to meaningful and constructive discussions that enhance scientific understanding.
Rule 4: No AI-generated answers.
Strictly prohibit the use of AI-generated answers. Providing answers generated by AI systems is not allowed and may result in a ban.
Rule 5: Follow guidelines and moderators' instructions.
Adhere to community guidelines and comply with instructions given by moderators.
Rule 6: Use appropriate language and tone.
Communicate using suitable language and maintain a professional and respectful tone.
Rule 7: Report violations.
Report any violations of the community rules to the moderators for appropriate action.
Rule 8: Foster a continuous learning environment.
Encourage a continuous learning environment where members can share knowledge and engage in scientific discussions.
Rule 9: Source required for answers.
Provide credible sources for answers. Failure to include a source may result in the removal of the answer to ensure information reliability.
By adhering to these rules, we create a welcoming and informative environment where science-related questions receive accurate and credible answers. Thank you for your cooperation in making the Ask Science community a valuable resource for scientific knowledge.
We retain the discretion to modify the rules as we deem necessary.
view the rest of the comments
There's a couple thing to keep in mind that might help it make sense. Meta-analyses, though not without merit, don't always accomplish the intended goals for a few reasons, two of which this study specifically suffers from. The first is that they combine studies that when they were conducted may have looked at the desired treatments and controls, but they often are doing so in different populations (note they stratify results by elderly, cancer patients etc.) I'm not going to on my phone start pulling the references, but I would venture to guess that the included studies have all sorts of specific groups they were targeting which leads to heterogeniety both in effect size but in interpretation of effect size. Think about it this way, if you are using Dat from many studies with different (often very specific) target populations, does it really make sense to combine them to draw conclusions about a some hypothetical population comprised of those people?
The second thing is sample size. A few thousand seems like a lot until you realize the data in question is incidence. Each subject included either had the disease or they didn't (it's 0 or 1) nothing in-between and nothing outside. Interval inference for dichotomous data (especially when it gets substratified down like the authors have done here) often lead to results like the plain language summary presented. That is, everything is null because they tried to say too much, with too little data.
Takeaway is don't read too much into the findings. The authors were certainly trying to earnestly answer the question (probably), but the existing literature and available data came up short.
I appreciate that. It's the feeling that I got, but I don't have any formal education on reading things like this, so I wanted some confirmation or education