TY - JOUR
T1 - Improving the transparency of meta-analyses with interactive web applications
AU - Ahern, Thomas P.
AU - Maclehose, Richard F.
AU - Haines, Laura
AU - Cronin-Fenton, Deirdre P.
AU - Damkier, Per
AU - Collin, Lindsay J.
AU - Lash, Timothy L.
N1 - Publisher Copyright:
© Author(s) (or their employer(s)) 2021.
PY - 2021/12/1
Y1 - 2021/12/1
N2 - Increased transparency in study design and analysis is one proposed solution to the perceived reproducibility crisis facing science. Systematic review and meta-analysis -through which individual studies on a specific association are ascertained, assessed for quality and quantitatively combined -is a critical process for building consensus in medical research. However, the conventional publication model creates static evidence summaries that force the quality assessment criteria and analytical choices of a small number of authors onto all stakeholders, some of whom will have different views on the quality assessment and key features of the analysis. This leads to discordant inferences from meta-analysis results and delayed arrival at consensus. We propose a shift to interactive meta-analysis, through which stakeholders can take control of the evidence synthesis using their own quality criteria and preferred analytic approach -including the option to incorporate prior information on the association in question -to reveal how their summary estimate differs from that reported by the original analysts. We demonstrate this concept using a web-based meta-analysis of the association between genetic variation in a key tamoxifen-metabolising enzyme and breast cancer recurrence in tamoxifen-treated women. We argue that interactive meta-analyses would speed consensus-building to the degree that they reveal invariance of inferences to different study selection and analysis criteria. On the other hand, when inferences are found to differ substantially as a function of these choices, the disparities highlight where future research resources should be invested to resolve lingering sources of disagreement.
AB - Increased transparency in study design and analysis is one proposed solution to the perceived reproducibility crisis facing science. Systematic review and meta-analysis -through which individual studies on a specific association are ascertained, assessed for quality and quantitatively combined -is a critical process for building consensus in medical research. However, the conventional publication model creates static evidence summaries that force the quality assessment criteria and analytical choices of a small number of authors onto all stakeholders, some of whom will have different views on the quality assessment and key features of the analysis. This leads to discordant inferences from meta-analysis results and delayed arrival at consensus. We propose a shift to interactive meta-analysis, through which stakeholders can take control of the evidence synthesis using their own quality criteria and preferred analytic approach -including the option to incorporate prior information on the association in question -to reveal how their summary estimate differs from that reported by the original analysts. We demonstrate this concept using a web-based meta-analysis of the association between genetic variation in a key tamoxifen-metabolising enzyme and breast cancer recurrence in tamoxifen-treated women. We argue that interactive meta-analyses would speed consensus-building to the degree that they reveal invariance of inferences to different study selection and analysis criteria. On the other hand, when inferences are found to differ substantially as a function of these choices, the disparities highlight where future research resources should be invested to resolve lingering sources of disagreement.
KW - breast tumours
KW - statistics & research methods
UR - http://www.scopus.com/inward/record.url?scp=85082528444&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85082528444&partnerID=8YFLogxK
U2 - 10.1136/bmjebm-2019-111308
DO - 10.1136/bmjebm-2019-111308
M3 - Review article
C2 - 32220861
AN - SCOPUS:85082528444
SN - 2515-446X
VL - 26
SP - 327
EP - 332
JO - BMJ evidence-based medicine
JF - BMJ evidence-based medicine
IS - 6
ER -