Improving the Transparency of Meta-Analyses with Interactive Web Applications

Details

• Personal Author:
  Ahern TP ; Collin LJ ; Cronin-Fenton DP ; Damkier P ; Haines L ; Lash TL ; MacLehose RF
• Description:
  Increased transparency in study design and analysis is one proposed solution to the perceived reproducibility crisis facing science. Systematic review and meta-analysis-through which individual studies on a specific association are ascertained, assessed for quality and quantitatively combined-is a critical process for building consensus in medical research. However, the conventional publication model creates static evidence summaries that force the quality assessment criteria and analytical choices of a small number of authors onto all stakeholders, some of whom will have different views on the quality assessment and key features of the analysis. This leads to discordant inferences from meta-analysis results and delayed arrival at consensus. We propose a shift to interactive meta-analysis, through which stakeholders can take control of the evidence synthesis using their own quality criteria and preferred analytic approach-including the option to incorporate prior information on the association in question-to reveal how their summary estimate differs from that reported by the original analysts. We demonstrate this concept using a web-based meta-analysis of the association between genetic variation in a key tamoxifen-metabolising enzyme and breast cancer recurrence in tamoxifen-treated women. We argue that interactive meta-analyses would speed consensus-building to the degree that they reveal invariance of inferences to different study selection and analysis criteria. On the other hand, when inferences are found to differ substantially as a function of these choices, the disparities highlight where future research resources should be invested to resolve lingering sources of disagreement. [Description provided by NIOSH]
• Subjects:
  Occupational Health Safety
• Keywords:
  Analytical Processes Breast Cancer Research Productivity Statistical Analysis Statistical Quality Control Systematic Reviews
• ISSN:
  2515-446X
• Document Type:
  Text
• Funding:
  Grant
• Genre:
  Journal Article
• Place as Subject:
  Georgia ; Minnesota ; OSHA Region 1 ; OSHA Region 4 ; OSHA Region 5 ; Vermont
• CIO:
  National Institute for Occupational Safety and Health (NIOSH)
• Topic:
  Workplace Safety & Health
• Location:
  North America
• Pages in Document:
  327-332
• Volume:
  26
• Issue:
  6
• NIOSHTIC Number:
  nn:20064477
• Citation:
  BMJ Evid Based Med 2021 Dec; 26(6):327-332
• Contact Point Address:
  Dr Thomas P Ahern, University of Vermont College of Medicine, Burlington, VT 05405, USA
• Email:
  thomas.ahern@med.uvm.edu
• Federal Fiscal Year:
  2022
• Performing Organization:
  University of Minnesota Twin Cities
• Peer Reviewed:
  True
• Start Date:
  20050701
• Source Full Name:
  BMJ Evidence-Based Medicine
• End Date:
  20250630
• Collection(s):
  National Institute for Occupational Safety and Health
• Main Document Checksum:
  urn:sha-512:9cfe3c2e30fa75fe062d4aafed53f65a6147c014d8bf95233674f69beef2dd45cf57eaa756c233e9a50ccdde268c720b7349c047174df0ca2a88777492f96ae5
• Download URL:
  https://stacks.cdc.gov/view/cdc/222930/cdc_222930_DS1.pdf
• File Type:
  [PDF - 598.56 KB ]