There is no upper limit on the maximum effect that can be detected in randomized trials.

J Clin Epidemiol

Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA; Stanford Prevention Research Center, Department of Medicine, Stanford, CA, USA; Department of Epidemiology and Population Health, Stanford, CA, USA; Department of Biomedical Data Science, Stanford Universi

Published: August 2025


Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

Background And Objectives: Randomized controlled trials (RCTs) are commonly viewed as essential for detecting small treatment benefits, yet they also identify large ("dramatic") effects. Forecasting the likelihood of future large effects helps guide resource allocation for conducting clinical trials.

Methods: We included consecutive cancer RCTs from 5 cohorts identified by funders or trial registries, minimizing publication bias. Between 1955 and 2018 (and published by 2022), 716 RCTs compared 984 experimental vs standard treatments in approximately 350,000 patients. We applied a generalized Pareto distribution (GPD) under Extreme Value Theory to predict future maximum treatment effects using data spanning 65 years.

Results: The GPD's positive shape parameter implies no upper limit on maximum treatment effects. Historically, the largest observed effect had an odds ratio (OR) of 45 (95% CI: 2-1008). If current patterns hold, the largest effect over the next 50 years is projected at OR = 23 (95% CI: 13-106). We estimated 20% probability of detecting new treatments with OR >50 within the same time frame. Increasing the number of RCTs from about 20 to 40 or 60 per year would double or triple the likelihood of detecting breakthrough treatments with dramatic effects.

Conclusion: Our findings suggest there may be no absolute upper bound on discoverable treatment effects in cancer RCTs, although estimates will likely remain in the range observed between 1955 and 2022. Conducting more RCTs would boost the probability of identifying treatments with large effects, underscoring the importance of sustained or expanded trial activity to accelerate breakthrough discoveries.

Plain Language Summary: New treatments cannot be discovered without individuals volunteering to participate in clinical studies. Among all types of human clinical studies, RCTs are considered the most reliable method for evaluating new medical treatments and are especially effective at detecting small beneficial effects. This study also demonstrates that conducting more RCTs would accelerate the discovery of treatments with both small and large effects. By increasing public participation in RCTs, we can drive faster advances in therapeutics and influence policy decisions to allocate more resources toward the conduct of these trials.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.jclinepi.2025.111828DOI Listing

Publication Analysis

Top Keywords

large effects
12
treatment effects
12
rcts
9
upper limit
8
limit maximum
8
detecting small
8
effects
8
cancer rcts
8
maximum treatment
8
conducting rcts
8

Similar Publications

With the persistence of difficult employment, a large number of college students feel anxious and nervous about job hunting. College students with different family economic status have various feelings and performances when faced with employment, possibly due to subjective social class differences. The present study investigated the employment confidence of 611 undergraduates in Chongqing, aimed to ascertain the overall employment confidence of Chinese college students, and tried to analyze how subjective social class works on the employment confidence of college students and its influencing mechanism.

View Article and Find Full Text PDF

Background: To compare surgical and long-term patient-reported outcomes (PRO) between excisional (Nesbit) and incisional (Yachia) corporoplasty for correction of uncomplicated Peyronie's-related penile curvature in a large, single-surgeon cohort. A retrospective audit identified men who underwent Nesbit or Yachia corporoplasty (2015-2021). Operative data was extracted from records.

View Article and Find Full Text PDF

Background: Although current evidence supports the effectiveness of social norm feedback (SNF) interventions, their sustained integration into primary care remains limited. Drawing on the elements of the antimicrobial SNF intervention strategy identified through the Delphi-based evidence applicability evaluation, this study aims to explore the barriers and facilitators to its implementation in primary care institutions, thereby informing future optimization.

Methods: Based on the five domains of the Consolidated Framework for Implementation Research (CFIR), we developed semi-structured interview and focus group discussion guides.

View Article and Find Full Text PDF

Forests have been increasingly affected by natural disturbances and human activities. These impacts have caused habitat fragmentation and a loss of ecological connectivity. This study examines potential restoration pathways that reconnect the five largest forest cores in the Castilla y León region of Spain.

View Article and Find Full Text PDF

Land degradation (LD) is a critical environmental challenge caused by human activities and climate change. Reversing degraded land requires effective LD monitoring. The UN Sustainable Development Goal (SDG) indicator 15.

View Article and Find Full Text PDF