Why would they stop a clinical trial early?
Well.
This seems like it belongs somewhere in Section 2.5.1 from the second edition of the CICM Syllabus for the Second Part Examination, where candidates should be able to discuss "Research methods for each study type including study design, populations, methods, data collection, analysis and outcomes". Of these, the premature cessation of the trial probably fits best into the "study design" component, whether the trial was stopped intentionally or not.
In summary:
Trials have a planned end goal. They are planned to end when:
A planned early stop occurs when interim analysis demonstrates:
An unplanned early stop can occur when:
Trials can also be stopped strategically to achieve a goal of the sponsor, eg. where the trial drug is performing poorly. This is viewed as an unethical practice.
Patient consequences of stopping the trial early:
Resource consequences of stopping a trial early:
Consequences of early stopping for data analysis:
There does not seem to be a specific single resource to point to, when it comes to finding peer-reviewed reading recommendations. CONSORT had a good statement on the various (validity-preserving and invalidating) reasons for why a trial might be stopped, but their website is being updated and this broken link cannot be updated right now. Briel et al (2012) is good for the disadvantages of early stopping, Viele et al (2016) for the caveats in the interpretation of the resulting data, Montori et al (2005) for those that stopped for benefit, Cook & Buhule (2022) for harm, Walter et al (2020) for those that stopped for futility, and Lièvre et al (2001) for ... other reasons.
A planned early stop can be built in to the trial design. This is the Lawful Good ending to a randomised controlled trial. In this morally upright worldview, the only correct reasons for ending a trial are efficacy, safety or feasibility. When an interim analysis is performed, it should be performed according to certain validity-preserving criteria:
All this should be reported transparently, and, where possible, such interim analysis steps should be minimised, as the more times you analyse something the more likely you are to find some kind of effect.
This is the version where the trial finds such clear benefit that the steering committee stops randomisation because it becomes apparent that to randomise people to placebo or some other less effective treatment is going to put them at risk. In this scenario, the effect size is abundantly demonstrated to be statistically significant, as compared to the control group. In such a situation, it is usually necessary to continue fio
Montori et al (2005) looked at a variety of examples where this had happened. The majority of these were trials where there eas already an effective therapy, and where there was a rapidly obvious benefit to the patients, which could be observed over the short timeframe of the interim analysis. Most were published in reputable journals, were paid for by for-profit agencies, and reported extremely positive results, notably in favour of the sponsor. Many failed to report their original sample size calculations or the results of the interim analysis. One example is the infamous bisoprolol paper by Poldermans et al (1999) that found a preposterous large treatment effect (RR = 0.09). Others from the critical care literature, which were not fraudulent as far as we know, included the hypoglycaemia trial by Van Den Berghe et al (2001) and the PROWESS trial of activated protein C - both of which were overturned by later findings. Of the trials that ended early and still remained valid, the best example is the original ARDNSET low tidal volume study (2000)
This is the version where the trial finds so little benefit that the steering committee decides to stop all further data collection, on the grounds that the data will probably not shift the effect size into the realms of significance. This is usually determined by a calculation of conditional power where some assumptions are made (eg. that future data will resemble the available data). The calculation of this interim variable is fraught with error, as it is possible to make all kinds of pessimistic assumptions and stop the study prematurely, underestimating the treatment effect and potentially killing a viable intervention. Walter et al (2020), exploring 52 such trials, found that many were vague or unclear about the exact rules they used, but that overall most of them were stopped on reasonable grounds.
The other most interesting finding was the much lower treatment effect seen in these studies. The most concerning possibility is that the premature end of a promising line of investigation might result in a "freezing" of interest, where the scientific community comes to regard the stopped trial findings as definitive, and gives up on investigating the intervention. This was not the case for EOLIA (Combes et al 2018) which ended early because of futility but which involved ECMO, an intrinsically sexy intervention which will never go out of fashion no matter how many futile trials are published.
These trials are stopped early because the intervention is actually causing harm, and it becomes unethical to randomise patients into the treatment arm. is the version where the trial finds so little benefit that the steering committee decides to stop all further data collection. Cook & Buhule (2022) reviewed some examples and emphasised that a rash decision to stop too early can result in a treatment being dismissed as harmful when it is in fact merely risky. Same as the early stopping due to benefit, the effect size can be overestimated. A counterexample from the ICU literature is the ART trial (Cavalcanti et al, 2017), which ultimately found enough harm to stop the concurrent PHARLAP trial from running to completion, but which itself continued to the end because the interim analysis report concluded that they should cause a few more pneumothoraces.
Baum, Michael, Joan Houghton, and Keith Abrams. "Early stopping rules‐clinical perspectives and ethical considerations." Statistics in Medicine 13.13‐14 (1994): 1459-1469.
Briel, Matthias, et al. "The dangers of stopping a trial too early." JBJS 94.Supplement_1 (2012): 56-60.
Montori, Victor M., et al. "Randomized trials stopped early for benefit: a systematic review." Jama 294.17 (2005): 2203-2209.
Walter, S. D., et al. "A systematic survey of randomised trials that stopped early for reasons of futility." BMC medical research methodology 20 (2020): 1-11.
Lièvre, Michel, et al. "Premature discontinuation of clinical trial for reasons not related to efficacy, safety, or feasibilityCommentary: Early discontinuation violates Helsinki principles." Bmj 322.7286 (2001): 603-606.
Schou, I. Manjula, and Ian C. Marschner. "Meta‐analysis of clinical trials with early stopping: an investigation of potential bias." Statistics in Medicine 32.28 (2013): 4859-4874.
Walter, S. D., et al. "Randomised trials with provision for early stopping for benefit (or harm): the impact on the estimated treatment effect." Statistics in medicine 38.14 (2019): 2524-2543.
Cook, Thomas, and Olive D. Buhule. "Stopping trials early due to harm." NEJM evidence 1.5 (2022): EVIDctw2100026.
Poldermans, Don, et al. "The effect of bisoprolol on perioperative mortality and myocardial infarction in high-risk patients undergoing vascular surgery." New England Journal of Medicine 341.24 (1999): 1789-1794.
Bernard, Gordon R., et al. "Efficacy and safety of recombinant human activated protein C for severe sepsis." New England journal of medicine 344.10 (2001): 699-709.
Van Den Berghe, Greet, et al. "Intensive insulin therapy in critically ill patients." New England journal of medicine 345.19 (2001): 1359-1367.
Acute Respiratory Distress Syndrome Network. "Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome." New England Journal of Medicine 342.18 (2000): 1301-1308.
Cavalcanti, Alexandre Biasi, et al. "Effect of lung recruitment and titrated positive end-expiratory pressure (PEEP) vs low PEEP on mortality in patients with acute respiratory distress syndrome: a randomized clinical trial." Jama 318.14 (2017): 1335-1345.
Combes, Alain, et al. "Extracorporeal membrane oxygenation for severe acute respiratory distress syndrome." New England Journal of Medicine 378.21 (2018): 1965-1975.