Skip to content
PaperFren

Research method

Randomized Controlled Trial

A randomized controlled trial assigns people by chance to an intervention or a comparator, then measures the same outcomes in both arms. Randomisation is meant to balance known and unknown confounders at baseline so that later differences can be attributed to the assigned treatment rather than to who signed up. The result is a contrast — a difference in minutes walked, a quality score, a PHQ-9 change — whose credibility still depends on retention, blinding, and whether the outcome is a behaviour people report or an event the trial was powered to count.

Clinicians reach for an RCT when they need to know whether a programme, drug, app or training actually changes outcomes, not merely whether people who already use it look healthier. It answers 'does this assignment cause a difference over this follow-up?' Its main limitation in this library is that many trials are short, rely on self-report, and lose people unevenly, so a statistically significant contrast is not the same as a durable hard-endpoint benefit.

Studies

33

Findings

5

6 supporting · 0 challenging · 0 qualifying citations

Open tensions

2

Currently

What we know

  1. Behaviour-change RCTs in this set often show a clear advantage while the intervention is running and a weaker or gone contrast once it stops. Insufficiently active adults randomised to a 50-day Facebook walking programme increased walking by about 155 min/week during the programme, but between-group advantages were not maintained three months after the app ended; Text4Heart raised lifestyle adherence at 3 months (AOR 2.55) without a significant 6-month difference.
  2. Some service-delivery trials are designed as non-inferiority tests rather than superiority tests. Orthopaedic patients randomised to videoconference versus usual outpatient visits had quality-score differences whose 90% CI (0.05–0.17) stayed inside the pre-specified non-inferiority margin, with all video visits completed as planned.
  3. Adjunctive digital CBT can move a validated symptom score without proving remission or long-term relapse prevention. Adults with antidepressant-refractory major depression randomised to add a smartphone CBT app scored about 2.5 PHQ-9 points lower at week 9 (SMD 0.40) and were more likely to meet response criteria; remission and side-effect differences were not significant.
  4. Intention-to-treat mixed models can still leave a trial hard to interpret when dropout is large and unequal. NHS Choices users randomised to MoodGYM versus wait-list showed adjusted WEMWBS advantages of about 2.5 points at 6 weeks and 2.9 at 12 weeks, but attrition was 73.5% in the intervention arm versus 26.9% in control.
  5. Not every paper that uses randomisation is an intervention RCT. A Copenhagen Mendelian-randomisation analysis of BMI and ischaemic heart disease uses genotype as an instrumental variable for BMI rather than randomly assigning a diet or drug, so the causal claim is about genetically influenced BMI, not about a treatment protocol.

Largest unresolved question

Trials disagree on what a 'positive' result is allowed to be. The orthopaedic telemedicine trial treats staying inside a non-inferiority margin as success, whereas the Facebook walking, Text4Heart, Kokoro-app and MoodGYM trials are powered to show the intervention beating control on a change score. A student who reads only superiority language will misread a successful non-inferiority trial as 'no difference, so it failed.'

Procedure

How it works

The main stages of the method. Specific protocols and analysis choices vary between studies.

  1. Define eligibility and the outcomes

    Before assignment, the trial states who can enter and what will be counted — minutes walked, a symptom score, a quality-of-life scale, or a hard event. An underpowered hard endpoint cannot be rescued by a significant score on a different measure.

  2. Assign by chance

    Eligible people are randomised to the intervention or a comparator so that known and unknown baseline confounders should balance. Randomisation is an assignment method. It does not keep the arms comparable if later dropout or unblinded reporting differs by arm.

  3. Deliver the intervention and the comparator

    One arm receives the programme, drug, app, or training; the other receives usual care, placebo, or an active control. Blinding, when it is possible, is what stops knowledge of assignment from shaping a subjective outcome.

  4. Follow up and retain

    The same outcomes are measured on a schedule. Differential attrition — people leaving one arm more than the other — reopens confounding after randomisation and is a known weak point of many trials in this library.

  5. Estimate the contrast

    The result is a difference between arms, often analysed as randomised (intention-to-treat). A statistically significant change on a reported score is still only that contrast, over that follow-up, in those who contributed data.

  6. Do not read a score change as a hard event

    An RCT answers whether this assignment caused a difference on the measured outcomes. A PHQ-9 or lifestyle-adherence contrast is not proof of fewer heart attacks, remissions, or deaths, and a benefit seen during the programme need not persist after it stops.

Common misconceptions

  • Randomisation guarantees that the groups stay comparable until the end of the trial.

    It balances baseline assignment. Differential dropout, as in MoodGYM's 73.5% versus 26.9% attrition, and unblinded quality-of-life reporting, as in the heart-failure telemonitoring trial, can reopen confounding after randomisation.

  • If the intervention works during the programme, the benefit will persist after it stops.

    The Facebook walking trial's between-group walking advantage was gone three months after the app ended, and Text4Heart's lifestyle-adherence contrast was no longer significant at 6 months.

  • A statistically significant symptom-score difference means the trial proved fewer heart attacks, remissions, or deaths.

    Kokoro-app moved PHQ-9 without a significant remission difference; Text4Heart did not prove fewer hard cardiac events; the telemonitoring trial was explicitly underpowered for hard endpoints.

Related