Skip to content
PaperFren

Research method

Sensitivity and Specificity

At one cutoff, sensitivity is the true-positive rate (the fraction of people with the target condition who test positive) and specificity is the true-negative rate (the fraction without the condition who test negative). Those two numbers do not say what a positive result means for the next patient: positive predictive value also depends on prevalence. The same data can yield an excellent AUC or a sky-high specificity for a rare class while most positives — or almost no screening flags — are still the wrong clinical story.

Diagnostic papers quote sensitivity and specificity when they need to know how a blood test, bedside sign, phone PPG, blood-culture panel or frailty trajectory trades missed cases against false alarms at a chosen threshold. It answers 'among people whose true status is known, how often does this cutoff agree?' Its main limitation is portability: 95%/93% in a specialist pain clinic, 77%/93.8% for a 0.9%-incidence cancer test, and 99.1% specificity for a 1.1%-of-population frailty class are not interchangeable operating points.

Studies

5

Findings

5

5 supporting · 0 challenging · 0 qualifying citations

Open tensions

1

Currently

What we know

  1. Among 50,780 women with CA125 tested in English primary care, ovarian-cancer incidence was 0.9%. At the conventional ≥35 U/ml cutoff, sensitivity was 77%, specificity 93.8%, AUC 0.92, and PPV only 10.1%. Performance and the mix of cancers varied by age; elevated CA125 also related to non-ovarian cancers. Observational EHR accuracy is not a trial of changing the threshold to improve survival.
  2. In specialist chronic-pain clinics, StEP's pinprick response was 95% sensitive and 93% specific for neuropathic versus non-neuropathic pain, and combined signs gave strong predictive values for radicular versus axial low-back pain. Those figures were validated against clinical classification in a high-prevalence referred sample, not as a standalone imaging replacement in general practice.
  3. Primary-care FibriCheck PPG, after excluding pacing and poor signals, classified atrial fibrillation against 12-lead ECG with sensitivity 95.6% and specificity 96.6% (241 enrolled, 223 analysed). Signal quality is a prerequisite; PPV and NPV still depend on prevalence in the waiting room being tested.
  4. An automated microarray panel for gram-positive organisms and resistance markers on 1,157 monomicrobial positive blood cultures reached Staphylococcus genus sensitivity 99.4% and specificity 99.7% versus reference culture. Assay accuracy is not a mortality benefit of faster reporting, and performance varies by organism and target.
  5. In English primary-care EHR data, rapidly rising frailty (about 0.01 eFI per month) doubled 12-month death risk versus stable frailty among 13,149 decedents matched to 26,298 controls. Reweighted, that rare class (about 1.1% of the population) predicted 1-year mortality with 99.1% specificity. High specificity for a tiny stratum is not a reason to replace clinical judgment or to assume that intervening on trajectory class improves end-of-life care.

Largest unresolved question

The five papers are tuned to different prevalences and harms of error, so a 'good' sensitivity/specificity pair is not portable. CA125's 77%/93.8% at 0.9% incidence yields PPV 10.1% — a primary-care rare-disease problem. StEP's 95%/93% pinprick figures come from specialist clinics where neuropathic pain is common. FibriCheck's 95.6%/96.6% is versus ECG after dropping poor signals. Blood-culture 99.4%/99.7% is laboratory identification, not community screening. Frailty's 99.1% specificity describes a ~1.1% trajectory class, not a test you run on everyone.

Common misconceptions

  • Specificity of 93.8% means 93.8% of positive CA125 tests are ovarian cancer.

    Specificity is among women without ovarian cancer. At 0.9% incidence, PPV at ≥35 U/ml was 10.1% despite specificity 93.8% and sensitivity 77%. Most positives were not ovarian cancer.

  • 99.1% specificity means the frailty trajectory is an excellent screening test for everyone.

    That specificity is for a rapidly rising eFI class that is about 1.1% of the population and that doubled 12-month death risk versus stable frailty. A rare, highly specific flag is not a mass-screening tool, and the paper does not show that acting on the class improves care.

  • A highly sensitive and specific bedside sign or phone PPG can replace the reference standard.

    StEP was validated against clinical classification in specialist clinics, not as an imaging replacement. FibriCheck was compared with 12-lead ECG after excluding pacing and poor signals; PPV/NPV still follow prevalence. Blood-culture microarray accuracy is not a trial of faster reporting on death.

Related