Skip to content
PaperFren

Clinical NLP

Can deep learning use a whole hospital record to predict outcomes?

Rajkomar A, Oren E, Chen K, et al. · NPJ digital medicine · 2018

Open access · cc by · source: Europe PMC

Neural networks reading a patient's entire raw hospital record predicted death, readmission and long stays more accurately than standard clinical scores.

Save to libraryView originalAsk PaperFrenStudy view

Study at a glance

Design
Computational / modelling — Retrospective development and test of an ensemble of LSTM, attention and boosted-stump networks on raw FHIR-formatted records, compared with logistic-regression baselines, with an 80/10/10 patient split.
N
N=216221 · 216,221 hospitalizations from 114,003 unique adult patients across two US academic hospitals.
Population
Adult inpatients (stays of at least 24 hours) at two US academic medical centres
Outcome
AUROC for in-hospital mortality, 30-day unplanned readmission, long length of stay, and discharge diagnosis codes

Structured fields used in claim comparison tables when every cited study has a complete layer.

Key findings

For in-hospital death predicted 24 hours after admission, the model reached an AUROC of 0.95 and 0.93 at the two hospitals versus 0.85 and 0.86 for the baseline score, roughly halving false alerts. Readmission (0.77 and 0.76 vs 0.70 and 0.68) and long stay (0.86 and 0.85 vs 0.76 and 0.74) were also better predicted. Diagnosis prediction reached a weighted AUROC of 0.90 at discharge, though the harder micro-F1 score was only 0.40 to 0.41. An attribution method highlighted which parts of the record drove an individual prediction.

Methodology

The team converted all electronic health record data from two hospitals, including doctors' and nurses' notes at one site, into a single time-ordered sequence per patient without hand-picking variables. They trained three kinds of deep network and combined them, then predicted in-hospital death, unplanned readmission within 30 days, stays of a week or more, and the full set of discharge diagnoses. Results on a held-out test set were compared with logistic-regression models built from established clinical scores.

Limitations

This is a retrospective study, so it does not show that using the predictions would improve patient care; prospective trials are needed. Models were trained and tested separately within each hospital and data were not harmonised across sites, so transfer to a new hospital is untested. Because only one hospital had notes and the cohorts differed, the study cannot say how much the free text contributed. The interpretability example is a single case study, and the code depends on internal Google infrastructure, limiting replication.

How this study connects

Role on claims

Each row is a claim on a concept or method page where this paper supports, challenges, or qualifies the statement. Roles are hand-checked — not a model guess.

  • SupportsInterpretable machine learningconcept

    An explanation is a lead to check, not a finding.

    Explanations are post hoc hypotheses unless tested: PASNet's authors caution active nodes don't mean activated pathways, TranSynergy's SHAP explanations were not validated in the lab, and the EHR model's attribution example was a single case.

    Evidence for the claim as stated.

Related papers in this topic

Same topic cluster — not a recommendation engine.