| Title | Predicted risk of mortality models: surgeons need to understand limitations of the University HealthSystem Consortium models. | | Author(s) | Kozower BD, Ailawadi G, Jones DR, Pates RD, Lau CL, Kron IL, Stukenborg GJ | | Institution | Department of Surgery, University of Virginia Health System, Charlottesville, VA, USA. | | Source | J Am Coll Surg 2009 Nov; 209(5):551-6. | | MeSH | Adult
Aged
Aged, 80 and over
Cardiac Surgical Procedures
Coronary Artery Bypass
Databases, Factual
Female
Heart Valve Prosthesis Implantation
Humans
Male
Middle Aged
Models, Statistical
Predictive Value of Tests
Retrospective Studies
Risk Assessment
Risk Factors
United States
| | Abstract | BACKGROUND: The University HealthSystem Consortium (UHC) mortality risk adjustment models are increasingly being used as benchmarks for quality assessment. But these administrative database models may include postoperative complications in their adjustments for preoperative risk. The purpose of this study was to compare the performance of the UHC with the Society of Thoracic Surgeons (STS) risk-adjusted mortality models for adult cardiac surgery and evaluate the contribution of postoperative complications on model performance.
STUDY DESIGN: We identified adult cardiac surgery patients with mortality risk estimates in both the UHC and Society of Thoracic Surgeons databases. We compared the predictive performance and calibration of estimates from both models. We then reestimated both models using only patients without any postoperative complications to determine the relative contribution of adjustments for postoperative events on model performance.
RESULTS: In the study population of 2,171 patients, the UHC model explained more variability (27% versus 13%, p < 0.001) and achieved better discrimination (C statistic = 0.88 versus 0.81, p < 0.001). But when applied in the population of patients without complications, the UHC model performance declined severely. The C statistic decreased from 0.88 to 0.49, a level of discrimination equivalent to random chance. The discrimination of the Society of Thoracic Surgeons model was unchanged (C statistic of 0.79 versus 0.81).
CONCLUSIONS: Although the UHC model demonstrated better performance in the total study population, this difference in performance reflects adjustments for conditions that are postoperative complications. The current UHC models should not be used for quality benchmarks. | | Language | eng | | Pub Type(s) | Comparative Study
Journal Article
| | PubMed ID | 19854393 |
|
