Abstract
OBJECTIVE: There are many measures of healthcare quality, but no obvious summary measures to simplify ranking of hospital performance. With public reporting and accountability for hospital performance, the validity of composite measures for performance rankings has increased importance. This study aimed to explore the covariance of pediatric hospital quality indicators and evaluate the use of a single composite score. METHODS: We performed an observational study of pediatric hospital performance across 13 safety indicators extracted from the Pediatric Health Information System, a comparative database of children's hospitals in the United States. We included patients discharged from 36 hospitals from January 1, 2016, to December 31, 2019. Using principal components analysis, we investigate relationships among patient safety measures from the Agency for Healthcare Research and Quality pediatric quality indicators and Center for Medicare and Medicaid Services hospital-acquired conditions. We compare and summarize rankings based on individual safety indicators and calculate alternative composite scores. RESULTS: We identified 5 orthogonal variance components accounting for 68% of variation in pediatric hospital quality indicators. Rankings demonstrated greater within-hospital variation compared with between-hospital variation. We observed discordant rankings across commonly used summary measures and conclude that these pediatric safety measures demonstrate at least 2 underlying variance components. CONCLUSIONS: This study demonstrates the multifactorial nature of patient safety. This implies no unique ordering of hospitals based on these measures, and thus, no pediatric hospital can claim to be "the safest." This raises further questions about appropriate methods to rank hospitals by safety.