Abstract
BACKGROUND: Several studies explored factors related to adverse clinical outcomes among COVID-19 patients but lacked analysis of the impact of the temporal data shifts on the strength of association between different predictors and adverse outcomes. This study aims to evaluate factors related to patients and hospitals in the prediction of in-hospital mortality, need for invasive mechanical ventilation (IMV), and intensive care unit (ICU) transfer throughout the pandemic waves. METHODS: This multicenter retrospective cohort included COVID-19 patients from 39 hospitals, from March/2020 to August/2022. The pandemic was divided into waves: 10/03/2020-14/11/2020 (first), 15/11/2020-25/12/2021 (second), 26/12/2021-03/08/2022 (third). Patient-related factors included clinical, demographic, and laboratory data, while hospital-related factors covered funding sources, accreditation, academic status, and socioeconomic characteristics. Shapley additive explanation (SHAP) values derived from the predictions of a light gradient-boosting machine (LightGBM) model were used to assess potential risk factors for death, IMV and ICU. RESULTS: Overall, 16,958 adult patients were included (median age 59 years, 54.7% men). LightGBM achieved competitive effectiveness metrics across all periods. Temporal drifts were observed due to a decrease in various metrics, such as the recall for the positive class [ICU: 0.4211 (wave 1) to 0.1951 (wave 3); IMV: 0.2089 (wave 1) to 0.0438 (wave 3); death: 0.2711 (wave 1) to 0.1175 (wave 3)]. Peripheral arterial oxygen saturation to the fraction of inspired oxygen ratio (SatO(2)/FiO(2)) at admission had great predictive capacity for all outcomes, with an optimal cut-off value for death prediction of 227.78. Lymphopenia had its association strength increased over time for all outcomes, optimal threshold for death prediction of 643 × 10(9)/L. Thrombocytopenia was the most important feature in wave 2 (ICU); overall, values below 143,000 × 10(9)/L were more related to death. CONCLUSION: Data drifts were observed in all scenarios, affecting potential predictive capabilities of explainable machine learning methods. Upon admission, SatO(2)/FiO(2) values, platelet and lymphocyte count were significant predictors of adverse outcomes in COVID-19 patients. Overall, inflammatory response markers were more important than clinical characteristics. Limitations included sample representativeness and confounding factors. Integrating the drift's knowledge into models to improve effectiveness is a challenge, requiring continuous updates and monitoring of performance in real-world applications. CLINICAL TRIAL NUMBER: Not applicable.