Abstract
OBJECTIVE: This study aimed to identify the risk factors and construct a reliable prediction model of 28-day all-cause mortality in critically ill patients with acute pancreatitis (AP) using machine learning techniques. METHODS: A total of 534 patients from three different institutions were included. Thirty-eight possible variables were collected from the Intensive care unit (ICU) admission for investigation. Patients were split into a training cohort (n = 400) and test cohort (n = 134) according to their source of hospital. The synthetic minority oversampling technique (SMOTE) was introduced to handle the inherent class imbalance. Six machine learning algorithms were applied in this study. The optimal machine learning model was chosen after patients in the test cohort were selected to validate the models. SHapley Additive exPlanation (SHAP) analysis was performed to rank the importance of variable. The predictive performance of the models was evaluated by the calibration curve, area under the receiver operating characteristics curves (AUROC), and decision clinical analysis. RESULTS: About 13.5% (72/534) of all patients eventually died of all-cause within 28 days of ICU admission. Eight important variables were screened out, including white blood cell count, platelets, body temperature, age, blood urea nitrogen, red blood cell distribution width, SpO2, and hemoglobin. The support vector machine (SVM) algorithm performed best in predicting 28-d all-cause death. Its AUROC reached 0.877 (95% CI: 0.809 to 0.927, p < 0.001), the Youden index was 0.634 (95% CI: 0.459 to 0.717). Based on the risk stratification system, the difference between the high-risk and low-risk groups was significantly different. CONCLUSION: In conclusion, this study developed and validated SVM model, which better predicted 28-d all-cause mortality in critically ill patients with AP. In the future, we will continue to include patients from more institutions to conduct validation in different contexts and countries.