Abstract
BACKGROUND: The sublingual microcirculation presumably exhibits disease-specific changes in function and morphology. Algorithm-based quantification of functional microcirculatory hemodynamic variables in handheld vital microscopy (HVM) has recently allowed identification of hemodynamic alterations in the microcirculation associated with COVID-19. In the present study we hypothesized that supervised deep machine learning could be used to identify previously unknown microcirculatory alterations, and combination with algorithmically quantified functional variables increases the model's performance to differentiate critically ill COVID-19 patients from healthy volunteers. METHODS: Four international, multi-central cohorts of critically ill COVID-19 patients and healthy volunteers (n = 59/n = 40) were used for neuronal network training and internal validation, alongside quantification of functional microcirculatory hemodynamic variables. Independent verification of the models was performed in a second cohort (n = 25/n = 33). RESULTS: Six thousand ninety-two image sequences in 157 individuals were included. Bootstrapped internal validation yielded AUROC(CI) for detection of COVID-19 status of 0.75 (0.69-0.79), 0.74 (0.69-0.79) and 0.84 (0.80-0.89) for the algorithm-based, deep learning-based and combined models. Individual model performance in external validation was 0.73 (0.71-0.76) and 0.61 (0.58-0.63). Combined neuronal network and algorithm-based identification yielded the highest externally validated AUROC of 0.75 (0.73-0.78) (P < 0.0001 versus internal validation and individual models). CONCLUSIONS: We successfully trained a deep learning-based model to differentiate critically ill COVID-19 patients from heathy volunteers in sublingual HVM image sequences. Internally validated, deep learning was superior to the algorithmic approach. However, combining the deep learning method with an algorithm-based approach to quantify the functional state of the microcirculation markedly increased the sensitivity and specificity as compared to either approach alone, and enabled successful external validation of the identification of the presence of microcirculatory alterations associated with COVID-19 status.