Abstract
BACKGROUND AND PURPOSE: The ISLES challenge (Ischemic Stroke Lesion Segmentation) enables globally diverse teams to compete to develop advanced tools for stroke lesion analysis with machine learning. Detection of irreversibly damaged tissue on computed tomography perfusion (CTP) is often necessary to determine eligibility for late-time-window thrombectomy. Therefore, the aim of ISLES-2018 was to segment infarcted tissue on CTP based on diffusion-weighted imaging as a reference standard. METHODS: The data, from 4 centers, consisted of 103 cases of acute anterior circulation large artery occlusion stroke who underwent diffusion-weighted imaging rapidly after CTP. Diffusion-weighted imaging lesion segmentation was performed manually and acted as a reference standard. The data were separated into 63 cases for training and 40 for testing, upon which quality metrics (dice score coefficient, Hausdorff distance, absolute lesion volume difference, etc) were computed to rank methods based on their overall performance. RESULTS: Twenty-four different teams participated in the challenge. Median time to CTP was 185 minutes (interquartile range, 180-238), the time between CTP and magnetic resonance imaging was 36 minutes (interquartile range, 25-79), and the median infarct lesion size was 15.2 mL (interquartile range, 5.7-45). The best performance for Dice score coefficient and absolute volume difference were 0.51 and 10.1 mL, respectively, from different teams. Based on the ranking criteria, the top team's algorithm demonstrated for average Dice score coefficient and average absolute volume difference 0.51 and 10.2 mL, respectively, outperforming the conventional threshold-based method (dice score coefficient, 0.3; volume difference, 15.3). Diverse algorithms were used, almost all based on deep learning, with top-ranked approaches making use of the raw perfusion data as well as methods to synthetically generate complementary information to boost prediction performance. CONCLUSIONS: Machine learning methods may predict infarcted tissue from CTP with improved accuracy compared with threshold-based methods used in clinical routine. This dataset will remain public and can be used to test improvement in algorithms over time.