Abstract
Correct classification of skin lesions is a key step in skin cancer screening, which requires high accuracy and interpretability. This paper proposes a multimodal method for differentiating various clinical forms of basal cell carcinoma and benign neoplasms that includes machine learning. This study was conducted on 37 neoplasms, including benign neoplasms and five different clinical forms of basal cell carcinoma. The proposed multimodal screening method combines diffuse reflectance spectroscopy, optical coherence tomography and high-frequency ultrasound. Using diffuse reflectance spectroscopy, the coefficients of melanin pigmentation, erythema, hemoglobin content, and the slope coefficient of diffuse reflectance spectroscopy in the wavelength range 650-800 nm were determined. Statistical texture analysis of optical coherence tomography images was used to calculate first- and second-order statistical parameters. The analysis of ultrasound images assessed the shape of the tumor according to parameters such as area, perimeter, roundness and other characteristics. Based on the calculated parameters, a machine learning algorithm was developed to differentiate the various clinical forms of basal cell carcinoma. The proposed algorithm for classifying various forms of basal cell carcinoma and benign neoplasms provided a sensitivity of 70.6 ± 17.3%, specificity of 95.9 ± 2.5%, precision of 72.6 ± 14.2%, F(1) score of 71.5 ± 15.6% and mean intersection over union of 57.6 ± 20.1%. Moreover, for differentiating basal cell carcinoma and benign neoplasms without taking into account the clinical form, the method achieved a sensitivity of 89.1 ± 8.0%, specificity of 95.1 ± 0.7%, F(1) score of 89.3 ± 3.4% and mean intersection over union of 82.6 ± 10.8%.