Deep-learning based colorectal cancer pathological analysis with hyperspectral light field microscopy

基于深度学习的高光谱光场显微镜结直肠癌病理分析

阅读:1

Abstract

5D hyperspectral light field (H-LF) integrates multi-angular and multi-spectral observation, offering a comprehensive opportunity to capture more detailed information from biological samples. In this article, we integrate hyperspectral light field microscopy imaging to analyze H&E-stained whole slide images (WSIs) of colorectal cancer (CRC). Specifically, we design a triple separable transformer encoder (HLFTST) that efficiently extracts features by decoupling the 5D H-LF data into lower-dimensional components and applying self-attention for global interaction. We also introduce a text encoder-decoder to align H-LF features with language, enabling automatic cell classification and pathology report generation through a three-stage training pipeline. Experiments show our method outperforms 2D, 3D, and 4D baselines, improving precision by up to 4.88% and F1 score by 4.21% across five CRC cell categories. Additionally, it generates meaningful pathology descriptions, highlighting its potential for enhancing diagnostics and supporting personalized treatment in broader biomedical settings.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。