Leveraging fundus images for on device eye disease diagnosis with AI powered lightweight software hardware framework

利用眼底图像,借助人工智能驱动的轻量级软硬件框架,实现设备上眼部疾病诊断。

阅读:1

Abstract

Vision loss due to illness can result from various medical conditions that affect the eyes. Advanced devices like OCT and ultra-widefield retinal cameras are expensive, making them less accessible in resource-limited settings. While eye image capture devices have transformed disease detection, they require expert analysis, and also variability between observers can lead to inconsistent diagnoses. Many devices do not seamlessly integrate with electronic health records (EHR), complicating workflow and data management. In the detection and diagnosis of eye disorders, machine learning (ML) has emerged as a vital technique. Deep learning algorithms based on individual eye diseases have been created to diagnose them. These models still have a number of drawbacks, including complexity of computation, low precision brought on by class imbalance, and increased time consumption. In order to support ophthalmologists, this study suggests an effective software-hardware framework with edge AI integration that uses a refined EfficientNetB0 model with spatial attention CNN block for rapid and accurate identification of eight types of eye illnesses using fundus images. While using pre-trained models and heatmaps is common, combining EfficientNet-B0 as a feature extractor with ImageNet-trained models for downstream classification introduces a novel hybrid pipeline. The architecture of the developed efficient net B0 model is optimized for the low-cost hardware and the work is directed to develop a smart, low latency, cost-effective device for use in underprivileged areas. Publicly accessible datasets from various sources, including 13,300 fundus and private hospital images, are used in the experimental work. The EfficientNetB0 model outperformed all other models with an accuracy of 96.2% for multi-label tasks, followed by Unet with 88% and DenseNet169 with 91%. The key aspects of the process are model optimization for edge devices, efficient preprocessing, and leveraging TensorFlow Lite's performance features for real-time disease detection with an average inference time of 5 s per image on the Raspberry Pi 5 platform.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。