Sign language detection dataset: A resource for AI-based recognition systems

手语检测数据集:基于人工智能的识别系统的资源

阅读:1

Abstract

Sign language is a very important mode of communication among deaf and hard-of-hearing populations. Automatic sign language detection based on deep learning model is the theme of this study. Hand gestures are classified by the Convolutional Neural Network (CNN) model to different signs. For training purposes, there are 26,000 images available with 3000 images for every alphabet letter such that there is complete representation of sign language gesture. Photos were taken in controlled lighting with a consistent black background to facilitate better feature extraction. The data contains varied participants of various age groups, skin types, and hand shapes to enhance generalization. Data collection was standardized through iPhone 15 Pro Max, black background cloth, tripod stand, and remote-controlled Drodcam app to maintain consistency in image quality and framing. For diversity and realism, three participants were involved in data collection, each providing 1000 images per sign, resulting in a rich and diverse dataset. Preprocessing of data methods were used for achieving the best quality of data, such as resizing, conversion to grayscale, normalization, and augmentation. Different techniques of data augmentation like rotation, flipping, scaling, brightness change, and addition of Gaussian noise were used to introduce variations in hand gestures and make the model robust against various environmental conditions. The dataset was then partitioned into 70 % training, 15 % validation, and 15 % test sets for maximizing model performance and ensuring good generalization. The dataset show high accuracy, reflecting the potential of the model for real-world usage, such as accessibility tools for the deaf community, educational tools, and real-time sign language recognition systems.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。