Indonesian sign language system (SIBI) dataset: Sentences enhanced by diverse facial expressions for total communication

印尼手语系统(SIBI)数据集:通过丰富面部表情增强句子表达,实现全面沟通

阅读:1

Abstract

Total communication in sign language is a communication approach that involves several components in conveying information, including hand movements, body movements, lip movements, and facial expressions. Currently, there is no publicly available Indonesian Sign Language (SIBI) dataset. Therefore, researchers must collect their own data. Utilizing diverse datasets can result in partiality when making inferences about the suggested approach. The SIBI dataset was built by involving 10 teachers and 10 hearing-impaired high school students. The SIBI dataset includes basic signs and sign sentences. Basic sign gestures include letters, numbers, and affixes, according to the SIBI online dictionary published by the Indonesian Government. Sentences are created by several teachers using common communication phrases during learning process. Sign language sentences are delivered using total communication, which combines lip movements, body movements, and facial expressions. The same sentence can be delivered with different facial expressions, giving different meanings. This article discusses how a sign sentence is expressed with different facial expressions. In SIBI, word morphology follows the rules of the Indonesian language. Therefore, this paper also explains the morphemic structure of the 40 sentences used as references. The use of the SIBI dataset can be adjusted to certain research parameters. The video dataset can be converted into a series of frames or images as needed for the research. Although audio is not available, the SIBI video data captures lip movements that can be used in lip reading research. The SIBI dataset can facilitate research in computer vision as well as other fields of study related to sign language.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。