MADOran: A morphologically annotated dataset of Oran

MADOran:一个经过形态学注释的奥兰语数据集

阅读:2

Abstract

This paper introduces a new morphologically annotated dataset for the Orani Arabic dialect (ORN), comprising 30,919 words gathered from diverse genres, including written language (41 %) which cover topics such as culture, history, politics, recipes, social issues, tourism, and traditions, as well as spoken language (59 %) spanning stories, songs, TV scenes, proverbs, relationships and daily conversation such as college life, family, and relationships. Each word is manually annotated with a fine-grained tagset that provides part-of-speech, root, pattern, and English and French translations of the glosses. The morphological annotation was performed using the Dialectal Word Annotation Tool for Arabic (DIWAN) and it followed guidelines established for The Dynamic Arabella Corpus (Arabella), with adaptations to fit the dialectal context. MADOran, the Morphologically Annotated Dataset of Oran, presents a valuable resource for natural language processing applications that are focused on Arabic dialect processing, including dialect identification, machine translation, text generation, and speech recognition. It enables the training of language models for capturing the unique morphological and syntactic characteristics of ORN. Moreover, the dataset supports any linguistic research where features of ORN and Modern Standard Arabic (MSA) are compared and whenever the features unique to each variety are discussed. It also aids in developing dialect-specific lexicographic resources and in facilitating Arabic language learning. The annotated dataset adheres to scientific data stewardship principles of findability, accessibility, interoperability, and reusability, which qualify MADOran for use across domains.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。