KuSarcasm: Automated annotation of a sarcasm dataset using hybrid NLP techniques

KuSarcasm:使用混合自然语言处理技术自动标注讽刺数据集

阅读:1

Abstract

This paper presents KuSarcasm, a Kurdish Sorani dataset developed for the automatic detection of sarcasm expressions. KuSarcasm represents a carefully constructed resource designed to address the challenges of sarcasm identification in Sorani Kurdish, a linguistically rich but low-resource language with limited Natural Language Processing (NLP) resources. The dataset was compiled through a multi-stage process of data collection and annotation, guided by linguistic expertise and methodology. Source material was drawn from culturally significant repositories, including Kurdish proverbs, poetry, idiom collections, literary magazines such as Sekhurma, digital publications, and web archives. Extensive consultations with Kurdish linguists, editors, and researchers ensured robust annotation guidelines and cultural authenticity. Data collection relied primarily on manual efforts, complemented by Optical Character Recognition (OCR) for printed texts, web scraping, structured documentation, and filtering-based extraction, resulting in 16,833 entries. The dataset underwent comprehensive preprocessing, including deduplication, normalization, and noise removal. Automatic labelling was conducted using a locally tuned hybrid approach involving multilingual sentiment classification through Multilingual-Bidirectional Encoder Representations for Transformers (mBERT) and semantic similarity scoring through Sentence-Bidirectional Encoder Representations for Transformers (SBERT). A rule-based framework with over 100 predefined linguistic patterns further distinguished sarcastic from non-sarcastic texts based on emotional polarity and semantic proximity. Every entry is further annotated with metadata like source, matched rule, and sentiment category. Considering its scale, cultural depth, and methodological rigor, KuSarcasm provides a significant benchmark for low-resource language research, sentiment analysis, and computational linguistics while establishing a strong foundation for deep learning model development.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。