A bilingual Malay-English social media dataset for binary hate speech detection

用于二元仇恨言论检测的马来语-英语双语社交媒体数据集

阅读:2

Abstract

In recent years, online hate speech has posed a growing threat to user safety, social harmony, and community cohesion especially on social media platforms. However, most existing hate speech datasets are monolingual and resource-rich, which leave Southeast Asia languages such as Malay underrepresented in natural language processing research. The aim of this dataset is to handle this gap by providing a balanced and quality-controlled resource that supports machine learning applications in multilingual settings. Binary classification is selected as a foundation task because it simplifies practical deployment in real-world and early-stage detection systems. It is beneficial in low-resource languages where detailed or multi-label annotations are always unavailable or inconsistent. This dataset presents 26,985 bilingual Malay-English social media texts curated from five public sources for binary hate speech detection. It combines human-annotated and filtered through controlled pseudo-labelling to retain only high-confidence, quality-controlled texts. The dataset is provided in UTF-8 encoded CSV format with 13,609 English and 13,376 Malay-language texts. Each entry includes the social media post, binary label (0 = non-hate, 1 = hate), language identifier (en or ms), and data source information. The dataset meets clear practical demands, including training multilingual transformer-based classifiers, benchmarking cross-lingual NLP models, and developing effective hate speech detection systems and educational NLP resources for English and Malay-speaking communities.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。