Persian text readability assessment with hierarchical transformer-based classification models

基于分层Transformer分类模型的波斯语文本可读性评估

阅读:1

Abstract

Accurate readability assessment is essential for enhancing text accessibility, developing educational materials, and evaluating digital content quality. Nonetheless, unlike for English and other high-resource languages, there has been considerably less research in this area on Persian, with a few existing models employing only shallow linguistic or graph-based features. In this paper, we propose a hierarchical transformer-based model to provide readability classification for Persian. The proposed approach utilizes pretrained Persian language models to jointly encode sentence- and document-level contextual representations, eliminating the need for manual feature engineering. A newly curated and extended Persian readability corpus has also been developed to enable robust training and evaluation. The experimental results indicate that the proposed model outperforms existing feature-based and neural methods, yielding a 1.9% increase in overall classification accuracy and substantial improvements in both F1-score and cross-domain generalization. These results confirm that hierarchical contextual modeling works well for predicting readability. They also show that transformer architectures can help reduce the performance gap in automatic readability assessment between Persian and high-resource languages.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。