A truth inference scheme for crowdsourcing using NLP and swin transformers

一种基于自然语言处理和SwinTransformer的众包真值推理方案

阅读:1

Abstract

Crowdsourcing has become a prevalent method for data collection across various domains, offering a scalable and cost-effective solution. However, ensuring the reliability of crowdsourced data remains a significant challenge due to the varying expertise of contributors and the complexity of tasks. Truth inference aims to derive high-quality and accurate answers from heterogeneous and noisy responses for crowdsourcing tasks. In order to address these challenges, we propose a truth inference model that integrates Natural Language Processing with transfer learning using Swin transformers. Unlike traditional transformer architectures, the Swin transformer employs a shifted windowing technique that effectively captures both local and global contextual features in textual data. This approach helps to generate more accurate embedding representations, specifically fine-tuned for nuances of crowdsourced tasks. By incorporating the Swin transformer, our model dynamically refines contributor reliability scores and task difficulty estimates, resulting in a more accurate truth inference. Experimental evaluations on multiple crowdsourcing datasets demonstrate that our approach consistently outperforms state-of-the-art methods in accuracy, scalability, and robustness, particularly under noisy and complex task conditions.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。