Emotion recognition using spatially unidimensional self-attention with fusion feature of brain effective connectivity network and spectral power

基于空间一维自注意力、融合脑有效连接网络特征和频谱功率的情绪识别

阅读:1

Abstract

Electroencephalogram(EEG)-based emotion recognition is crucial for advancing human-computer interaction (HCI), and brain network features have become a key research focus. While existing methods often concatenate brain network features with traditional single-channel features to enhance recognition performance, this direct concatenation undermines the spatial information of brain networks and hinders effective application of deep learning. In this work, we propose a novel feature fusion strategy that effectively combines two-dimensional brain effective connectivity (BEC) network features with one-dimensional spectral power features while preserving spatial information. To leverage the spatial topological properties of brain networks and the one-dimensional correlations in fused features, we further introduce a Dual-channel 1D-CNN based on Spatially Unidimensional Self-Attention (SAD-1D-CNN), designed to extract discriminative features by capturing spatial correlations within the combined data. Results show 90.61% accuracy on SEED and 82.13% on SEED-IV (2.68% higher than state-of-the-art). Comprehensive tests confirm the superiority of our fusion strategy and SAD-1D-CNN in emotion recognition. Parameter visualization reveals the attention module's ability to automatically focus on emotion-related core brain regions, and ablation experiments validate the necessity of each network module. These findings offer new perspectives for advancing emotion recognition research.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。