An explainable real time sensor graph transformer for dance recognition

一种用于舞蹈识别的可解释实时传感器图转换器

阅读:1

Abstract

The automatic interpretation of dance motion sequences from inertial and pressure-based sensors requires models that maintain strict temporal fidelity, preserve orientation invariance, and produce verifiable reasoning suitable for real-time deployment on constrained hardware. Existing approaches frequently lose accuracy when confronted with heterogeneous choreography, variable sensor placement, or shifting performer-specific kinematics, and they offer limited access to the decision-relevant evidence that underlies their classifications. This study introduces an explainable sensor-driven dance recognition framework constructed around an Adaptive Sensor Normalisation module that performs quaternion-based orientation correction with drift-aware Kalman refinement, a Multi-Scale Motion Feature Extractor that applies tempo-conditioned dilation schedules to capture micro-step transitions and phrase-level rhythmic structures, and a Spatio-Temporal Graph Attention Core that integrates edge-weighted graph convolutions with dual spatial-temporal attention to quantify sensor saliency and temporal concentration. A final Explainable Decision and Feedback Layer links prototype-anchored latent representations with gradient-resolved saliency vectors to expose class-specific motion determinants. The system is optimized for edge-class execution through kernel-level compression and causal attention windows operating on a 512-sample sliding segment. Experiments on three inertial datasets indicate classification accuracy up to 94.2 percent, movement-quality estimation of 92.8 percent, and sub-8.5 millisecond per-frame latency that confirms stability under tempo variation, sensor drift, and partial channel loss.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。