Abstract
Objective.The EPHNOGRAM project aimed to develop a low-cost, low-power device for simultaneous electrocardiogram (ECG) and phonocardiogram (PCG) recording, with additional channels for environmental audio to enhance PCG through active noise cancellation. The objective was to study multimodal electro-mechanical activities of the heart, offering insights into the differences and synergies between these modalities during various cardiac activity levels.Approach.We developed and tested several hardware prototypes of a simultaneous ECG-PCG acquisition device. Using this technology, we collected simultaneous ECG and PCG data from 24 healthy adults during different physical activities, including resting, walking, running, and stationary biking, in an indoor fitness center. The data were annotated using a robust software that we developed for detecting ECG R-peaks and PCG S1 and S2 components, and overseen by a human expert. We also developed machine learning models using ECG-based, PCG-based, and joint ECG-PCG features, like R-R and S1-S2 intervals, to classify physical activities and analyze electro-mechanical dynamics.Main results.The results show a significant coupling between ECG and PCG components, especially during high-intensity exercise. Notable micro-variations in S2-based heart rate show differences in the heart's electrical and mechanical functions. The Lomb-Scargle periodogram and approximate entropy analyses confirm the higher volatility of S2-based heart rate compared to ECG-based heart rate. Correlation analysis shows stronger coupling between R-R and R-S1 intervals during high-intensity activities. Hybrid ECG-PCG features, like the R-S2 interval, were identified as more informative for physical activity classification through mRMR feature selection and SHAP value analysis.Significance.The EPHNOGRAM database, is available on PhysioNet. The database enhances our understanding of cardiac function, enabling future studies on the heart's mechanical and electrical interrelationships. The results of this study can contribute to improved cardiac condition diagnoses. Additionally, the designed hardware has the potential for integration into wearable devices and the development of multimodal stress test technologies.