Abstract
OBJECTIVE: This study aimed to evaluate the effectiveness of a virtual reality (VR) training system for mass casualty management, integrating artificial intelligence (AI) and machine learning (ML) to analyze trainee performance and error patterns. The goal was to identify key predictors of performance, generate personalized feedback, and provide actionable recommendations for optimizing VR-based medical training. MATERIALS AND METHODS: A total of 196 medical professionals participated in a 1-hour VR training session, followed by a 20-question assessment and a post-training evaluation survey. The DeepSeek AI framework was employed to analyze the data, utilizing clustering analysis, principal component analysis (PCA), and random forest models. Descriptive statistics, error rates, and correlation analyses were performed using R software (version 4.1.2). Machine learning models were trained to predict performance outcomes, and feature importance was assessed using the Gini index. Personalized feedback reports were generated based on clustering and error analysis results. RESULTS: The study identified three distinct trainee clusters, with the highest-performing group excelling in Trauma Assessment and Clinical Case Analysis. However, high error rates were observed in Clinical Case Analysis (69.4%) and Trauma Assessment (67.3%), indicating areas for targeted improvement. Machine learning models highlighted replacing traditional teaching methods (IncNodePurity = 25.76) and stimulating learning interest (IncNodePurity = 13.08) as the most critical factors influencing learning outcomes. AI-driven feedback provided actionable recommendations, such as redesigning complex scenarios and enhancing system usability. CONCLUSIONS: This study demonstrates the potential of integrating AI with VR training to create a more personalized and effective learning experience for medical professionals. The findings underscore the importance of adaptive, data-driven approaches in medical education, particularly in high-stakes environments such as emergency medicine. Future research should explore hybrid training models and incorporate physiological data to further enhance the efficacy of VR-based training systems.