From Workshop to Workplace: Evaluating the Short and Long-term Transfer of Objective Structured Clinical/Practical Examination Training using Kirkpatrick's Evaluation Model

从研讨会到工作场所:运用柯克帕特里克评估模型评估客观结构化临床/实践考试培训的短期和长期迁移效果

阅读:1

Abstract

BACKGROUND: With the adoption of competency-based medical education (CBME) by the National Medical Commission of India in 2019, assessment methods such as objective structured clinical/practical examination (OSCE/OSPE) have gained importance for objectively evaluating clinical and practical competencies. However, the success of such methods largely depends on effective faculty training and subsequent transfer of training (TOT) to the workplace. AIM AND OBJECTIVES: This study aimed to evaluate the immediate and long-term TOT among medical faculty following a structured OSCE/OSPE workshop and subsequent implementation in respective departments. The objectives included to design and conduct the training workshop on OSCE/OSPE and to assess knowledge retention, skill application, and impact on student learning using Kirkpatrick's four-level evaluation model. MATERIALS AND METHODS: A prospective, interventional study was conducted over 3 years at a medical college with an annual intake of 150 MBBS students. The first phase involved training 29 faculty members across 16 departments through a 1-day OSCE/OSPE workshop. The second phase involved implementation in respective departments. Data were collected from trained faculty, peer faculty and students using reflective writing, self-efficacy questionnaires, Likert-scale feedback, and open-ended responses. Quantitative data were analyzed in terms of medians, percentages and satisfaction indices and represented in graphs, whereas qualitative data were transcribed and thematic analysis was conducted. RESULTS: A total of 29 trained faculty, 53 peer faculty, and 410 students participated in the study. Following the OSCE/OSPE workshop, 94% of departments implemented it in their workplace. Faculty showed significant improvement in knowledge, confidence, and self-efficacy, with satisfaction indices ranging from 80% to 90%. Peer faculty validated the effective application and teamwork of trained faculty. Students found OSCE/OSPE more structured, equitable, and less stressful, with improved confidence and skill retention. The study demonstrated successful TOT at all levels of Kirkpatrick's model, with sustained implementation across 3 years and regular practice thereafter, indicating strong institutional integration and impact. CONCLUSIONS: OSCE/OSPE-based assessment was perceived positively by faculty, peers, and students, reinforcing its value in CBME. Continuous follow-up and institutional commitment are essential for long-term success. The study provides strong evidence that well-structured faculty training, followed by support and evaluation, facilitates effective and sustainable TOT.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。