Abstract
Following successful pilots in 2006, knowledge-based assessments for those engaged in specialty training have been developed and implemented in 11 medical specialties, by the Federation of Royal Colleges of Physicians in partnership with the specialist societies. Over 400 physicians have been involved in a project that has required recruitment and training of up to 25 question writers in each discipline, and the constitution of examining boards and standard setting advisory groups in each specialty. The assessments (now known as the specialty certificate examinations) are delivered by computer-based testing in centres throughout the UK and overseas. This paper analyses the outcome of 14 examination diets, sat by 948 candidates, of whom 72% were occupying UK numbered training posts. A total of 786 candidates sat the examination in the UK, 162 in overseas centres. Pass rates among UK trainees have generally exceeded 80%, with reliability coefficients well in excess of 0.8.