No CrossRef data available.
Published online by Cambridge University Press: 13 July 2023
The docimology or "science of examinations" is a scientific discipline devoted to the study of the examination in all its dimensions. The main objective is the development of standards guaranteeing valid, reliable and objective tests. It was adopted within a Medical School in 2007.
Our aim was to analyze results of docimological survey results of written acute medicine examinations through a global approach, by discipline and by item.
This was a retrospective study analyzing the notes of acute medicine examinations (January and May sessions) of Second Cycle Medical Studies 3). We have calculated docimological parameters allowing three levels of assessment: global, by discipline, and items analysis.
We analyzed 407 scripts, 99 questions and 6,919 pieces of data. The overall success rate was 97.6%. Highest success rates were found in Medical resuscitation (87%). The lowest rate was found in emergency medicine (53%). The difficulty index for the January session was 0.53 and 0.61 for the May session. For the January session: 24% of questions were easy, 14% of questions were difficult and 61% were of acceptable difficulty. For the May session: 40% of questions were easy, 6% of questions were difficult and 54% were of acceptable difficulty. The discrimination index was 0.27 for the January session and 0.24 for the May session. Discrimination was very good in 18% of items and good in 25%. Useless and bad discrimination items were about 35% for both sessions. Average Cronbach’s Alpha was 0.84, showing good internal-consistency.
Overall, acute medical examinations have joined docimological recommendations and had an acceptable internal consistency and a good level of difficulty and discrimination. However, some weaknesses had been revealed specially for the discipline with low weighting. A reflection on the integration of questions would make up for these weaknesses. This would ensure better assessment and training.