KHPLEI
Search
- Page Path
- HOME > Search
Research article
-
Examiner seniority and experience are associated with bias when scoring communication, but not examination, skills in objective structured clinical examinations in Australia
-
Lauren Chong
, Silas Taylor, Matthew Haywood, Barbara-Ann Adelstein, Boaz Shulruf - J Educ Eval Health Prof. 2018;15:17.
- DOI: https://doi.org/10.3352/jeehp.2018.15.17
- 25,434 View
- 278 Download
- 19 Web of Science
- 17 Crossref
-
Abstract
PDF
Supplementary Material - Purpose
The biases that may influence objective structured clinical examination (OSCE) scoring are well understood, and recent research has attempted to establish the magnitude of their impact. However, the influence of examiner experience, clinical seniority, and occupation on communication and physical examination scores in OSCEs has not yet been clearly established.
Methods
We compared the mean scores awarded for generic and clinical communication and physical examination skills in 2 undergraduate medicine OSCEs in relation to examiner characteristics (gender, examining experience, occupation, seniority, and speciality). The statistical significance of the differences was calculated using the 2-tailed independent t-test and analysis of variance.
Results
Five hundred and seventeen students were examined by 237 examiners at the University of New South Wales in 2014 and 2016. Examiner gender, occupation (academic, clinician, or clinical tutor), and job type (specialist or generalist) did not significantly impact scores. Junior doctors gave consistently higher scores than senior doctors in all domains, and this difference was statistically significant for generic and clinical communication scores. Examiner experience was significantly inversely correlated with generic communication scores.
Conclusion
We suggest that the assessment of examination skills may be less susceptible to bias because this process is fairly prescriptive, affording greater scoring objectivity. We recommend training to define the marking criteria, teaching curriculum, and expected level of performance in communication skills to reduce bias in OSCE assessment. -
Citations
Citations to this article as recorded by
- Analyse systématique des évaluations de circuits multiples d’examen clinique objectif structuré (ECOS) : variables explicatives et corrélations inter-évaluateurs
E. Ollier, C. Pelissier, C. Boissier, T. Barjat, P. Berthelot, C. Boutet, X. Gocko, C. Le Hello, S. Perinel
La Revue de Médecine Interne.2024;[Epub] CrossRef - Association entre les performances cliniques des étudiants et leur réussite aux Épreuves classantes nationales informatisées : une étude de cohorte rétrospective monocentrique
L. Azoyan, Y. Lombardi, M.C. Renaud, A. Duguet, S. Georgin-Lavialle, F. Cohen-Aubart, G. Ibanez, O. Steichen
La Revue de Médecine Interne.2023; 44(1): 5. CrossRef - Bias in Medical School Clerkship Grading: Is It Time for a Change?
Rachel A. Russo, Dana M. Raml, Anna J. Kerlek, Martin Klapheke, Katherine B. Martin, Jeffrey J. Rakofsky
Academic Psychiatry.2023; 47(4): 428. CrossRef - Are we ready yet for digital transformation? Virtual versus on-campus OSCE as assessment tools in pharmacy education. A randomized controlled head-to-head comparative assessment
Zelal Kharaba, Mohammad M. AlAhmad, Asim Ahmed Elnour, Abdallah Abou Hajal, Suhad Abumweis, Mohammad A. Ghattas
Saudi Pharmaceutical Journal.2023; 31(3): 359. CrossRef - Comparing Entrustable Professional Activity Scores Given by Faculty Physicians and Senior Trainees to First-Year Residents
Steven J Katz, Dennis Wang
Cureus.2022;[Epub] CrossRef - eOSCE stations live versus remote evaluation and scores variability
Donia Bouzid, Jimmy Mullaert, Aiham Ghazali, Valentine Marie Ferré, France Mentré, Cédric Lemogne, Philippe Ruszniewski, Albert Faye, Alexy Tran Dinh, Tristan Mirault, Nathan Peiffer Smadja, Léonore Muller, Laure Falque Pierrotin, Michael Thy, Maksud Assa
BMC Medical Education.2022;[Epub] CrossRef - Development and Evaluation of an Online Exam for Exercise Physiology During the COVID-19 Pandemic
Amanda L Burdett, Nancy van Doorn, Matthew D Jones, Natalie CG Kwai, Rachel E Ward, Silas Taylor, Boaz Shulruf
Journal of Clinical Exercise Physiology.2022; 11(4): 122. CrossRef - Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study
Ying-Ying Yang, Pin-Hsiang Huang, Ling-Yu Yang, Chia-Chang Huang, Chih-Wei Liu, Shiau-Shian Huang, Chen-Huan Chen, Fa-Yauh Lee, Shou-Yen Kao, Boaz Shulruf
Journal of Educational Evaluation for Health Professions.2022; 19: 27. CrossRef - How biased are you? The effect of prior performance information on attending physician ratings and implications for learner handover
Tammy Shaw, Timothy J. Wood, Claire Touchie, Debra Pugh, Susan M. Humphrey-Murto
Advances in Health Sciences Education.2021; 26(1): 199. CrossRef - Does objective structured clinical examination examiners’ backgrounds influence the score agreement?
Oscar Gilang Purnajati, Rachmadya Nur Hidayah, Gandes Retno Rahayu
The Asia Pacific Scholar.2021; 6(2): 48. CrossRef - Ethnic and gender bias in objective structured clinical examination: A critical review
IrisC. I. Chao, Efrem Violato, Brendan Concannon, Charlotte McCartan, Sharla King, MaryRoduta Roberts
Education in the Health Professions.2021; 4(2): 37. CrossRef - Tutor–Student Partnership in Practice OSCE to Enhance Medical Education
Eve Cosker, Valentin Favier, Patrice Gallet, Francis Raphael, Emmanuelle Moussier, Louise Tyvaert, Marc Braun, Eva Feigerlova
Medical Science Educator.2021; 31(6): 1803. CrossRef - Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 23. CrossRef - Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 11. CrossRef - Is There Variability in Scoring of Student Surgical OSCE Performance Based on Examiner Experience and Expertise?
Claire L. Donohoe, Frank Reilly, Suzanne Donnelly, Ronan A. Cahill
Journal of Surgical Education.2020; 77(5): 1202. CrossRef - The role of training in student examiner rating performance in a student-led mock OSCE
Jian Hui Koo, Kim Yao Ong, Yun Ting Yap, Kum Ying Tham
Perspectives on Medical Education.2020; 10(5): 293. CrossRef - Insights into student assessment outcomes in rural clinical campuses
Boaz Shulruf, Gary Velan, Lesley Forster, Anthony O’Sullivan, Peter Harris, Silas Taylor
BMC Medical Education.2019;[Epub] CrossRef
- Analyse systématique des évaluations de circuits multiples d’examen clinique objectif structuré (ECOS) : variables explicatives et corrélations inter-évaluateurs
First
Prev
