Journal of Educational Evaluation for Health Professions

Jonathan Zachary Felthun

2 Articles

Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review: Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen; J Educ Eval Health Prof. 2021;18:11. Published online June 1, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.11

7,578 View
416 Download
12 Web of Science
12 Crossref

The coronavirus disease 2019 (COVID-19) pandemic has required educators to adapt the in-person objective structured clinical examination (OSCE) to online settings in order for it to remain a critical component of the multifaceted assessment of a student’s competency. This systematic scoping review aimed to summarize the assessment methods and validity and reliability of the measurement tools used in current online OSCE (hereafter, referred to as teleOSCE) approaches. A comprehensive literature review was undertaken following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines. Articles were eligible if they reported any form of performance assessment, in any field of healthcare, delivered in an online format. Two reviewers independently screened the results and analyzed relevant studies. Eleven articles were included in the analysis. Pre-recorded videos were used in 3 studies, while observations by remote examiners through an online platform were used in 7 studies. Acceptability as perceived by students was reported in 2 studies. This systematic scoping review identified several insights garnered from implementing teleOSCEs, the components transferable from telemedicine, and the need for systemic research to establish the ideal teleOSCE framework. TeleOSCEs may be able to improve the accessibility and reproducibility of clinical assessments and equip students with the requisite skills to effectively practice telemedicine in the future.

Citations

Citations to this article as recorded by

Feasibility and reliability of the pandemic-adapted online-onsite hybrid graduation OSCE in Japan
Satoshi Hara, Kunio Ohta, Daisuke Aono, Toshikatsu Tamai, Makoto Kurachi, Kimikazu Sugimori, Hiroshi Mihara, Hiroshi Ichimura, Yasuhiko Yamamoto, Hideki Nomura
Advances in Health Sciences Education.2024; 29(3): 949. CrossRef
A level playing field? Evaluation of the virtual Objective Structured Clinical Examination in Psychiatry and Addiction Medicine: A mixed methods study
Rebecca E Reay, Paul A Maguire, Jeffrey CL Looi
Australasian Psychiatry.2024; 32(4): 359. CrossRef
Conducting an objective structured clinical examination under COVID-restricted conditions
Andrea Gotzmann, John Boulet, Yichi Zhang, Judy McCormick, Mathieu Wojcik, Ilona Bartman, Debra Pugh
BMC Medical Education.2024;[Epub] CrossRef
The virtual Clinical Assessment of Skills and Competence: the impact and challenges of a digitised final examination
Kenny Chu, Shivanthi Sathanandan
BJPsych Bulletin.2023; 47(2): 110. CrossRef
Virtual Learning and Assessment in Rheumatology Fellowship Training: Objective Structured Clinical Examination Revisited
Rachel M. Wolfe, Faye N. Hant, Rumey C. Ishizawar, Lisa G. Criscione‐Schreiber, Beth L. Jonas, Kenneth S. O'Rourke, Marcy B. Bolster
Arthritis Care & Research.2023; 75(12): 2435. CrossRef
Innovations in assessment in health professions education during the COVID‐19 pandemic: A scoping review
Jamal Giri, Claire Stewart
The Clinical Teacher.2023;[Epub] CrossRef
Evaluation of the Utility of Online Objective Structured Clinical Examination Conducted During the COVID-19 Pandemic
Mona Arekat, Mohamed Hany Shehata, Abdelhalim Deifalla, Ahmed Al-Ansari, Archana Kumar, Mohamed Alsenbesy, Hamdi Alshenawi, Amgad El-Agroudy, Mariwan Husni, Diaa Rizk, Abdelaziz Elamin, Afif Ben Salah, Hani Atwa
Advances in Medical Education and Practice.2022; Volume 13: 407. CrossRef
Comparison of student pharmacists' performance on in-person vs. virtual OSCEs in a pre-APPE capstone course
Justine S. Gortney, Joseph P. Fava, Andrew D. Berti, Brittany Stewart
Currents in Pharmacy Teaching and Learning.2022; 14(9): 1116. CrossRef
Is online objective structured clinical examination teaching an acceptable replacement in post-COVID-19 medical education in the United Kingdom?: a descriptive study
Vashist Motkur, Aniket Bharadwaj, Nimalesh Yogarajah
Journal of Educational Evaluation for Health Professions.2022; 19: 30. CrossRef
Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study
Ying-Ying Yang, Pin-Hsiang Huang, Ling-Yu Yang, Chia-Chang Huang, Chih-Wei Liu, Shiau-Shian Huang, Chen-Huan Chen, Fa-Yauh Lee, Shou-Yen Kao, Boaz Shulruf
Journal of Educational Evaluation for Health Professions.2022; 19: 27. CrossRef
Applying the Student Response System in the Online Dermatologic Video Curriculum on Medical Students' Interaction and Learning Outcomes during the COVID-19 Pandemic
Chih-Tsung Hung, Shao-An Fang, Feng-Cheng Liu, Chih-Hsiung Hsu, Ting-Yu Yu, Wei-Ming Wang
Indian Journal of Dermatology.2022; 67(4): 477. CrossRef
Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 23. CrossRef

Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia: Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen; J Educ Eval Health Prof. 2021;18:23. Published online September 23, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.23

5,518 View
233 Download
4 Web of Science
5 Crossref

Abstract PDF Supplementary Material

Purpose
It aimed to compare the use of the tele-objective structured clinical examination (teleOSCE) with in-person assessment in high-stakes clinical examination so as to determine the impact of the teleOSCE on the assessment undertaken. Discussion follows regarding what skills and domains can effectively be assessed in a teleOSCE.
Methods
This study is a retrospective observational analysis. It compares the results achieved by final year medical students in their clinical examination, assessed using the teleOSCE in 2020 (n=285), with those who were examined using the traditional in-person format in 2019 (n=280). The study was undertaken at the University of New South Wales, Australia.
Results
In the domain of physical examination, students in 2020 scored 0.277 points higher than those in 2019 (mean difference=–0.277, P<0.001, effect size=0.332). Across all other domains, there was no significant difference in mean scores between 2019 and 2020.
Conclusion
The teleOSCE does not negatively impact assessment in clinical examination in all domains except physical examination. If the teleOSCE is the future of clinical skills examination, assessment of physical examination will require concomitant workplace-based assessment.

Citations

Citations to this article as recorded by

Feasibility and reliability of the pandemic-adapted online-onsite hybrid graduation OSCE in Japan
Satoshi Hara, Kunio Ohta, Daisuke Aono, Toshikatsu Tamai, Makoto Kurachi, Kimikazu Sugimori, Hiroshi Mihara, Hiroshi Ichimura, Yasuhiko Yamamoto, Hideki Nomura
Advances in Health Sciences Education.2024; 29(3): 949. CrossRef
Feasibility of an online clinical assessment of competence in physiotherapy students
Brooke Flew, Lucy Chipchase, Darren Lee, Jodie A. McClelland
Physiotherapy Theory and Practice.2024; : 1. CrossRef
Navigating digital assessments in medical education: Findings from a scoping review
Chin-Siang Ang, Sakura Ito, Jennifer Cleland
Medical Teacher.2024; : 1. CrossRef
Radiography education in 2022 and beyond - Writing the history of the present: A narrative review
Y.X. Tay, J.P. McNulty
Radiography.2023; 29(2): 391. CrossRef
Newly appointed medical faculty members’ self-evaluation of their educational roles at the Catholic University of Korea College of Medicine in 2020 and 2021: a cross-sectional survey-based study
Sun Kim, A Ra Cho, Chul Woon Chung
Journal of Educational Evaluation for Health Professions.2021; 18: 28. CrossRef

Author index