Journal of Educational Evaluation for Health Professions

Research articles

Development and validation of the student ratings in clinical teaching scale in Australia: a methodological study: Pin-Hsiang Huang, Anthony John O’Sullivan, Boaz Shulruf; J Educ Eval Health Prof. 2023;20:26. Published online September 5, 2023; DOI: https://doi.org/10.3352/jeehp.2023.20.26

463 View
86 Download

Abstract PDF Supplementary Material: Purpose
This study aimed to devise a valid measurement for assessing clinical students’ perceptions of teaching practices.
Methods
A new tool was developed based on a meta-analysis encompassing effective clinical teaching-learning factors. Seventy-nine items were generated using a frequency (never to always) scale. The tool was applied to the University of New South Wales year 2, 3, and 6 medical students. Exploratory and confirmatory factor analysis (exploratory factor analysis [EFA] and confirmatory factor analysis [CFA], respectively) were conducted to establish the tool’s construct validity and goodness of fit, and Cronbach’s α was used for reliability.
Results
In total, 352 students (44.2%) completed the questionnaire. The EFA identified student-centered learning, problem-solving learning, self-directed learning, and visual technology (reliability, 0.77 to 0.89). CFA showed acceptable goodness of fit (chi-square P<0.01, comparative fit index=0.930 and Tucker-Lewis index=0.917, root mean square error of approximation=0.069, standardized root mean square residual=0.06).
Conclusion
The established tool—Student Ratings in Clinical Teaching (STRICT)—is a valid and reliable tool that demonstrates how students perceive clinical teaching efficacy. STRICT measures the frequency of teaching practices to mitigate the biases of acquiescence and social desirability. Clinical teachers may use the tool to adapt their teaching practices with more active learning activities and to utilize visual technology to facilitate clinical learning efficacy. Clinical educators may apply STRICT to assess how these teaching practices are implemented in current clinical settings.

What impacts students’ satisfaction the most from Medicine Student Experience Questionnaire in Australia: a validity study: Pin-Hsiang Huang, Gary Velan, Greg Smith, Melanie Fentoullis, Sean Edward Kennedy, Karen Jane Gibson, Kerry Uebel, Boaz Shulruf; J Educ Eval Health Prof. 2023;20:2. Published online January 18, 2023; DOI: https://doi.org/10.3352/jeehp.2023.20.2

1,078 View
108 Download
1 Citations

Purpose
This study evaluated the validity of student feedback derived from Medicine Student Experience Questionnaire (MedSEQ), as well as the predictors of students’ satisfaction in the Medicine program.
Methods
Data from MedSEQ applying to the University of New South Wales Medicine program in 2017, 2019, and 2021 were analyzed. Confirmatory factor analysis (CFA) and Cronbach’s α were used to assess the construct validity and reliability of MedSEQ respectively. Hierarchical multiple linear regressions were used to identify the factors that most impact students’ overall satisfaction with the program.
Results
A total of 1,719 students (34.50%) responded to MedSEQ. CFA showed good fit indices (root mean square error of approximation=0.051; comparative fit index=0.939; chi-square/degrees of freedom=6.429). All factors yielded good (α>0.7) or very good (α>0.8) levels of reliability, except the “online resources” factor, which had acceptable reliability (α=0.687). A multiple linear regression model with only demographic characteristics explained 3.8% of the variance in students’ overall satisfaction, whereas the model adding 8 domains from MedSEQ explained 40%, indicating that 36.2% of the variance was attributable to students’ experience across the 8 domains. Three domains had the strongest impact on overall satisfaction: “being cared for,” “satisfaction with teaching,” and “satisfaction with assessment” (β=0.327, 0.148, 0.148, respectively; all with P<0.001).
Conclusion
MedSEQ has good construct validity and high reliability, reflecting students’ satisfaction with the Medicine program. Key factors impacting students’ satisfaction are the perception of being cared for, quality teaching irrespective of the mode of delivery and fair assessment tasks which enhance learning.

Citations

Citations to this article as recorded by

Mental health and quality of life across 6 years of medical training: A year-by-year analysis
Natalia de Castro Pecci Maddalena, Alessandra Lamas Granero Lucchetti, Ivana Lucia Damasio Moutinho, Oscarina da Silva Ezequiel, Giancarlo Lucchetti
International Journal of Social Psychiatry.2023;[Epub] CrossRef

Medical student selection process enhanced by improving selection algorithms and changing the focus of interviews in Australia: a descriptive study: Boaz Shulruf, Gary Mayer Velan, Sean Edward Kennedy; J Educ Eval Health Prof. 2022;19:31. Published online November 28, 2022; DOI: https://doi.org/10.3352/jeehp.2022.19.31

1,238 View
103 Download

Abstract PDF Supplementary Material: Purpose
The study investigates the efficacy of new features introduced to the selection process for medical school at the University of New South Wales, Australia: (1) considering the relative ranks rather than scores of the Undergraduate Medicine and Health Sciences Admission Test and Australian Tertiary Admission Rank; (2) structured interview focusing on interpersonal interaction and concerns should the applicants become students; and (3) embracing interviewers’ diverse perspectives.
Methods
Data from 5 cohorts of students were analyzed, comparing outcomes of the second year in the medicine program of 4 cohorts of the old selection process and 1 of the new process. The main analysis comprised multiple linear regression models for predicting academic, clinical, and professional outcomes, by section tools and demographic variables.
Results
Selection interview marks from the new interview (512 applicants, 2 interviewers each) were analyzed for inter-rater reliability, which identified a high level of agreement (kappa=0.639). No such analysis was possible for the old interview since it required interviewers to reach a consensus. Multivariate linear regression models utilizing outcomes for 5 cohorts (N=905) revealed that the new selection process was much more effective in predicting academic and clinical achievement in the program (R2=9.4%–17.8% vs. R2=1.5%–8.4%).
Conclusion
The results suggest that the medical student selection process can be significantly enhanced by employing a non-compensatory selection algorithm; and using a structured interview focusing on interpersonal interaction and concerns should the applicants become students; as well as embracing interviewers’ diverse perspectives.

Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study: Ying-Ying Yang, Pin-Hsiang Huang, Ling-Yu Yang, Chia-Chang Huang, Chih-Wei Liu, Shiau-Shian Huang, Chen-Huan Chen, Fa-Yauh Lee, Shou-Yen Kao, Boaz Shulruf; J Educ Eval Health Prof. 2022;19:27. Published online October 17, 2022; DOI: https://doi.org/10.3352/jeehp.2022.19.27

1,339 View
109 Download

Abstract PDF Supplementary Material: Purpose
Undertaking a standard-setting exercise is a common method for setting pass/fail cut scores for high-stakes examinations. The recently introduced equal Z standard-setting method (EZ method) has been found to be a valid and effective alternative for the commonly used Angoff and Hofstee methods and their variants. The current study aims to estimate the minimum number of panelists required for obtaining acceptable and reliable cut scores using the EZ method.
Methods
The primary data were extracted from 31 panelists who used the EZ method for setting cut scores for a 12-station of medical school’s final objective structured clinical examination (OSCE) in Taiwan. For this study, a new data set composed of 1,000 random samples of different panel sizes, ranging from 5 to 25 panelists, was established and analyzed. Analysis of variance was performed to measure the differences in the cut scores set by the sampled groups, across all sizes within each station.
Results
On average, a panel of 10 experts or more yielded cut scores with confidence more than or equal to 90% and 15 experts yielded cut scores with confidence more than or equal to 95%. No significant differences in cut scores associated with panel size were identified for panels of 5 or more experts.
Conclusion
The EZ method was found to be valid and feasible. Less than an hour was required for 12 panelists to assess 12 OSCE stations. Calculating the cut scores required only basic statistical skills.

Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia: Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen; J Educ Eval Health Prof. 2021;18:23. Published online September 23, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.23

4,415 View
218 Download
3 Citations

Abstract PDF Supplementary Material

Purpose
It aimed to compare the use of the tele-objective structured clinical examination (teleOSCE) with in-person assessment in high-stakes clinical examination so as to determine the impact of the teleOSCE on the assessment undertaken. Discussion follows regarding what skills and domains can effectively be assessed in a teleOSCE.
Methods
This study is a retrospective observational analysis. It compares the results achieved by final year medical students in their clinical examination, assessed using the teleOSCE in 2020 (n=285), with those who were examined using the traditional in-person format in 2019 (n=280). The study was undertaken at the University of New South Wales, Australia.
Results
In the domain of physical examination, students in 2020 scored 0.277 points higher than those in 2019 (mean difference=–0.277, P<0.001, effect size=0.332). Across all other domains, there was no significant difference in mean scores between 2019 and 2020.
Conclusion
The teleOSCE does not negatively impact assessment in clinical examination in all domains except physical examination. If the teleOSCE is the future of clinical skills examination, assessment of physical examination will require concomitant workplace-based assessment.

Citations

Citations to this article as recorded by

Radiography education in 2022 and beyond - Writing the history of the present: A narrative review
Y.X. Tay, J.P. McNulty
Radiography.2023; 29(2): 391. CrossRef
Feasibility and reliability of the pandemic-adapted online-onsite hybrid graduation OSCE in Japan
Satoshi Hara, Kunio Ohta, Daisuke Aono, Toshikatsu Tamai, Makoto Kurachi, Kimikazu Sugimori, Hiroshi Mihara, Hiroshi Ichimura, Yasuhiko Yamamoto, Hideki Nomura
Advances in Health Sciences Education.2023;[Epub] CrossRef
Newly appointed medical faculty members’ self-evaluation of their educational roles at the Catholic University of Korea College of Medicine in 2020 and 2021: a cross-sectional survey-based study
Sun Kim, A Ra Cho, Chul Woon Chung
Journal of Educational Evaluation for Health Professions.2021; 18: 28. CrossRef

Review

Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review: Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen; J Educ Eval Health Prof. 2021;18:11. Published online June 1, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.11

5,998 View
379 Download
9 Citations

Abstract PDF Supplementary Material

The coronavirus disease 2019 (COVID-19) pandemic has required educators to adapt the in-person objective structured clinical examination (OSCE) to online settings in order for it to remain a critical component of the multifaceted assessment of a student’s competency. This systematic scoping review aimed to summarize the assessment methods and validity and reliability of the measurement tools used in current online OSCE (hereafter, referred to as teleOSCE) approaches. A comprehensive literature review was undertaken following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines. Articles were eligible if they reported any form of performance assessment, in any field of healthcare, delivered in an online format. Two reviewers independently screened the results and analyzed relevant studies. Eleven articles were included in the analysis. Pre-recorded videos were used in 3 studies, while observations by remote examiners through an online platform were used in 7 studies. Acceptability as perceived by students was reported in 2 studies. This systematic scoping review identified several insights garnered from implementing teleOSCEs, the components transferable from telemedicine, and the need for systemic research to establish the ideal teleOSCE framework. TeleOSCEs may be able to improve the accessibility and reproducibility of clinical assessments and equip students with the requisite skills to effectively practice telemedicine in the future.

Citations

Citations to this article as recorded by

The virtual Clinical Assessment of Skills and Competence: the impact and challenges of a digitised final examination
Kenny Chu, Shivanthi Sathanandan
BJPsych Bulletin.2023; 47(2): 110. CrossRef
Virtual Learning and Assessment in Rheumatology Fellowship Training: Objective Structured Clinical Examination Revisited
Rachel M. Wolfe, Faye N. Hant, Rumey C. Ishizawar, Lisa G. Criscione‐Schreiber, Beth L. Jonas, Kenneth S. O'Rourke, Marcy B. Bolster
Arthritis Care & Research.2023;[Epub] CrossRef
Feasibility and reliability of the pandemic-adapted online-onsite hybrid graduation OSCE in Japan
Satoshi Hara, Kunio Ohta, Daisuke Aono, Toshikatsu Tamai, Makoto Kurachi, Kimikazu Sugimori, Hiroshi Mihara, Hiroshi Ichimura, Yasuhiko Yamamoto, Hideki Nomura
Advances in Health Sciences Education.2023;[Epub] CrossRef
Innovations in assessment in health professions education during the COVID‐19 pandemic: A scoping review
Jamal Giri, Claire Stewart
The Clinical Teacher.2023;[Epub] CrossRef
Evaluation of the Utility of Online Objective Structured Clinical Examination Conducted During the COVID-19 Pandemic
Mona Arekat, Mohamed Hany Shehata, Abdelhalim Deifalla, Ahmed Al-Ansari, Archana Kumar, Mohamed Alsenbesy, Hamdi Alshenawi, Amgad El-Agroudy, Mariwan Husni, Diaa Rizk, Abdelaziz Elamin, Afif Ben Salah, Hani Atwa
Advances in Medical Education and Practice.2022; Volume 13: 407. CrossRef
Comparison of student pharmacists' performance on in-person vs. virtual OSCEs in a pre-APPE capstone course
Justine S. Gortney, Joseph P. Fava, Andrew D. Berti, Brittany Stewart
Currents in Pharmacy Teaching and Learning.2022; 14(9): 1116. CrossRef
Is online objective structured clinical examination teaching an acceptable replacement in post-COVID-19 medical education in the United Kingdom?: a descriptive study
Vashist Motkur, Aniket Bharadwaj, Nimalesh Yogarajah
Journal of Educational Evaluation for Health Professions.2022; 19: 30. CrossRef
Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study
Ying-Ying Yang, Pin-Hsiang Huang, Ling-Yu Yang, Chia-Chang Huang, Chih-Wei Liu, Shiau-Shian Huang, Chen-Huan Chen, Fa-Yauh Lee, Shou-Yen Kao, Boaz Shulruf
Journal of Educational Evaluation for Health Professions.2022; 19: 27. CrossRef
Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 23. CrossRef

Research articles

Effects of virtual reality training on decreasing the rates of needlestick or sharp injury in new-coming medical and nursing interns in Taiwan: Szu-Hsien Wu, Chia-Chang Huang, Shiau-Shian Huang, Ying-Ying Yang, Chih-Wei Liu, Boaz Shulruf, Chen-Huan Chen; J Educ Eval Health Prof. 2020;17:1. Published online January 20, 2020; DOI: https://doi.org/10.3352/jeehp.2020.17.1

10,419 View
397 Download
25 Citations

Abstract PDF Supplementary Material

Purpose
Senior nursing and medical interns’ lack of familiarity and confidence with respect to practicing universal precaution for the prevention of occupational needlestick or sharp injuries may harm themselves. Trainees’ self-reported needlestick or sharp injury rate was known to be especially high during the first 2 months of internship in Taiwan. This prospective cohort study aimed to assess the effect of newly developed virtual reality (VR) game, which uses Gagne’s learning model to improve universal precaution for needlestick or sharp injury prevention and decrease the rates of needle stick or sharp injuries in new-coming medical and nursing interns in Taiwan.
Methods
From 2017 to 2019, the VR system was developed and applied in training of 59 new-coming nursing and 50 medical interns. Occupational needlestick or sharp injury prevention was sought to be achieved through a game of right and wrong choices for safe or unsafe universal precaution behaviors.
Results
In comparison with medical interns, a higher proportion of nursing interns had past experiences of deep occupational needlestick or sharp injury. Before VR training, the familiarity and confidence for needlestick or sharp injury prevention were higher among nursing interns than medical interns. Trainees with past experiences of deep needlestick or sharp injury exhibited better performance on the accuracy rate and time needed to complete 20 decisions than those without past experiences in VR practice. All trainees showed an improved performance after VR training. A high proportion of trainees reported that the VR-based training significantly decreased their anxiety about needlestick or sharp injury prevention.
Conclusion
This self-developed VR game system using Gagne’s flow improved universal precaution for needlestick or sharp injury prevention and reduced the needlestick or sharp injury rates in the first 2 months of nursing and medical internship.

Citations

Citations to this article as recorded by

Impact of an immersive virtual reality simulator education program on nursing students' intravenous injection administration: A mixed methods study
Yi-Ya Chang, Li-Fen Chao, Wen Chang, Chih-Ming Lin, Yi-Hsing Lee, Abigail Latimer, Misook L. Chung
Nurse Education Today.2024; 132: 106002. CrossRef
Virtual Reality Head-Mounted Displays in Medical Education
Thomas Tursø-Finnich, Rune Overgaard Jensen, Lasse X. Jensen, Lars Konge, Ebbe Thinggaard
Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare.2023; 18(1): 42. CrossRef
Review of literature: Knowledge and practice of standard precautions by nursing student and teaching techniques used in training
Stephanie Bouget Mohammedi, Caroline Landelle
American Journal of Infection Control.2023; 51(5): 574. CrossRef
Exploring Key Factors Influencing Nursing Students’ Cognitive Load and Willingness to Serve Older Adults: Cross-sectional Descriptive Correlational Study
Pei-Lun Hsieh, Yu-Rung Wang, Tien-Chi Huang
JMIR Serious Games.2023; 11: e43203. CrossRef
The Development and Pilot Testing of Immersive Virtual Reality Simulation Training for Prelicensure Nursing Students: A Quasi-Experimental Study
Bethany Cieslowski, Tanya Haas, Kyeung Mi Oh, Kathleen Chang, Cheryl A. Oetjen
Clinical Simulation in Nursing.2023; 77: 6. CrossRef
Metaverse applied to musculoskeletal pathology: Orthoverse and Rehabverse
Juan M. Román-Belmonte, E. Carlos Rodríguez-Merchán, Hortensia De la Corte-Rodríguez
Postgraduate Medicine.2023; 135(5): 440. CrossRef
Evaluating the effectiveness of virtual reality for safety-relevant training: a systematic review
Hans Stefan, Michael Mortimer, Ben Horan
Virtual Reality.2023;[Epub] CrossRef
How, for Whom, and in Which Contexts or Conditions Augmented and Virtual Reality Training Works in Upskilling Health Care Workers: Realist Synthesis
Norina Gasteiger, Sabine N van der Veer, Paul Wilson, Dawn Dowding
JMIR Serious Games.2022; 10(1): e31644. CrossRef
Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers
Sun Huh
Journal of Educational Evaluation for Health Professions.2022; 19: 2. CrossRef
A Systematic Literature Review of Virtual, Augmented, and Mixed Reality Game Applications in Healthcare
Yu Fu, Yan Hu, Veronica Sundstedt
ACM Transactions on Computing for Healthcare.2022; 3(2): 1. CrossRef
Effectiveness of Immersive Virtual Reality in Nursing Education
Jeeyae Choi, C Elise Thompson, Jeungok Choi, Colette B. Waddill, Soyoung Choi
Nurse Educator.2022; 47(3): E57. CrossRef
Systematic Bibliometric Analysis of Research Hotspots and Trends on the Application of Virtual Reality in Nursing
Junqiang Zhao, Yi Lu, Fujun Zhou, Ruping Mao, Fangqin Fei
Frontiers in Public Health.2022;[Epub] CrossRef
Development and Pilot Testing of a Non-stress Test Virtual Reality Simulator
Li-Fen Chao, Tsuey-Yuan Huang, Debra K. Moser, Fen-Fang Chung, Ying-Tung Lau, Xaviera Xiao
CIN: Computers, Informatics, Nursing.2022; 40(6): 357. CrossRef
The Effect of a Child Model on Breath-Sounds Examination Skills and Satisfaction on Nursing Students
Silpthai Thamruangrit, Sermsri Santati, Jumpee Granger, Dongruethai Buadong, Jatuporn Thongsri
Healthcare.2022; 10(7): 1165. CrossRef
Theories informing technology enhanced learning in nursing and midwifery education: A systematic review and typological classification
Siobhan O'Connor, Stephanie Kennedy, Yajing Wang, Amna Ali, Samantha Cooke, Richard G. Booth
Nurse Education Today.2022; 118: 105518. CrossRef
Tendência temporal dos acidentes por exposição percutânea em um hospital público no Brasil, 2007-2019
Renan Sallazar Ferreira Pereira, Cecília Angelita dos Santos, Adriano Marçal Pimenta
Revista Brasileira de Enfermagem.2022;[Epub] CrossRef
Temporal trend of accidents due to percutaneous exposure in a public hospital in Brazil, 2007-2019
Renan Sallazar Ferreira Pereira, Cecília Angelita dos Santos, Adriano Marçal Pimenta
Revista Brasileira de Enfermagem.2022;[Epub] CrossRef
Mild simulator sickness can alter heart rate variability, mental workload, and learning outcomes in a 360° virtual reality application for medical education: a post hoc analysis of a randomized controlled trial
Li-Jen Hsin, Yi-Ping Chao, Hai-Hua Chuang, Terry B. J. Kuo, Cheryl C. H. Yang, Chung-Guei Huang, Chung-Jan Kang, Wan-Ni Lin, Tuan-Jen Fang, Hsueh-Yu Li, Li-Ang Lee
Virtual Reality.2022;[Epub] CrossRef
Influence of Technology in Supporting Quality and Safety in Nursing Education
Gerry Altmiller, Loraine Hopkins Pepe
Nursing Clinics of North America.2022; 57(4): 551. CrossRef
Virtual reality simulations in nurse education: A systematic mapping review
Christian Plotzky, Ulrike Lindwedel, Michaela Sorber, Barbara Loessl, Peter König, Christophe Kunze, Christiane Kugler, Michael Meng
Nurse Education Today.2021; 101: 104868. CrossRef
Virtual Reality in Healthcare Skills Training: The Effects of Presence on Acceptance and Increase of Knowledge
Christian Plotzky, Ulrike Lindwedel, Alexander Bejan, Peter König, Christophe Kunze
i-com.2021; 20(1): 73. CrossRef
A systematic review of immersive virtual reality for industrial skills training
Unnikrishnan Radhakrishnan, Konstantinos Koumaditis, Francesco Chinello
Behaviour & Information Technology.2021; 40(12): 1310. CrossRef
No difference in learning outcomes and usability between using controllers and hand tracking during a virtual reality endotracheal intubation training for medical students in Thailand
Chaowanan Khundam, Naparat Sukkriang, Frédéric Noël
Journal of Educational Evaluation for Health Professions.2021; 18: 22. CrossRef
How to train health personnel to protect themselves from SARS-CoV-2 (novel coronavirus) infection when caring for a patient or suspected case
Sun Huh
Journal of Educational Evaluation for Health Professions.2020; 17: 10. CrossRef
Knowledge, attitude and behavior towards COVID-19 among the Turkish healthcare workers
Yasin Uzuntarla, Sumeyra Ceyhan
Journal of Clinical Medicine of Kazakhstan.2020; 6(60): 93. CrossRef

Dreyfus scale-based feedback increased medical students’ satisfaction with the complex cluster part of a interviewing and physical examination course and improved skills readiness in Taiwan: Shiau-Shian Huang, Chia-Chang Huang, Ying-Ying Yang, Shuu-Jiun Wang, Boaz Shulruf, Chen-Huan Chen; J Educ Eval Health Prof. 2019;16:30. Published online October 11, 2019; DOI: https://doi.org/10.3352/jeehp.2019.16.30

9,973 View
125 Download

Abstract PDF Supplementary Material: Purpose
In contrast to the core part of the clinical interviewing and physical examination (PE) skills course, corresponding to the basic, head-to-toe, and thoracic systems, learners need structured feedback in the cluster part of the course, which includes the abdominal, neuromuscular, and musculoskeletal systems. This study evaluated the effects of using Dreyfus scale-based feedback, which has elements of continuous professional development, instead of Likert scale-based feedback in the cluster part of training in Taiwan.
Methods
Instructors and final-year medical students in the 2015–2016 classes of National Yang-Ming University, Taiwan comprised the regular cohort, whereas those in the 2017–2018 classes formed the intervention cohort. In the intervention cohort, Dreyfus scale-based feedback, rather than Likert scale-based feedback, was used in the cluster part of the course.
Results
In the cluster part of the course in the regular cohort, pre-trained standardized patients rated the class climate as poor, and students expressed low satisfaction with the instructors and course and low self-assessed readiness. In comparison with the regular cohort, improved end-of-course group objective structured clinical examination scores after the cluster part were noted in the intervention cohort. In other words, the implementation of Dreyfus scale-based feedback in the intervention cohort for the cluster part improved the deficit in this section of the course.
Conclusion
The implementation of Dreyfus scale-based feedback helped instructors to create a good class climate in the cluster part of the clinical interviewing and PE skills course. Simultaneously, this new intervention achieved the goal of promoting medical students’ readiness for interviewing, PE, and self-directed learning.

Definition of professionalism and tools for assessing professionalism in pharmacy practice: a systematic review: Huda Dubbai, Barbara-Ann Adelstein, Silas Taylor, Boaz Shulruf; J Educ Eval Health Prof. 2019;16:22. Published online August 21, 2019; DOI: https://doi.org/10.3352/jeehp.2019.16.22

17,507 View
409 Download
14 Citations

Abstract PDF Supplementary Material

Purpose
In contemporary pharmacy, the role of pharmacists has become more multifaceted, as they now handle a wider range of tasks and take more responsibility for providing patient care than 20 years ago. This evolution in pharmacists’ responsibilities has been accompanied by the need for pharmacists to display high-quality patient-centred care and counselling, and to demonstrate professionalism, which now needs to be taught and assessed as part of pharmacy education and practice. This study aimed at identifying definitions of professionalism in pharmacy practice and critically evaluating published instruments for assessing professionalism in pharmacy practice.
Methods
We searched the medical literature listed in Scopus, MEDLINE, and PsycINFO databases from 1 January 2000 to 31 December 2018. All papers meeting our selection criteria were reviewed and summarised into a clear review of professionalism requirements in pharmacy practice. Details of the instruments measuring professionalism were reviewed in detail.
Results
There is no accepted simple definition of professionalism, although we identified several theoretical and policy frameworks required for professional pharmaceutical practice. We identified 4 instruments (the Behavioural Professionalism Assessment Instrument, Lerkiatbundit’s instrument, the Pharmacy Professionalism Instrument, and the Professionalism Assessment Tool that build on these frameworks and measure professional practice in pharmacy students. These were found to be reliable and valid, but had only been used and tested in student populations.
Conclusion
Given the increasingly broad role of community pharmacists, there is a need for assessments of professionalism in practice. Professionalism is a complex concept that is challenging to measure because it has no standardised definition and the existing literature related to the topic is limited. Currently available instruments focus on measuring the development of the elements of professionalism among pharmacy students, rather than pharmacists.

Citations

Citations to this article as recorded by

Dress codes written for dietetics education programs: A Foucauldian discourse analysis
Michele A “Shelly” DeBiasse, Shannon M Peters, Baderha Bujiriri
Feminism & Psychology.2023; 33(2): 276. CrossRef
Preceptor Perceptions of Pharmacy Student Performance Before and After a Curriculum Transformation
Catherine A. Forrester, Da Sol Lee, Ethel Hon, Kai Ying Lim, Tina P. Brock, Daniel T. Malone, Simon G. Furletti, Kayley M. Lyons
American Journal of Pharmaceutical Education.2023; 87(2): ajpe8575. CrossRef
Physicians’ professionalism from the patients’ perspective: a qualitative study at a single-family practice in Saudi Arabia
Eiad AlFaris, Farhana Irfan, Noura Abouammoh, Nasriah Zakaria, Abdullah MA Ahmed, Omar Kasule, Dina M Aldosari, Nora A AlSahli, Mohammed Ghatar Alshibani, Gominda Ponnamperuma
BMC Medical Ethics.2023;[Epub] CrossRef
Behaviours that contribute to pharmacist professionalism: a scoping review
Deanna Mill, Amy Theresa Page, Jacinta Johnson, Renae Lloyd, Sandra Salter, Kenneth Lee, Liza Seubert, Rhonda Marise Clifford, Danielle D’Lima
BMJ Open.2023; 13(6): e070265. CrossRef
Estamos preparando os futuros médicos para atendimentos de situações de violência com enfoque em gênero e em sexualidades não heterossexuais? Relato de uma “experiência” educacional diagnóstica
Beatriz Angélica Cruz, Ana Flávia Azevedo Querichelli, Lucas Uback, Alba Regina de Abreu Lima, Júlio César André
Interface - Comunicação, Saúde, Educação.2023;[Epub] CrossRef
Are we preparing future doctors for assistance in situations of violence with a focus on gender and non-heterosexual sexualities? Report of a diagnostic educational “experience”
Beatriz Angélica Cruz, Ana Flávia Azevedo Querichelli, Lucas Uback, Alba Regina de Abreu Lima, Júlio César André
Interface - Comunicação, Saúde, Educação.2023;[Epub] CrossRef
Cross-cultural adaptation and psychometric evaluation of the “Modification of Hall’s professionalism scale for use with pharmacists”
Fernando de Castro Araújo Neto, Thaís Maria Araújo Tavares, Douglas de Menezes Santos, Francielly Lima da Fonseca, Dyego Carlos Souza Anacleto de Araújo, Alessandra Rezende Mesquita, Divaldo Pereira de Lyra
BMC Medical Education.2023;[Epub] CrossRef
Professional tress code: I look like a pharmacist
Natalie Rosario, Joshua Wollen
Journal of the American Pharmacists Association.2022; 62(2): 424. CrossRef
Exploration of changes in pharmacy students’ perceptions of and attitudes towards professionalism: outcome of a community pharmacy experiential learning programme in Taiwan
Yen-Ming Huang, Hsun-Yu Chan, Ping-Ing Lee, Yun-Wen Tang, Ta-Wei Chiou, Karin C.S. Chen Liu, Yunn-Fang Ho
BMC Medical Education.2022;[Epub] CrossRef
Medical students’ self-evaluation of character, and method of character education
Yera Hur, Sanghee Yeo, Keumho Lee
BMC Medical Education.2022;[Epub] CrossRef
Professionalism development and assessment in the pre-registration pharmacist placement in England: transformative moments and maturation periods
Helen Ireland, Julie Sowter, Rebecca O’Rourke
International Journal of Pharmacy Practice.2022; 30(4): 367. CrossRef
Tatted not tattered
Natalie Rosario, Joshua Wollen
Journal of the American Pharmacists Association.2022; 62(5): 1538. CrossRef
Evaluation of an Instrument to Assess Students’ Personal and Professional Development During the Faculty Advising Process
Justine S. Gortney, Minakshi Lahiri, Chris Giuliano, Heba Saleem, Mehvish Khan, Francine Salinitri, Richard Lucarotti
American Journal of Pharmaceutical Education.2021; 85(3): 8201. CrossRef
Pharmacists’ clinical knowledge and practice in the safe use of contraceptives: real knowledge vs. self-perception and the implications
Ana Golić Jelić, Ljiljana Tasić, Ranko Škrbić, Valentina Marinković, Svjetlana Stoisavljević Šatara, Nataša Stojaković, Vanda Marković Peković, Brian Godman
BMC Medical Education.2021;[Epub] CrossRef

An expert-led and artificial intelligence system-assisted tutoring course to improve the confidence of Chinese medical interns in suturing and ligature skills: a prospective pilot study: Ying-Ying Yang, Boaz Shulruf; J Educ Eval Health Prof. 2019;16:7. Published online April 10, 2019; DOI: https://doi.org/10.3352/jeehp.2019.16.7

17,830 View
294 Download
13 Citations

Abstract PDF Supplementary Material

Purpose
Lack of confidence in suturing/ligature skills due to insufficient practice and assessments is common among novice Chinese medical interns. This study aimed to improve the skill acquisition of medical interns through a new intervention program.
Methods
In addition to regular clinical training, expert-led or expert-led plus artificial intelligence (AI) system tutoring courses were implemented during the first 2 weeks of the surgical block. Interns could voluntarily join the regular (no additional tutoring), expert-led tutoring, or expert-led+AI tutoring groups freely. In the regular group, interns (n=25) did not receive additional tutoring. The expert-led group received 3-hour expert-led tutoring and in-training formative assessments after 2 practice sessions. After a similar expert-led course, the expert-led+AI group (n=23) practiced and assessed their skills on an AI system. Through a comparison with the internal standard, the system automatically recorded and evaluated every intern’s suturing/ligature skills. In the expert-led+AI group, performance and confidence were compared between interns who participated in 1, 2, or 3 AI practice sessions.
Results
The end-of-surgical block objective structured clinical examination (OSCE) performance and self-assessed confidence in suturing/ligature skills were highest in the expert-led+AI group. In comparison with the expert-led group, the expert-led+AI group showed similar performance in the in-training assessment and greater improvement in the end-of-surgical block OSCE. In the expert-led+AI group, the best performance and highest post-OSCE confidence were noted in those who engaged in 3 AI practice sessions.
Conclusion
This pilot study demonstrated the potential value of incorporating an additional expert-led+AI system–assisted tutoring course into the regular surgical curriculum.

Citations

Citations to this article as recorded by

Automated measurement extraction for assessing simple suture quality in medical education
Thanapon Noraset, Prawej Mahawithitwong, Wethit Dumronggittigule, Pongthep Pisarnturakit, Cherdsak Iramaneerat, Chanean Ruansetakit, Irin Chaikangwan, Nattanit Poungjantaradej, Nutcha Yodrabum
Expert Systems with Applications.2024; 241: 122722. CrossRef
Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education
Thomas K.F. Chiu, Qi Xia, Xinyan Zhou, Ching Sing Chai, Miaoting Cheng
Computers and Education: Artificial Intelligence.2023; 4: 100118. CrossRef
The impact of Generative AI (GenAI) on practices, policies and research direction in education: a case of ChatGPT and Midjourney
Thomas K. F. Chiu
Interactive Learning Environments.2023; : 1. CrossRef
Application value of an artificial intelligence-based diagnosis and recognition system in gastroscopy training for graduate students in gastroenterology: a preliminary study
Peng An, Zhongqiu Wang
Wiener Medizinische Wochenschrift.2023;[Epub] CrossRef
Technological advancements in surgical laparoscopy considering artificial intelligence: a survey among surgeons in Germany
Sebastian Lünse, Eric L. Wisotzky, Sophie Beckmann, Christoph Paasch, Richard Hunger, René Mantke
Langenbeck's Archives of Surgery.2023;[Epub] CrossRef
Artificial Intelligence Methods and Artificial Intelligence-Enabled Metrics for Surgical Education: A Multidisciplinary Consensus
S Swaroop Vedula, Ahmed Ghazi, Justin W Collins, Carla Pugh, Dimitrios Stefanidis, Ozanan Meireles, Andrew J Hung, Steven Schwaitzberg, Jeffrey S Levy, Ajit K Sachdeva
Journal of the American College of Surgeons.2022; 234(6): 1181. CrossRef
The use and future perspective of Artificial Intelligence—A survey among German surgeons
Mathieu Pecqueux, Carina Riediger, Marius Distler, Florian Oehme, Ulrich Bork, Fiona R. Kolbinger, Oliver Schöffski, Peter van Wijngaarden, Jürgen Weitz, Johannes Schweipert, Christoph Kahlert
Frontiers in Public Health.2022;[Epub] CrossRef
TIPTA YAPAY ZEKA UYGULAMALARI
Hatice KELEŞ
Kırıkkale Üniversitesi Tıp Fakültesi Dergisi.2022; 24(3): 604. CrossRef
Application of Artificial Intelligence in Medicine: An Overview
Peng-ran Liu, Lin Lu, Jia-yao Zhang, Tong-tong Huo, Song-xiang Liu, Zhe-wei Ye
Current Medical Science.2021; 41(6): 1105. CrossRef
Applications and Effects of EdTech in Medical Education
Hyeonmi Hong, Youngjon Kim
Korean Medical Education Review.2021; 23(3): 160. CrossRef
Artificial Intelligence Education and Tools for Medical and Health Informatics Students: Systematic Review
A Hasan Sapci, H Aylin Sapci
JMIR Medical Education.2020; 6(1): e19285. CrossRef
Scientific Development of Educational Artificial Intelligence in Web of Science
Antonio-José Moreno-Guerrero, Jesús López-Belmonte, José-Antonio Marín-Marín, Rebeca Soler-Costa
Future Internet.2020; 12(8): 124. CrossRef
An Educational Network for Surgical Education Supported by Gamification Elements: Protocol for a Randomized Controlled Trial
Natasha Guérard-Poirier, Michèle Beniey, Léamarie Meloche-Dumas, Florence Lebel-Guay, Bojana Misheva, Myriam Abbas, Malek Dhane, Myriam Elraheb, Adam Dubrowski, Erica Patocskai
JMIR Research Protocols.2020; 9(12): e21273. CrossRef

Comparison of the effects of simulated patient clinical skill training and student roleplay on objective structured clinical examination performance among medical students in Australia: Silas Taylor, Matthew Haywood, Boaz Shulruf; J Educ Eval Health Prof. 2019;16:3. Published online January 11, 2019; DOI: https://doi.org/10.3352/jeehp.2019.16.3

20,324 View
400 Download
10 Citations

Abstract PDF Supplementary Material

Purpose
Optimal methods for communication skills training (CST) are an active research area, but the effects of CST on communication performance in objective structured clinical examinations (OSCEs) has not been closely studied. Student roleplay (RP) for CST is common, although volunteer simulated patient (SP) CST is cost-effective and provides authentic interactions. We assessed whether our volunteer SP CST program improved OSCE performance compared to our previous RP strategy.
Methods
We performed a retrospective, quasi-experimental study of 2 second-year medical student cohorts’ OSCE data in Australia. The 2014 cohort received RP-only CST (N=182) while the 2016 cohort received SP-only CST (N=148). The t-test and analysis of variance were used to compare the total scores in 3 assessment domains: generic communication, clinical communication, and physical examination/procedural skills.
Results
The baseline characteristics of groups (scores on the Australian Tertiary Admission Rank, Undergraduate Medicine and Health Sciences Admission Test, and medicine program interviews) showed no significant differences between groups. For each domain, the SP-only CST group demonstrated superior OSCE outcomes, and the difference between cohorts was significant (P<0.01). The superiority of volunteer SP CST over student RP CST in terms of OSCE performance outcomes was found for generic communication, clinical communication, and physical examination/procedural skills.
Conclusion
The better performance of the SP cohort in physical examination/procedural skills might be explained by the requirement for patient compliance and cooperation, facilitated by good generic communication skills. We recommend a volunteer SP program as an effective and efficient way to improve CST among junior medical students.

Citations

Citations to this article as recorded by

A cost analysis of a 5-day simulation-based learning program for speech-language pathology student training
Elizabeth C. Ward, Emma Caird, Saval Khanal, Sanjeewa Kularatna, Joshua Byrnes, Adriana Penman, Sue Mcallister, Stacey Baldac, Elizabeth Cardell, Rachel Davenport, Bronwyn Davidson, Sally Hewat, Simone Howells, Patricia Mccabe, Alison Purcell, Joanne Walt
International Journal of Speech-Language Pathology.2023; 25(5): 688. CrossRef
Perception of simulation-based first-aid training by medical students: a qualitative descriptive study
Lukáš Plch, Daniel Barvík, Tereza Prokopová, Aneta Pilátová, Tereza Vafková, Jiří Zounek
SN Social Sciences.2023;[Epub] CrossRef
Application of objective structured clinical examination (OSCE) for the evaluation of Kampo medicine training
Marie Amitani, Haruka Amitani, Hajime Suzuki, Suguru Kawazu, Kimiko Mizuma, Kojiro Yamaguchi, Toshimichi Oki, Hideaki Nitta, Takuro Sonoda, Keiko Kawano, Yasuhiro Tanaka, Nanami Uto, Rie Ibusuki, Ryutaro Arita, Shin Takayama, Tadamichi Mitsuma, Toshiro Ta
BMC Medical Education.2022;[Epub] CrossRef
The Use of Simulated Patients Is more Effective than Student Role Playing in Fostering Patient-Centred Attitudes during Communication Skills Training: A Mixed Method Study
Stanislaw Gorski, Anna Prokop-Dorner, Michal Pers, Agata Stalmach-Przygoda, Łukasz Malecki, Grzegorz Cebula, Katrien Bombeke, Mauro Henrique Nogueira Guimarães Abreu
BioMed Research International.2022; 2022: 1. CrossRef
Improved detection of patient centeredness in objective structured clinical examinations through authentic scenario design
Kye-Yeung Park, Hoon-Ki Park, Hwan-Sik Hwang, Sang-Ho Yoo, Jae-Sook Ryu, Jong-Hoon Kim
Patient Education and Counseling.2021; 104(5): 1094. CrossRef
Interventions for improving medical students' interpersonal communication in medical consultations
Conor Gilligan, Martine Powell, Marita C Lynagh, Bernadette M Ward, Chris Lonsdale, Pam Harvey, Erica L James, Dominique Rich, Sari P Dewi, Smriti Nepal, Hayley A Croft, Jonathan Silverman
Cochrane Database of Systematic Reviews.2021;[Epub] CrossRef
Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 23. CrossRef
Raising rare disease awareness using red flags, role play simulation and patient educators: results of a novel educational workshop on Raynaud phenomenon and systemic sclerosis
S. Sanges, M.-M. Farhat, M. Assaraf, J. Galland, E. Rivière, C. Roubille, M. Lambert, C. Yelnik, H. Maillard, V. Sobanski, G. Lefèvre, D. Launay, S. Morell-Dubois, E. Hachulla
Orphanet Journal of Rare Diseases.2020;[Epub] CrossRef
Improved clinical communication OSCE scores after simulation-based training: Results of a comparative study
Alexandre Nuzzo, Alexy Tran-Dinh, Marie Courbebaisse, Hugo Peyre, Patrick Plaisance, Alexandre Matet, Brigitte Ranque, Albert Faye, Victoire de Lastours, Conor Gilligan
PLOS ONE.2020; 15(9): e0238542. CrossRef
Comparison of students' performance of objective structured clinical examination during clinical practice
Jihye Yu, Sukyung Lee, Miran Kim, Janghoon Lee
Korean Journal of Medical Education.2020; 32(3): 231. CrossRef

The sights and insights of examiners in objective structured clinical examinations: Lauren Chong, Silas Taylor, Matthew Haywood, Barbara-Ann Adelstein, Boaz Shulruf; J Educ Eval Health Prof. 2017;14:34. Published online December 27, 2017; DOI: https://doi.org/10.3352/jeehp.2017.14.34

30,594 View
387 Download
30 Citations

Abstract PDF Supplementary Material

Purpose
The objective structured clinical examination (OSCE) is considered to be one of the most robust methods of clinical assessment. One of its strengths lies in its ability to minimise the effects of examiner bias due to the standardisation of items and tasks for each candidate. However, OSCE examiners’ assessment scores are influenced by several factors that may jeopardise the assumed objectivity of OSCEs. To better understand this phenomenon, the current review aims to determine and describe important sources of examiner bias and the factors affecting examiners’ assessments.
Methods
We performed a narrative review of the medical literature using Medline. All articles meeting the selection criteria were reviewed, with salient points extracted and synthesised into a clear and comprehensive summary of the knowledge in this area.
Results
OSCE examiners’ assessment scores are influenced by factors belonging to 4 different domains: examination context, examinee characteristics, examinee-examiner interactions, and examiner characteristics. These domains are composed of several factors including halo, hawk/dove and OSCE contrast effects; the examiner’s gender and ethnicity; training; lifetime experience in assessing; leadership and familiarity with students; station type; and site effects.
Conclusion
Several factors may influence the presumed objectivity of examiners’ assessments, and these factors need to be addressed to ensure the objectivity of OSCEs. We offer insights into directions for future research to better understand and address the phenomenon of examiner bias.

Citations

Citations to this article as recorded by

Educational guidelines for diversity and inclusion: addressing racism and eliminating biases in medical education
Samantha D. Buery-Joyner, Laura Baecher-Lind, Camille A. Clare, B. Star Hampton, Michael D. Moxley, Dotun Ogunyemi, Archana A. Pradhan, Shireen M. Madani Sims, Sara Whetstone, Mark B. Woodland, Nadine T. Katz
American Journal of Obstetrics and Gynecology.2023; 228(2): 133. CrossRef
Quality Management of Objective Structured Clinical Examinations at a Multicampus Nursing College: A Pilot Study
Thandolwakhe Nyangeni, Dalena R.M. van Rooyen, Wilma ten Ham-Baloyi
Journal of Nursing Education.2023; 62(3): 155. CrossRef
Scoring consistency of standard patients and examiners in the developed dental objective structured clinical examination system
Feng Zhu, Li Wu, Xiuxiu Shao, Lijuan Huang, Xiangfeng Meng, Rongrong Nie
BMC Medical Education.2023;[Epub] CrossRef
Assessing the utility of a novel entrustment‐supervision assessment tool
Sebastian Dewhirst, Timothy J. Wood, Warren J. Cheung, Jason R. Frank
Medical Education.2023;[Epub] CrossRef
Pre-COVID and COVID experience of objective structured clinical examination as a learning tool for post-graduate residents in Obstetrics & Gynecology-a quality improvement study
Charu Sharma, Pratibha Singh, Shashank Shekhar, Abhishek Bhardwaj, Manisha Jhirwal, Navdeep Kaur Ghuman, Meenakshi Gothwal, Garima Yadav, Priyanka Kathuria, Vibha Mishra
Obstetrics & Gynecology Science.2023; 66(4): 316. CrossRef
Does following an “excellent” candidate in the objective structured clinical examination affect your checklist score?
Craig Brown, Mintu Nath, Wendy Watson, Mary Joan Macleod
Journal of Applied Research in Higher Education.2023;[Epub] CrossRef
Interactions between the sex of the clinician grader and the sex of the chiropractic student intern on spinal manipulation assessment grade
Michael Sheppard, Stephanie Johnson, Victor Quiroz, John Ward
Journal of Chiropractic Education.2023; 37(2): 157. CrossRef
Objective structured clinical examination for teaching and assessment: Evidence-based critique
Pooja Dewan, Sumaira Khalil, Piyush Gupta
Clinical Epidemiology and Global Health.2023; : 101477. CrossRef
Response to: Twelve tips for conducting a virtual OSCE
Mohamed Guled, Juned Islam, Haseeb Qureshi
Medical Teacher.2022; 44(1): 101. CrossRef
Comparison of OSCE performance between 6- and 7-year medical school curricula in Taiwan
Jr-Wei Wu, Hao-Min Cheng, Shiau-Shian Huang, Jen-Feng Liang, Chia-Chang Huang, Ling-Yu Yang, Boaz Shulruf, Ying-Ying Yang, Chen-Huan Chen, Ming-Chih Hou, Wayne Huey-Herng Sheu
BMC Medical Education.2022;[Epub] CrossRef
Factors Associated With Undergraduate Nursing Students' Academic and Clinical Performance: A Mixed-Methods Study
Ensieh Fooladi, Md Nazmul Karim, Sheila Vance, Lorraine Walker, Maya Ebrahimi Zanjani, Dragan Ilic, Gabrielle Brand
Frontiers in Medicine.2022;[Epub] CrossRef
Medical Students’ Perception of a Newly Implemented Objective Structured Clinical Examination (OSCE) in Orthopedic Surgery and Trauma: A Mixed-Method Study
Asser Sallam, Hani Atwa, Adel Abdelaziz, Asmaa Abdel Nasser
Journal of Ecophysiology and Occupational Health.2022; 22(1): 29. CrossRef
Using Think-aloud Interviews to Examine a Clinically Oriented Performance Assessment Rubric
Mary Roduta Roberts, Chad M. Gotch, Megan Cook, Karin Werther, Iris C. I. Chao
Measurement: Interdisciplinary Research and Perspectives.2022; 20(3): 139. CrossRef
Objective structured clinical examination: Challenges and opportunities from students’ perspective
Nazdar Alkhateeb, Abubakir Majeed Salih, Nazar Shabila, Ali Al-Dabbagh, Ayse Hilal Bati
PLOS ONE.2022; 17(9): e0274055. CrossRef
Medical school grades may predict future clinical competence
Jr-Wei Wu, Hao-Min Cheng, Shiau-Shian Huang, Jen-Feng Liang, Chia-Chang Huang, Boaz Shulruf, Ying-Ying Yang, Chen-Huan Chen, Ming-Chih Hou, Wayne Huey-Herng Sheu
Journal of the Chinese Medical Association.2022; 85(9): 909. CrossRef
Development and Evaluation of an Online Exam for Exercise Physiology During the COVID-19 Pandemic
Amanda L Burdett, Nancy van Doorn, Matthew D Jones, Natalie CG Kwai, Rachel E Ward, Silas Taylor, Boaz Shulruf
Journal of Clinical Exercise Physiology.2022; 11(4): 122. CrossRef
eOSCE stations live versus remote evaluation and scores variability
Donia Bouzid, Jimmy Mullaert, Aiham Ghazali, Valentine Marie Ferré, France Mentré, Cédric Lemogne, Philippe Ruszniewski, Albert Faye, Alexy Tran Dinh, Tristan Mirault, Nathan Peiffer Smadja, Léonore Muller, Laure Falque Pierrotin, Michael Thy, Maksud Assa
BMC Medical Education.2022;[Epub] CrossRef
Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study
Ying-Ying Yang, Pin-Hsiang Huang, Ling-Yu Yang, Chia-Chang Huang, Chih-Wei Liu, Shiau-Shian Huang, Chen-Huan Chen, Fa-Yauh Lee, Shou-Yen Kao, Boaz Shulruf
Journal of Educational Evaluation for Health Professions.2022; 19: 27. CrossRef
Augmenting physician examiner scoring in objective structured clinical examinations: including the standardized patient perspective
Marguerite Roy, Josée Wojcik, Ilona Bartman, Sydney Smee
Advances in Health Sciences Education.2021; 26(1): 313. CrossRef
Re-conceptualising and accounting for examiner (cut-score) stringency in a ‘high frequency, small cohort’ performance test
Matt Homer
Advances in Health Sciences Education.2021; 26(2): 369. CrossRef
Comparison of the validity of bookmark and Angoff standard setting methods in medical performance tests
Majid Yousefi Afrashteh
BMC Medical Education.2021;[Epub] CrossRef
Examiners’ decision‐making processes in observation‐based clinical examinations
Bunmi S. Malau‐Aduli, Richard B. Hays, Karen D’Souza, Amy M. Smith, Karina Jones, Richard Turner, Lizzi Shires, Jane Smith, Shannon Saad, Cassandra Richmond, Antonio Celenza, Tarun Sen Gupta
Medical Education.2021; 55(3): 344. CrossRef
Tutor–Student Partnership in Practice OSCE to Enhance Medical Education
Eve Cosker, Valentin Favier, Patrice Gallet, Francis Raphael, Emmanuelle Moussier, Louise Tyvaert, Marc Braun, Eva Feigerlova
Medical Science Educator.2021; 31(6): 1803. CrossRef
Perception of Students and Examiners about Objective Structured Clinical Examination in a Teaching Hospital in Ethiopia
Henok Fisseha, Hailemichael Desalegn
Advances in Medical Education and Practice.2021; Volume 12: 1439. CrossRef
The Impact of COVID-19 Pandemic on the Learning Outcomes of Medical Students in Taiwan: A Two-Year Prospective Cohort Study of OSCE Performance
Tzyy-Yurn Tzeng, Chia-An Hsu, Ying-Ying Yang, Eunice J. Yuan, Ya-Ting Chang, Tzu-Hao Li, Chung-Pin Li, Jen-Feng Liang, Jiing-Feng Lirng, Tzeng-Ji Chen, Chia-Chang Huang, Ming-Chih Hou, Chen-Huan Chen, Wayne Huey-Herng Sheu
International Journal of Environmental Research and Public Health.2021; 19(1): 208. CrossRef
Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 11. CrossRef
Versatility in multiple mini-interview implementation: Rater background does not significantly influence assessment scoring
Keith D. Baker, Roy T. Sabo, Meagan Rawls, Moshe Feldman, Sally A. Santen
Medical Teacher.2020; 42(4): 411. CrossRef
Qualifying online assessment during COVID-19 pandemic: Reflecting on our experience under the cognitive lens of Miller’s pyramid
Dinesh Kumar, Rajasekhar Sajja SN
Research and Development in Medical Education.2020; 9(1): 15. CrossRef
Comparison of the effects of simulated patient clinical skill training and student roleplay on objective structured clinical examination performance among medical students in Australia
Silas Taylor, Matthew Haywood, Boaz Shulruf
Journal of Educational Evaluation for Health Professions.2019; 16: 3. CrossRef
Insights into student assessment outcomes in rural clinical campuses
Boaz Shulruf, Gary Velan, Lesley Forster, Anthony O’Sullivan, Peter Harris, Silas Taylor
BMC Medical Education.2019;[Epub] CrossRef

Research Articles

Australian medical students have fewer opportunities to do physical examination of peers of the opposite gender: Silas Taylor, Boaz Shulruf; J Educ Eval Health Prof. 2016;13:42. Published online November 23, 2016; DOI: https://doi.org/10.3352/jeehp.2016.13.42

25,168 View
213 Download
4 Citations

Abstract PDF

Purpose
Peer physical examination (PPE), by which junior medical students learn physical examination skills before practicing on patients, is a widely implemented and accepted part of medical curricula. However, the ethical implications of PPE have been debated, since issues including student gender impact on its acceptability. Research has previously demonstrated the phenomenon of ‘attitude-behavior inconsistency’ showing that students’ predictions about their participation in PPE differ from what they actually do in practice. This study asks whether gender and student self-ratings of outlook affect engagement in PPE. Methods: This study gathered data from students who had completed PPE with the objective of determining what factors have the greatest impact on the actual practice of PPE by students. Data were used to derive the number of opportunities students had to examine a peer, for various body parts. Respondent gender and self-ratings of outlook were recorded. Results: Responses from 130 students were analysed: 74 female (57%) and 56 male (43%). Students have fewer opportunities to examine peers of the opposite gender; this is statistically significant for all body parts when male students examine female peers. Conclusion: Gender is the factor of overriding importance on whether these peer interactions actually occur, such that students have fewer opportunities to examine peers of the opposite gender, particularly male students examining female peers. Student outlook has little impact. We speculate that the more acceptable PPE is to participants, paradoxically, the more complicated these interactions become, possibly with implications for future practice.

Citations

Citations to this article as recorded by

Syrian medical students’ acceptance of peer physical examination and its associating factors: a cross-sectional study
Jameel Soqia, Mohamad Ashraf Shamaa, Dima Alhomsi, Laila Yakoub-Agha, Mhd Basheer Alameer, Rawan Alhomsi, Mohmad Nour Hakok, Rim Khalil, Mazen Zaitouna
BMC Medical Education.2022;[Epub] CrossRef
Comparison of the effects of simulated patient clinical skill training and student roleplay on objective structured clinical examination performance among medical students in Australia
Silas Taylor, Matthew Haywood, Boaz Shulruf
Journal of Educational Evaluation for Health Professions.2019; 16: 3. CrossRef
L’enseignement par discipline de la sémiologie en deuxième année de médecine améliore l’acquisition des compétences. Exemple de la sémiologie neurologique
G. Turc, B. Terrier, A.-S. Bats, C. Ngo, B. Ranque, D. Calvet
La Revue de Médecine Interne.2018; 39(12): 905. CrossRef
The sights and insights of examiners in objective structured clinical examinations
Lauren Chong, Silas Taylor, Matthew Haywood, Barbara-Ann Adelstein, Boaz Shulruf
Journal of Educational Evaluation for Health Professions.2017; 14: 34. CrossRef

Breadth of knowledge vs. grades: What best predicts achievement in the first year of health sciences programmes?: Boaz Shulruf, Meisong Li, Judy McKimm, Melinda Smith; J Educ Eval Health Prof. 2012;9:7. Published online May 16, 2012; DOI: https://doi.org/10.3352/jeehp.2012.9.7

34,765 View
166 Download
3 Citations

Abstract PDF

This study aimed to identify those features within secondary school curricula and assessment, particularly science subjects that best predict academic achievement in the first year of three different three-year undergraduate health professional programmes (nursing, pharmacy, and health sciences) at a large New Zealand university. In particular, this study compared the contribution of breadth of knowledge (number of credits acquired) versus grade level (grade point average) and explored the impact of demographic variables on achievement. The findings indicated that grades are the most important factor predicting student success in the first year of university. Although taking biology and physics at secondary school has some impact on university first year achievement, the effect is relatively minor.

Citations

Citations to this article as recorded by

Use of machine learning to assess factors affecting progression, retention, and graduation in first-year health professions students in Qatar: a longitudinal study
Dalal Hammoudi Halat, Abdel-Salam G. Abdel-Salam, Ahmed Bensaid, Abderrezzaq Soltani, Lama Alsarraj, Roua Dalli, Ahmed Malki
BMC Medical Education.2023;[Epub] CrossRef
Predictive validity of multiple mini interview scores for future academic and clinical placement performance in physiotherapy, occupational therapy and speech and language therapy programmes
Swati Kale, Meghana Wadnerkar Kamble, Nicola Spalding
International Journal of Therapy and Rehabilitation.2020; 27(4): 1. CrossRef
Quantitative analysis of a Māori and Pacific admission process on first-year health study
Elana Curtis, Erena Wikaire, Yannan Jiang, Louise McMillan, Robert Loto, Airini, Papaarangi Reid
BMC Medical Education.2015;[Epub] CrossRef

Research article

Examiner seniority and experience are associated with bias when scoring communication, but not examination, skills in objective structured clinical examinations in Australia: Lauren Chong, Silas Taylor, Matthew Haywood, Barbara-Ann Adelstein, Boaz Shulruf; J Educ Eval Health Prof. 2018;15:17.; DOI: https://doi.org/10.3352/jeehp.2018.15.17

24,901 View
272 Download
16 Citations

Abstract PDF Supplementary Material

Purpose
The biases that may influence objective structured clinical examination (OSCE) scoring are well understood, and recent research has attempted to establish the magnitude of their impact. However, the influence of examiner experience, clinical seniority, and occupation on communication and physical examination scores in OSCEs has not yet been clearly established.
Methods
We compared the mean scores awarded for generic and clinical communication and physical examination skills in 2 undergraduate medicine OSCEs in relation to examiner characteristics (gender, examining experience, occupation, seniority, and speciality). The statistical significance of the differences was calculated using the 2-tailed independent t-test and analysis of variance.
Results
Five hundred and seventeen students were examined by 237 examiners at the University of New South Wales in 2014 and 2016. Examiner gender, occupation (academic, clinician, or clinical tutor), and job type (specialist or generalist) did not significantly impact scores. Junior doctors gave consistently higher scores than senior doctors in all domains, and this difference was statistically significant for generic and clinical communication scores. Examiner experience was significantly inversely correlated with generic communication scores.
Conclusion
We suggest that the assessment of examination skills may be less susceptible to bias because this process is fairly prescriptive, affording greater scoring objectivity. We recommend training to define the marking criteria, teaching curriculum, and expected level of performance in communication skills to reduce bias in OSCE assessment.

Citations

Citations to this article as recorded by

Association entre les performances cliniques des étudiants et leur réussite aux Épreuves classantes nationales informatisées : une étude de cohorte rétrospective monocentrique
L. Azoyan, Y. Lombardi, M.C. Renaud, A. Duguet, S. Georgin-Lavialle, F. Cohen-Aubart, G. Ibanez, O. Steichen
La Revue de Médecine Interne.2023; 44(1): 5. CrossRef
Bias in Medical School Clerkship Grading: Is It Time for a Change?
Rachel A. Russo, Dana M. Raml, Anna J. Kerlek, Martin Klapheke, Katherine B. Martin, Jeffrey J. Rakofsky
Academic Psychiatry.2023; 47(4): 428. CrossRef
Are we ready yet for digital transformation? Virtual versus on-campus OSCE as assessment tools in pharmacy education. A randomized controlled head-to-head comparative assessment
Zelal Kharaba, Mohammad M. AlAhmad, Asim Ahmed Elnour, Abdallah Abou Hajal, Suhad Abumweis, Mohammad A. Ghattas
Saudi Pharmaceutical Journal.2023; 31(3): 359. CrossRef
Comparing Entrustable Professional Activity Scores Given by Faculty Physicians and Senior Trainees to First-Year Residents
Steven J Katz, Dennis Wang
Cureus.2022;[Epub] CrossRef
eOSCE stations live versus remote evaluation and scores variability
Donia Bouzid, Jimmy Mullaert, Aiham Ghazali, Valentine Marie Ferré, France Mentré, Cédric Lemogne, Philippe Ruszniewski, Albert Faye, Alexy Tran Dinh, Tristan Mirault, Nathan Peiffer Smadja, Léonore Muller, Laure Falque Pierrotin, Michael Thy, Maksud Assa
BMC Medical Education.2022;[Epub] CrossRef
Development and Evaluation of an Online Exam for Exercise Physiology During the COVID-19 Pandemic
Amanda L Burdett, Nancy van Doorn, Matthew D Jones, Natalie CG Kwai, Rachel E Ward, Silas Taylor, Boaz Shulruf
Journal of Clinical Exercise Physiology.2022; 11(4): 122. CrossRef
Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study
Ying-Ying Yang, Pin-Hsiang Huang, Ling-Yu Yang, Chia-Chang Huang, Chih-Wei Liu, Shiau-Shian Huang, Chen-Huan Chen, Fa-Yauh Lee, Shou-Yen Kao, Boaz Shulruf
Journal of Educational Evaluation for Health Professions.2022; 19: 27. CrossRef
How biased are you? The effect of prior performance information on attending physician ratings and implications for learner handover
Tammy Shaw, Timothy J. Wood, Claire Touchie, Debra Pugh, Susan M. Humphrey-Murto
Advances in Health Sciences Education.2021; 26(1): 199. CrossRef
Does objective structured clinical examination examiners’ backgrounds influence the score agreement?
Oscar Gilang Purnajati, Rachmadya Nur Hidayah, Gandes Retno Rahayu
The Asia Pacific Scholar.2021; 6(2): 48. CrossRef
Ethnic and gender bias in objective structured clinical examination: A critical review
IrisC. I. Chao, Efrem Violato, Brendan Concannon, Charlotte McCartan, Sharla King, MaryRoduta Roberts
Education in the Health Professions.2021; 4(2): 37. CrossRef
Tutor–Student Partnership in Practice OSCE to Enhance Medical Education
Eve Cosker, Valentin Favier, Patrice Gallet, Francis Raphael, Emmanuelle Moussier, Louise Tyvaert, Marc Braun, Eva Feigerlova
Medical Science Educator.2021; 31(6): 1803. CrossRef
Empirical analysis comparing the tele-objective structured clinical examination and the in-person assessment in Australia
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 23. CrossRef
Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review
Jonathan Zachary Felthun, Silas Taylor, Boaz Shulruf, Digby Wigram Allen
Journal of Educational Evaluation for Health Professions.2021; 18: 11. CrossRef
Is There Variability in Scoring of Student Surgical OSCE Performance Based on Examiner Experience and Expertise?
Claire L. Donohoe, Frank Reilly, Suzanne Donnelly, Ronan A. Cahill
Journal of Surgical Education.2020; 77(5): 1202. CrossRef
The role of training in student examiner rating performance in a student-led mock OSCE
Jian Hui Koo, Kim Yao Ong, Yun Ting Yap, Kum Ying Tham
Perspectives on Medical Education.2020; 10(5): 293. CrossRef
Insights into student assessment outcomes in rural clinical campuses
Boaz Shulruf, Gary Velan, Lesley Forster, Anthony O’Sullivan, Peter Harris, Silas Taylor
BMC Medical Education.2019;[Epub] CrossRef

First
Prev
Page of 1
Next
Last

Search