Journal of Educational Evaluation for Health Professions

Minh Chau

3 Articles

The performance of ChatGPT-4.0o in medical imaging evaluation: a cross-sectional study: Elio Stefan Arruzza, Carla Marie Evangelista, Minh Chau; J Educ Eval Health Prof. 2024;21:29. Published online October 31, 2024; DOI: https://doi.org/10.3352/jeehp.2024.21.29

549 View
173 Download
1 Web of Science
1 Crossref

This study investigated the performance of ChatGPT-4.0o in evaluating the quality of positioning in radiographic images. Thirty radiographs depicting a variety of knee, elbow, ankle, hand, pelvis, and shoulder projections were produced using anthropomorphic phantoms and uploaded to ChatGPT-4.0o. The model was prompted to provide a solution to identify any positioning errors with justification and offer improvements. A panel of radiographers assessed the solutions for radiographic quality based on established positioning criteria, with a grading scale of 1–5. In only 20% of projections, ChatGPT-4.0o correctly recognized all errors with justifications and offered correct suggestions for improvement. The most commonly occurring score was 3 (9 cases, 30%), wherein the model recognized at least 1 specific error and provided a correct improvement. The mean score was 2.9. Overall, low accuracy was demonstrated, with most projections receiving only partially correct solutions. The findings reinforce the importance of robust radiography education and clinical experience.

Citations

Citations to this article as recorded by

Conversational LLM Chatbot ChatGPT-4 for Colonoscopy Boston Bowel Preparation Scoring: An Artificial Intelligence-to-Head Concordance Analysis
Raffaele Pellegrino, Alessandro Federico, Antonietta Gerarda Gravina
Diagnostics.2024; 14(22): 2537. CrossRef

Effectiveness of ChatGPT-4o in developing continuing professional development plans for graduate radiographers: a descriptive study: Minh Chau, Elio Stefan Arruzza, Kelly Spuur; J Educ Eval Health Prof. 2024;21:34. Published online November 18, 2024; DOI: https://doi.org/10.3352/jeehp.2024.21.34

322 View
73 Download

Abstract PDF: Purpose
This study evaluates the use of ChatGPT-4o in creating tailored continuing professional development (CPD) plans for radiography students, addressing the challenge of aligning CPD with Medical Radiation Practice Board of Australia (MRPBA) requirements. We hypothesized that ChatGPT-4o could support students in CPD planning while meeting regulatory standards.
Methods
A descriptive, experimental design was used to generate 3 unique CPD plans using ChatGPT-4o, each tailored to hypothetical graduate radiographers in varied clinical settings. Each plan followed MRPBA guidelines, focusing on computed tomography specialization by the second year. Three MRPBA-registered academics assessed the plans using criteria of appropriateness, timeliness, relevance, reflection, and completeness from October 2024 to November 2024. Ratings underwent analysis using the Friedman test and intraclass correlation coefficient (ICC) to measure consistency among evaluators.
Results
ChatGPT-4o generated CPD plans generally adhered to regulatory standards across scenarios. The Friedman test indicated no significant differences among raters (P=0.420, 0.761, and 0.807 for each scenario), suggesting consistent scores within scenarios. However, ICC values were low (–0.96, 0.41, and 0.058 for scenarios 1, 2, and 3), revealing variability among raters, particularly in timeliness and completeness criteria, suggesting limitations in the ChatGPT-4o’s ability to address individualized and context-specific needs.
Conclusion
ChatGPT-4o demonstrates the potential to ease the cognitive demands of CPD planning, offering structured support in CPD development. However, human oversight remains essential to ensure plans are contextually relevant and deeply reflective. Future research should focus on enhancing artificial intelligence’s personalization for CPD evaluation, highlighting ChatGPT-4o’s potential and limitations as a tool in professional education.

The effectiveness of cultural competence education in enhancing knowledge acquisition, performance, attitudes, and student satisfaction among undergraduate health science students: a scoping review: Elio Arruzza, Minh Chau; J Educ Eval Health Prof. 2021;18:3. Published online February 24, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.3

12,512 View
607 Download
20 Web of Science
23 Crossref

Abstract PDF Supplementary Material

Purpose
Cultural competence in healthcare assists in the delivery of culturally sensitive and high-quality services. This scoping review aims to provide an overview of the available evidence and to examine the effectiveness of classroom-based intervention strategies used to enhance the cultural competence of undergraduate health science students.
Methods
A comprehensive and systematic literature search was undertaken in databases, including Cochrane Library, Medline, and Emcare. Articles were eligible if they employed an experimental study design to assess classroom-based cultural competency education for university students across the health science disciplines. Two reviewers independently screened and extracted relevant data pertaining to study and participant characteristics using a charting table. The outcomes included knowledge, attitudes, skills, and perceived benefits.
Results
Ten studies were analysed. Diverse approaches to cultural education exist in terms of the mode, frequency, and duration of interventions. For the knowledge outcome, students who experienced cultural education interventions yielded higher post-test scores than their baseline cultural knowledge, but without a significant difference from the scores of students who did not receive interventions. Data relating to the skills domain demonstrated positive effects for students after experiencing interventions. Overall, students were satisfied with their experiences and demonstrated improvements in confidence and attitudes towards culturally competent practice.
Conclusion
Across health science disciplines, cultural competency interventions were shown to be effective in enhancing knowledge acquisition, performance of skills, attitudes, and student satisfaction. Future research is necessary to address the significant absence of control arms in the current literature, and to assess long-term effects and patient-related outcomes.

Citations

Citations to this article as recorded by

Predisposing Factors of Intercultural Sensitivity Among Nursing Students: A Predictive Correlational Design
Sultan Ayaz-Alkaya, Joyce Simones
Journal of Transcultural Nursing.2024; 35(1): 83. CrossRef
Usability and Acceptability of a Conversational Agent Health Education App (Nthabi) for Young Women in Lesotho: Quantitative Study
Elizabeth Nkabane-Nkholongo, Mathildah Mpata-Mokgatle, Brian W Jack, Clevanne Julce, Timothy Bickmore
JMIR Human Factors.2024; 11: e52048. CrossRef
Examining Cultural Comfort and Knowledge in Undergraduate Nursing Students After the Implementation of an Online Educational Animation on Providing Care for Muslim Patients
Farhat Alucozai, Elizabeth A. Richards, Amanda Ward, Ann Loomis
Journal of Transcultural Nursing.2024; 35(3): 237. CrossRef
Unlocking the mechanisms of change in the MAMAACT intervention to reduce ethnic disparity in stillbirth and newborns' health: integration of evaluation findings
Sarah Fredsted Villadsen, Helle Johnsen, Trine Damsted Rasmussen, Claus Thorn Ekstrøm, Janne Sørensen, Elie Azria, Janet Rich-Edwards, Birgitta Essén, Ulla Christensen, Signe Smith Jervelund, Anne-Marie Nybo Andersen
Frontiers in Health Services.2024;[Epub] CrossRef
By Medical Students, for Medical Students: A Narrative Medicine Antiracism Program
Yoshiko Iwai, Sarah Holdren, Alyssa R. Browne, Nicholas R. Lenze, Felix Gabriel Lopez, Antonia M. Randolph, Amy B. Weil
Journal of Medical Education and Curricular Development.2024;[Epub] CrossRef
Cultural competence of undergraduate student nurses: a multicenter study
Lucía Sagarra-Romero, Enrique Ramón-Arbués, Isabel Huércanos-Esparza, Indrani Kalkan, Nuran Kömürcü, Valérie Vanceulebroeck, Shana Dehaes, Margarida Coelho, Antonio Casa-Nova, Isabel Antón-Solanas
Revista Latino-Americana de Enfermagem.2024;[Epub] CrossRef
Competência cultural de estudantes de graduação em enfermagem: um estudo multicêntrico
Lucía Sagarra-Romero, Enrique Ramón-Arbués, Isabel Huércanos-Esparza, Indrani Kalkan, Nuran Kömürcü, Valérie Vanceulebroeck, Shana Dehaes, Margarida Coelho, Antonio Casa-Nova, Isabel Antón-Solanas
Revista Latino-Americana de Enfermagem.2024;[Epub] CrossRef
Competencia cultural de estudiantes de pregrado en enfermería: estudio multicéntrico
Lucía Sagarra-Romero, Enrique Ramón-Arbués, Isabel Huércanos-Esparza, Indrani Kalkan, Nuran Kömürcü, Valérie Vanceulebroeck, Shana Dehaes, Margarida Coelho, Antonio Casa-Nova, Isabel Antón-Solanas
Revista Latino-Americana de Enfermagem.2024;[Epub] CrossRef
Answering the Call
JeanMarie Digges, Antonio P. Gutierrez de Blume
Journal of Christian Nursing.2024; 41(4): E68. CrossRef
Food Insecurity Knowledge and Training Among College Students in Health Majors
Virginia B. Gray, Cara Cuite, Megan Patton-López, Rickelle Richards, Mateja Savoie-Roskos, Stephanie Machado, Emily Heying, Matthew Landry, Susan Chen, Rebecca L. Hagedorn-Hatfield, Georgianna Mann, Zubaida Qamar, Kendra OoNorasak, Victoria A. Zigmont
Journal of Nutrition Education and Behavior.2024;[Epub] CrossRef
Diversity training for health professionals: Preparedness to competently address intellectual disability in the Western Cape Province, South Africa
Mario R Smith, Maryam Papadakis, Erica Munnik
Journal of Intellectual Disabilities.2023; 27(1): 24. CrossRef
Physical Therapists' Perceptions of Preparedness to Engage in Culturally Competent Practice Upon Graduation: A Qualitative Research Study
Emily Schubbe
Journal of Physical Therapy Education.2023; 37(2): 145. CrossRef
The Relationship Between Cultural Intelligence and Cultural Competence of Students of Nursing and Midwifery During COVID-19: A Cross-Sectional Study
Zeynab Bakhtiari, Nasrin Hanifi, Nasrin Jafari Varjoshani
Journal of Medical Education and Curricular Development.2023;[Epub] CrossRef
Need for Widely Applicable Cultural Competencies in the Healthcare of Humans and Animals
Costas S. Constantinou
Encyclopedia.2023; 3(3): 956. CrossRef
The Changing Landscape of Intercultural Mindset in 616 Doctor of Physical Therapy Students Over the Past 7 Years and the Implications for Doctor of Physical Therapy Cultural Competence Education
Lisa VanHoose, Heidi Eigsti
Journal of Physical Therapy Education.2023; 37(4): 271. CrossRef
Patient representation in New Zealand general practice and rural health case-based teaching: a quality improvement exercise
Jessica Gu, Jim Ross, Sharon Leitch, Felicity Goodyear-Smith
Journal of Primary Health Care.2023; 15(3): 281. CrossRef
Quality improvement in allied healthcare: Key recommendations for educational institutions
Jithin Kalathikudiyil Sreedharan, Saad Mohammed AlRabeeah, Arun Vijay Subbarayalu, Edan M. AlZahrani, Jaber Saud AlQahtani, Mohammed Dafer AlAhmari, Abdullah Saeed AlQahtani, Musallam AlNasser, Amal AlSomali, Asma Falah AlHarbi, Yaser AlNaam, Ibrahim A. A
Informatics in Medicine Unlocked.2023; 43: 101412. CrossRef
Effect of a transcultural nursing course on improving the cultural competency of nursing graduate students in Korea: a before-and-after study
Kyung Eui Bae, Geum Hee Jeong
Journal of Educational Evaluation for Health Professions.2023; 20: 35. CrossRef
Proceedings From the Advances in Surgery Channel Diversity, Equity, and Inclusion Series: Lessons Learned From Asian Academic Surgeons
Tracy S. Wang, Eugene S. Kim, Quan-Yang Duh, Ankush Gosain, Lillian S. Kao, Anai N. Kothari, Susan Tsai, Jennifer F. Tseng, Allan Tsung, Kasper S. Wang, Steven D. Wexner
Journal of Surgical Research.2022; 278: 14. CrossRef
Improving Cultural Competence and Self-Efficacy Among Postgraduate Nursing Students: Results of an Online Cultural Care Training Program
Mohammad Mahdi Fadaeinia, Sakineh Miri, Mansooreh Azizzadeh Forouzi, Callista Roy, Jamileh Farokhzadian
Journal of Transcultural Nursing.2022; 33(5): 642. CrossRef
Preparing students to deal with the consequences of the workforce shortage among health professionals: a qualitative approach
Christoph Golz, Annie Oulevey Bachmann, Tiziana Sala Defilippis, Andrea Kobleder, Karin Anne Peter, René Schaffert, Xenia Schwarzenbach, Thomas Kampel, Sabine Hahn
BMC Medical Education.2022;[Epub] CrossRef
Cultural Competence in Healthcare and Healthcare Education
Costas S. Constantinou, Panayiota Andreou, Monica Nikitara, Alexia Papageorgiou
Societies.2022; 12(6): 178. CrossRef
Cultural Competence: A tool to Augment the Education Recovery in Universities of Pakistan
Seema Khalid Khan, Dr. Khalid Mehmood Iraqi
Pakistan Journal of Applied Social Sciences.2022; 13(2): 73. CrossRef

Author index