Journal of Educational Evaluation for Health Professions

Research articles

The effect of strengthening nurse practitioners’ competency in occupational health services for agricultural workers exposed to pesticides in primary care units, Thailand: a before-and-after study: Napamon Pumsopa, Ann Jirapongsuwan, Surintorn Kalampakorn, Sukhontha Siri; J Educ Eval Health Prof. 2025;22:14. Published online April 21, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.14

647 View
162 Download

Abstract PDF Supplementary Material: Purpose
This study aimed to evaluate the effect of the Strengthening Nurse Practitioners’ Competency in Occupational Health Service (SNPCOHS) program. It was hypothesized that nurse practitioners (NPs) participating in the program would demonstrate increased competency in providing occupational health services to agricultural workers exposed to pesticides in primary care units (PCUs) compared to their baseline competency and to a comparison group.
Methods
A quasi-experimental study was conducted between August and December 2023. The 4-week intervention included 5 hours of an e-learning program, 3 hours of online discussion, and 2 hours dedicated to completing an assignment. The program was evaluated at 3 time points: pre-intervention, post-intervention (week 4), and follow-up (week 8). Sixty NPs volunteered to participate, with 30 in the experimental group and 30 in the comparison group. Data on demographics, professional attributes, knowledge, skills, and perceived self-efficacy were collected using self-administered questionnaires via Google Forms. Data analysis involved descriptive statistics, independent t-tests, and repeated measures analysis of variance.
Results
The experimental group demonstrated significantly higher mean scores in professional attributes, knowledge, skills, and perceived self-efficacy in providing occupational health services to agricultural workers exposed to pesticides compared to the comparison group at both week 4 and week 8 post-intervention.
Conclusion
The SNPCOHS program is well-suited for self-directed learning for nurses in PCUs, supporting effective occupational health service delivery. It should be disseminated and supported as an e-learning resource for NPs in PCUs (Thai Clinical Trials Registry: TCTR20250115004).

A nationwide survey on the curriculum and educational resources related to the Clinical Skills Test of the Korean Medical Licensing Examination: a cross-sectional descriptive study: Eun-Kyung Chung, Seok Hoon Kang, Do-Hoon Kim, MinJeong Kim, Ji-Hyun Seo, Keunmi Lee, Eui-Ryoung Han; J Educ Eval Health Prof. 2025;22:11. Published online March 13, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.11

1,115 View
194 Download

Abstract PDF Supplementary Material: Purpose
The revised Clinical Skills Test (CST) of the Korean Medical Licensing Exam aims to provide a better assessment of physicians’ clinical competence and ability to interact with patients. This study examined the impact of the revised CST on medical education curricula and resources nationwide, while also identifying areas for improvement within the revised CST.
Methods
This study surveyed faculty responsible for clinical clerkships at 40 medical schools throughout Korea to evaluate the status and changes in clinical skills education, assessment, and resources related to the CST. The researchers distributed the survey via email through regional consortia between December 7, 2023 and January 19, 2024.
Results
Nearly all schools implemented preliminary student–patient encounters during core clinical rotations. Schools primarily conducted clinical skills assessments in the third and fourth years, with a simplified form introduced in the first and second years. Remedial education was conducted through various methods, including one-on-one feedback from faculty after the assessment. All schools established clinical skills centers and made ongoing improvements. Faculty members did not perceive the CST revisions as significantly altering clinical clerkship or skills assessments. They suggested several improvements, including assessing patient records to improve accuracy and increasing the objectivity of standardized patient assessments to ensure fairness.
Conclusion
During the CST, students’ involvement in patient encounters and clinical skills education increased, improving the assessment and feedback processes for clinical skills within the curriculum. To enhance students’ clinical competencies and readiness, strengthening the validity and reliability of the CST is essential.

Review

How to review and assess a systematic review and meta-analysis article: a methodological study (secondary publication): Seung-Kwon Myung; J Educ Eval Health Prof. 2023;20:24. Published online August 27, 2023; DOI: https://doi.org/10.3352/jeehp.2023.20.24

20,141 View
1,074 Download
26 Web of Science
26 Crossref

Abstract PDF Supplementary Material

Systematic reviews and meta-analyses have become central in many research fields, particularly medicine. They offer the highest level of evidence in evidence-based medicine and support the development and revision of clinical practice guidelines, which offer recommendations for clinicians caring for patients with specific diseases and conditions. This review summarizes the concepts of systematic reviews and meta-analyses and provides guidance on reviewing and assessing such papers. A systematic review refers to a review of a research question that uses explicit and systematic methods to identify, select, and critically appraise relevant research. In contrast, a meta-analysis is a quantitative statistical analysis that combines individual results on the same research question to estimate the common or mean effect. Conducting a meta-analysis involves defining a research topic, selecting a study design, searching literature in electronic databases, selecting relevant studies, and conducting the analysis. One can assess the findings of a meta-analysis by interpreting a forest plot and a funnel plot and by examining heterogeneity. When reviewing systematic reviews and meta-analyses, several essential points must be considered, including the originality and significance of the work, the comprehensiveness of the database search, the selection of studies based on inclusion and exclusion criteria, subgroup analyses by various factors, and the interpretation of the results based on the levels of evidence. This review will provide readers with helpful guidance to help them read, understand, and evaluate these articles.

Citations

Citations to this article as recorded by

The effectiveness and usability of online, group-based interventions for people with severe obesity: a systematic review and meta-analysis
Madison Milne-Ives, Lorna Burns, Dawn Swancutt, Raff Calitri, Ananya Ananthakrishnan, Helene Davis, Jonathan Pinkney, Mark Tarrant, Edward Meinert
International Journal of Obesity.2025; 49(4): 564. CrossRef
Testing the distinction between sadism and psychopathy: A metanalysis
Bruno Bonfá-Araujo, Gisele Magarotto Machado, Ariela Raissa Lima-Costa, Fernanda Otoni, Mahnoor Nadeem, Peter K. Jonason
Personality and Individual Differences.2025; 235: 112973. CrossRef
Impact of peripheral immune cells in experimental neonatal hypoxia-ischemia: A systematic review and meta-analysis
Ricardo Ribeiro Nunes, Luz Elena Durán-Carabali, Nícolas Heller Ribeiro, Dienifer Hermann Sirena, Isadora D’Ávila Tassinari, Carlos Alexandre Netto, Ana Helena Paz, Luciano Stürmer de Fraga
International Immunopharmacology.2025; 145: 113682. CrossRef
Systematic review and meta-analysis of the prevalence of frailty and pre-frailty amongst older hospital inpatients in low- and middle-income countries
Sean Lawlor Davidson, Jim Lee, Luke Emmence, Emily Bickerstaff, George Rayers, Elizabeth Davidson, Jenny Richardson, Heather Anderson, Richard Walker, Catherine Dotchin
Age and Ageing.2025;[Epub] CrossRef
Effect of Motivational Interviewing and Exercise on Chronic Low Back Pain: A Systematic Review and Meta‐Analysis
Olayinka Akinrolie, Uchechukwu B. Abioke, Francis O. Kolawole, Nicole Askin, Ebuka M. Anieto, Serena A. Itua, Oluwatoyin G. Akin, Blessing Eromosele, Opeyemi A. Idowu, Henrietta O. Fawole
Musculoskeletal Care.2025;[Epub] CrossRef
Smoking and Risk of Fatty Liver Disease: A Meta-Analysis of Cohort Studies
Moonhyung Lee, Seung-Kwon Myung, Sang Hee Lee, Yoosoo Chang
Gastroenterology Insights.2025; 16(1): 1. CrossRef
The Influence of Study Quality, Age, and Geographic Factors on PCOS Prevalence—A Systematic Review and Meta-analysis
Mina Amiri, Sana Hatoum, Richard P Buyalos, Ali Sheidaei, Ricardo Azziz
The Journal of Clinical Endocrinology & Metabolism.2025;[Epub] CrossRef
Relationship Between Bullshit, Cognitive Skills, and Belief Systems: A Meta‐Analytic Review
Geraldy Sepúlveda‐Páez, Marcelo Leiva‐Bianchi, Rodrigo Ferrer‐Urbina, Javier Escudero‐Pastén, Fabiola Salas
Applied Cognitive Psychology.2025;[Epub] CrossRef
Adjuvant chemotherapy in localized, resectable extremity and truncal soft tissue sarcoma and survival outcomes – A systematic review and meta‐analysis of randomized controlled trials
Megan H. Goh, Marcos R. Gonzalez, Hillary M. Heiling, Emanuele Mazzola, Joseph J. Connolly, Edwin Choy, Gregory M. Cote, Dimitrios Spentzos, Santiago A. Lozano‐Calderon
Cancer.2025;[Epub] CrossRef
Relationship Between Sleep Disturbances and In Vitro Fertilization Outcomes in Infertile Women: A Systematic Review and Meta‐Analysis
Farangis Habibi, Roya Nikbakht, Shayesteh Jahanfar, Mohammad Ahmadi, Maryam Eslami, Marzieh Azizi, Zohreh Shahhosseini
Brain and Behavior.2025;[Epub] CrossRef
Intimate partner violence among women of reproductive age during the COVID-19 pandemic in Ethiopia: a systematic review and meta-analysis
Alemayehu Sayih Belay, Gizachew Yilak, Aychew Kassie, Legese Fekede Abza, Ambaw Abebaw Emrie, Mulat Ayele, Befkad Derese Tilahun, Eyob Shitie Lake
BMJ Public Health.2025; 3(1): e001161. CrossRef
Meta-analysis of Reliability and Validity of the Bergen Social Media Addiction Scale (BSMAS)
Rossella Bottaro, Mark D. Griffiths, Palmira Faraci
International Journal of Mental Health and Addiction.2025;[Epub] CrossRef
Efficacy of PCSK9 inhibitors on pediatric patients with heterozygous familial hypercholesterolemia: a systematic review and meta-analysis of randomized controlled trials
Alesia Prillya Mauna, Joshua Eldad Frederich Lasanudin
Cardiology Plus.2025; 10(1): 61. CrossRef
Efficacy of integrated physical and psychological interventions on PTSD among forcibly displaced persons: a systematic review and meta-analysis
Aditi Chaudhari, Apoorwa Chaudhari, Sandra O’Frans, Rohan Jayasuriya, Alvin Kuowei Tay
Psychological Medicine.2025;[Epub] CrossRef
Home-based shared book reading and developmental outcomes in young children: a systematic review with meta-analyses
Claire Galea, Alana Jones, Katherine Ko, Andrea Salins, Serje Robidoux, Clayton Noble, Genevieve McArthur
Frontiers in Language Sciences.2025;[Epub] CrossRef
Efficacy and Safety of Quantum Molecular Resonance Electrotherapy in Dry Eye Disease: A Systematic Review with Meta-analysis
Antonio Ballesteros-Sánchez, Carlos Rocha-de-Lossada, José-María Sánchez-González, Giovanni Roberto Tedesco, Davide Borroni
Ophthalmology and Therapy.2025; 14(5): 1111. CrossRef
The impact of toe-clipping on animal welfare in amphibians: A systematic review
Miriam A. Zemanova, Raquel Lázaro Martín, Cathalijn H.C. Leenaars
Global Ecology and Conservation.2025; 59: e03582. CrossRef
Differences in Sprinting and Jumping Performance Between Maturity Status Groups in Youth: A Systematic Review and Meta-analysis
James Baker, Paul Read, Philip Graham-Smith, Marco Cardinale, Thomas W. Jones
Sports Medicine.2025;[Epub] CrossRef
Generative artificial intelligence in special education: A systematic review through the lens of the mediated-action model
Meiqin Wang, Ahmed Tlili, Mohamed Koutheair Khribi, Chung Kwan Lo, Ronghuai Huang
Information Development.2025;[Epub] CrossRef
Brief psychological interventions for schizophrenia: a systematic review and meta-analysis
Blue Pike, Leire Ambrosio, Lyn Ellett
Psychological Medicine.2025;[Epub] CrossRef
Effects of Collagen Supplements on Skin Aging: A Systematic Review and Meta-Analysis of Randomized Controlled Trials
Seung-Kwon Myung, Yunseo Park
The American Journal of Medicine.2025;[Epub] CrossRef
The Role of BIM in Managing Risks in Sustainability of Bridge Projects: A Systematic Review with Meta-Analysis
Dema Munef Ahmad, László Gáspár, Zsolt Bencze, Rana Ahmad Maya
Sustainability.2024; 16(3): 1242. CrossRef
The association between long noncoding RNA ABHD11-AS1 and malignancy prognosis: a meta-analysis
Guangyao Lin, Tao Ye, Jing Wang
BMC Cancer.2024;[Epub] CrossRef
The impact of indoor carbon dioxide exposure on human brain activity: A systematic review and meta-analysis based on studies utilizing electroencephalogram signals
Nan Zhang, Chao Liu, Caixia Hou, Wenhao Wang, Qianhui Yuan, Weijun Gao
Building and Environment.2024; 259: 111687. CrossRef
Efficacy of mechanical debridement with adjunct antimicrobial photodynamic therapy against peri-implant subgingival oral yeasts colonization: A systematic review and meta-analysis
Dena Ali, Jenna Alsalman
Photodiagnosis and Photodynamic Therapy.2024; 50: 104399. CrossRef
Non-invasive brain stimulation enhances motor and cognitive performances during dual tasks in patients with Parkinson’s disease: a systematic review and meta-analysis
Hajun Lee, Beom Jin Choi, Nyeonju Kang
Journal of NeuroEngineering and Rehabilitation.2024;[Epub] CrossRef

Research articles

Correlation between a motion analysis method and Global Operative Assessment of Laparoscopic Skills for assessing interns’ performance in a simulated peg transfer task in Jordan: a validation study: Esraa Saleh Abdelall, Shadi Mohammad Hamouri, Abdallah Fawaz Al Dwairi, Omar Mefleh Al- Araidah; J Educ Eval Health Prof. 2025;22:10. Published online March 6, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.10

1,192 View
188 Download

Abstract PDF Supplementary Material: Purpose
This study aims to validate the use of ProAnalyst (Xcitex Inc.), a software for professional motion analysts to assess the performance of surgical interns while performing the peg transfer task in a simulator box for safe practice in real minimally invasive surgery.
Methods
A correlation study was conducted in a multidisciplinary skills simulation lab at the Faculty of Medicine, Jordan University of Science and Technology from October 2019 to February 2020. Forty-one interns (i.e., novices and intermediates) were recruited and an expert surgeon participated as a reference benchmark. Videos of participants’ performance were analyzed through the ProAnalyst and Global Operative Assessment of Laparoscopic Skills (GOALS). Two results were s analyzed for correlation.
Results
The motion analysis scores by Proanalyst were correlated with those by GOALS for novices (r=–0.62925, P=0.009), and Intermediates (r= –0.53422, P=0.033). Both assessment methods differentiated the participants’ performance based on their experience level.
Conclusion
The motion analysis scoring method with Proanalyst provides an objective, time-efficient, and reproducible assessment of interns’ performance, and comparable to GOALS. It may require initial training and set-up; however, it eliminates the need for expert surgeon judgment.

Evaluation of a virtual objective structured clinical examination in the metaverse (Second Life) to assess the clinical skills in emergency radiology of medical students in Spain: a cross-sectional study: Alba Virtudes Perez-Baena, Teodoro Rudolphi-Solero, Rocio Lorenzo-Alvarez, Dolores Dominguez-Pinos, Miguel Jose Ruiz-Gomez, Francisco Sendra-Portero; J Educ Eval Health Prof. 2025;22:12. Published online April 21, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.12

720 View
123 Download

Abstract PDF Supplementary Material: Purpose
The objective structured clinical examination (OSCE) is an effective but resource-intensive tool for assessing clinical competence. This study hypothesized that implementing a virtual OSCE in the Second Life (SL) platform in the metaverse as a cost-effective alternative will effectively assess and enhance clinical skills in emergency radiology while being feasible and well-received. The aim was to evaluate a virtual radiology OSCE in SL as a formative assessment, focusing on feasibility, educational impact, and students’ perceptions.
Methods
Two virtual 6-station OSCE rooms dedicated to emergency radiology were developed in SL. Sixth-year medical students completed the OSCE during a 1-hour session in 2022–2023, followed by feedback including a correction checklist, individual scores, and group comparisons. Students completed a questionnaire with Likert-scale questions, a 10-point rating, and open-ended comments. Quantitative data were analyzed using the Student t-test and the Mann-Whitney U test, and qualitative data through thematic analysis.
Results
In total, 163 students participated, achieving mean scores of 5.1±1.4 and 4.9±1.3 (out of 10) in the 2 virtual OSCE rooms, respectively (P=0.287). One hundred seventeen students evaluated the OSCE, praising the teaching staff (9.3±1.0), project organization (8.8±1.2), OSCE environment (8.7±1.5), training usefulness (8.6±1.5), and formative self-assessment (8.5±1.4). Likert-scale questions and students’ open-ended comments highlighted the virtual environment’s attractiveness, case selection, self-evaluation usefulness, project excellence, and training impact. Technical difficulties were reported by 13 students (8%).
Conclusion
This study demonstrated the feasibility of incorporating formative OSCEs in SL as a useful teaching tool for undergraduate radiology education, which was cost-effective and highly valued by students.

Assessing genetic and genomic literacy concepts among Albanian nursing and midwifery students: a cross-sectional study: Elona Gaxhja, Mitilda Gugu, Angelo Dante, Armelda Teta, Armela Kapaj, Liljana Ramasaco; J Educ Eval Health Prof. 2025;22:13. Published online April 21, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.13

748 View
119 Download

Abstract PDF Supplementary Material: Purpose
This study aimed to adapt and validate the Albanian version of the Genomic Nursing Concept Inventory (GNCI) and to assess the level of genomic literacy among nursing and midwifery students.
Methods
Data were collected via a monocentric online cross-sectional study using the Albanian version of the GNCI. Participants included first-, second-, and third-year nursing and midwifery students. Demographic data such as age, sex, year level, and prior exposure to genetics were collected. The Kruskal-Wallis, Mann-Whitney U, and chi-square tests were used to compare demographic characteristics and GNCI scores between groups.
Results
Among the 715 participants, most were female (88.5%) with a median age of 19 years. Most respondents (65%) had not taken a genetics course, and 83.5% had not attended any related training. The mean score was 7.49, corresponding to a scale difficulty of 24.38% correct responses.
Conclusion
The findings reveal a low foundational knowledge of genetics/genomics among future nurses and midwives. It is essential to enhance learning strategies and update curricula to prepare a competent healthcare workforce in precision health.

Review

Application of artificial intelligence chatbots, including ChatGPT, in education, scholarly work, programming, and content generation and its prospects: a narrative review: Tae Won Kim; J Educ Eval Health Prof. 2023;20:38. Published online December 27, 2023; DOI: https://doi.org/10.3352/jeehp.2023.20.38

18,924 View
1,304 Download
30 Web of Science
28 Crossref

Abstract PDF Supplementary Material

This study aims to explore ChatGPT’s (GPT-3.5 version) functionalities, including reinforcement learning, diverse applications, and limitations. ChatGPT is an artificial intelligence (AI) chatbot powered by OpenAI’s Generative Pre-trained Transformer (GPT) model. The chatbot’s applications span education, programming, content generation, and more, demonstrating its versatility. ChatGPT can improve education by creating assignments and offering personalized feedback, as shown by its notable performance in medical exams and the United States Medical Licensing Exam. However, concerns include plagiarism, reliability, and educational disparities. It aids in various research tasks, from design to writing, and has shown proficiency in summarizing and suggesting titles. Its use in scientific writing and language translation is promising, but professional oversight is needed for accuracy and originality. It assists in programming tasks like writing code, debugging, and guiding installation and updates. It offers diverse applications, from cheering up individuals to generating creative content like essays, news articles, and business plans. Unlike search engines, ChatGPT provides interactive, generative responses and understands context, making it more akin to human conversation, in contrast to conventional search engines’ keyword-based, non-interactive nature. ChatGPT has limitations, such as potential bias, dependence on outdated data, and revenue generation challenges. Nonetheless, ChatGPT is considered to be a transformative AI tool poised to redefine the future of generative technology. In conclusion, advancements in AI, such as ChatGPT, are altering how knowledge is acquired and applied, marking a shift from search engines to creativity engines. This transformation highlights the increasing importance of AI literacy and the ability to effectively utilize AI in various domains of life.

Citations

Citations to this article as recorded by

The Development and Validation of an Artificial Intelligence Chatbot Dependence Scale
Xing Zhang, Mingyue Yin, Mingyang Zhang, Zhaoqian Li, Hansen Li
Cyberpsychology, Behavior, and Social Networking.2025; 28(2): 126. CrossRef
Readability, quality and accuracy of generative artificial intelligence chatbots for commonly asked questions about labor epidurals: a comparison of ChatGPT and Bard
D. Lee, M. Brown, J. Hammond, M. Zakowski
International Journal of Obstetric Anesthesia.2025; 61: 104317. CrossRef
ChatGPT-4 Performance on German Continuing Medical Education—Friend or Foe (Trick or Treat)? Protocol for a Randomized Controlled Trial
Christian Burisch, Abhav Bellary, Frank Breuckmann, Jan Ehlers, Serge C Thal, Timur Sellmann, Daniel Gödde
JMIR Research Protocols.2025; 14: e63887. CrossRef
The effect of incorporating large language models into the teaching on critical thinking disposition: An “AI + Constructivism Learning Theory” attempt
Peng Wang, Kexin Yin, Mingzhu Zhang, Yuanxin Zheng, Tong Zhang, Yanjun Kang, Xun Feng
Education and Information Technologies.2025;[Epub] CrossRef
The Impact of Adaptive Learning Technologies, Personalized Feedback, and Interactive AI Tools on Student Engagement: The Moderating Role of Digital Literacy
Husam Yaseen, Abdelaziz Saleh Mohammad, Najwa Ashal, Hesham Abusaimeh, Ahmad Ali, Abdel-Aziz Ahmad Sharabati
Sustainability.2025; 17(3): 1133. CrossRef
Artificial Intelligence in Nursing: New Opportunities and Challenges
Estel·la Ramírez‐Baraldes, Daniel García‐Gutiérrez, Cristina García‐Salido
European Journal of Education.2025;[Epub] CrossRef
Can ChatGPT be used as a scientific source of information on tooth extraction?
Shiori Yamamoto, Masakazu Hamada, Kyoko Nishiyama, Ayako Motoki, Yusei Fujita, Narikazu Uzawa
Journal of Oral and Maxillofacial Surgery, Medicine, and Pathology.2025;[Epub] CrossRef
Exploring artificial intelligence (AI) Chatbot usage behaviors and their association with mental health outcomes in Chinese university students
Xing Zhang, Zhaoqian Li, Mingyang Zhang, Mingyue Yin, Zhangyu Yang, Dong Gao, Hansen Li
Journal of Affective Disorders.2025; 380: 394. CrossRef
The analysis of optimization in music aesthetic education under artificial intelligence
Yixuan Peng
Scientific Reports.2025;[Epub] CrossRef
The Role of Artificial Intelligence in Computer Science Education: A Systematic Review with a Focus on Database Instruction
Alkmini Gaitantzi, Ioannis Kazanidis
Applied Sciences.2025; 15(7): 3960. CrossRef
A Bibliometric Exposition and Review on Leveraging LLMs for Programming Education
Joanah Pwanedo Amos, Oluwatosin Ahmed Amodu, Raja Azlina Raja Mahmood, Akanbi Bolakale Abdulqudus, Anies Faziehan Zakaria, Abimbola Rhoda Iyanda, Umar Ali Bukar, Zurina Mohd Hanapi
IEEE Access.2025; 13: 58364. CrossRef
Can ChatGPT be trusted as a resource for a scholarly article on treatment planning implant-supported prostheses?
Steven J. Sadowsky
The Journal of Prosthetic Dentistry.2025;[Epub] CrossRef
Use of machine translation in foreign language education
Blanka Klimova
Cogent Arts & Humanities.2025;[Epub] CrossRef
Comparison of triage performance among DRP tool, ChatGPT, and outpatient rehabilitation doctors
Yucong Zou, Ruixue Ye, Yan Gao, Jing Zhou, Yawei Li, Wenshi Chen, Fubing Zha, Yulong Wang
Scientific Reports.2025;[Epub] CrossRef
A Training Needs Analysis for AI and Generative AI in Medical Education: Perspectives of Faculty and Students
Lise McCoy, Natarajan Ganesan, Viswanathan Rajagopalan, Douglas McKell, Diego F. Niño, Mary Claire Swaim
Journal of Medical Education and Curricular Development.2025;[Epub] CrossRef
Application of ChatGPT 4.0 in radiological dose management: Perceptions of radiographers with varying expertise
L. Federico, D.D. Fusaro, G.C. Coppola, M. Gregori, S. Durante
Radiography.2025; 31(4): 102972. CrossRef
Opportunities, challenges, and future directions of large language models, including ChatGPT in medical education: a systematic scoping review
Xiaojun Xu, Yixiao Chen, Jing Miao
Journal of Educational Evaluation for Health Professions.2024; 21: 6. CrossRef
Artificial Intelligence: Fundamentals and Breakthrough Applications in Epilepsy
Wesley Kerr, Sandra Acosta, Patrick Kwan, Gregory Worrell, Mohamad A. Mikati
Epilepsy Currents.2024;[Epub] CrossRef
A Developed Graphical User Interface-Based on Different Generative Pre-trained Transformers Models
Ekrem Küçük, İpek Balıkçı Çiçek, Zeynep Küçükakçalı, Cihan Yetiş, Cemil Çolak
ODÜ Tıp Dergisi.2024; 11(1): 18. CrossRef
Art or Artifact: Evaluating the Accuracy, Appeal, and Educational Value of AI-Generated Imagery in DALL·E 3 for Illustrating Congenital Heart Diseases
Mohamad-Hani Temsah, Abdullah N. Alhuzaimi, Mohammed Almansour, Fadi Aljamaan, Khalid Alhasan, Munirah A. Batarfi, Ibraheem Altamimi, Amani Alharbi, Adel Abdulaziz Alsuhaibani, Leena Alwakeel, Abdulrahman Abdulkhaliq Alzahrani, Khaled B. Alsulaim, Amr Jam
Journal of Medical Systems.2024;[Epub] CrossRef
Authentic assessment in medical education: exploring AI integration and student-as-partners collaboration
Syeda Sadia Fatima, Nabeel Ashfaque Sheikh, Athar Osama
Postgraduate Medical Journal.2024; 100(1190): 959. CrossRef
Comparative performance analysis of large language models: ChatGPT-3.5, ChatGPT-4 and Google Gemini in glucocorticoid-induced osteoporosis
Linjian Tong, Chaoyang Zhang, Rui Liu, Jia Yang, Zhiming Sun
Journal of Orthopaedic Surgery and Research.2024;[Epub] CrossRef
Can AI-Generated Clinical Vignettes in Japanese Be Used Medically and Linguistically?
Yasutaka Yanagita, Daiki Yokokawa, Shun Uchida, Yu Li, Takanori Uehara, Masatomi Ikusaka
Journal of General Internal Medicine.2024; 39(16): 3282. CrossRef
ChatGPT vs. sleep disorder specialist responses to common sleep queries: Ratings by experts and laypeople
Jiyoung Kim, Seo-Young Lee, Jee Hyun Kim, Dong-Hyeon Shin, Eun Hye Oh, Jin A Kim, Jae Wook Cho
Sleep Health.2024; 10(6): 665. CrossRef
Technology integration into Chinese as a foreign language learning in higher education: An integrated bibliometric analysis and systematic review (2000–2024)
Binze Xu
Language Teaching Research.2024;[Epub] CrossRef
The Transformative Power of Generative Artificial Intelligence for Achieving the Sustainable Development Goal of Quality Education
Prema Nedungadi, Kai-Yu Tang, Raghu Raman
Sustainability.2024; 16(22): 9779. CrossRef
Is AI the new course creator
Sheri Conklin, Tom Dorgan, Daisyane Barreto
Discover Education.2024;[Epub] CrossRef
Emergency Medicine Assistants in the Field of Toxicology, Comparison of ChatGPT-3.5 and GEMINI Artificial Intelligence Systems
Hatice Aslı Bedel, Cihan Bedel, Fatih Selvi, Ökkeş Zortuk, Yusuf Karanci
Acta medica Lituanica.2024; 31(2): 294. CrossRef

Research article

Performance of large language models on Thailand’s national medical licensing examination: a cross-sectional study: Prut Saowaprut, Romen Samuel Wabina, Junwei Yang, Lertboon Siriwat; J Educ Eval Health Prof. 2025;22:16. Published online May 12, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.16 [Epub ahead of print]

585 View
109 Download

Abstract PDF: Purpose
This study aimed to evaluate the feasibility of general-purpose large language models (LLMs) in addressing inequities in medical licensure exam preparation for Thailand’s National Medical Licensing Examination (ThaiNLE), which currently lacks standardized public study materials.
Methods
We assessed 4 multi-modal LLMs (GPT-4, Claude 3 Opus, Gemini 1.0/1.5 Pro) using a 304-question ThaiNLE Step 1 mock examination (10.2% image-based), applying deterministic API configurations and 5 inference repetitions per model. Performance was measured via micro- and macro-accuracy metrics compared against historical passing thresholds.
Results
All models exceeded passing scores, with GPT-4 achieving the highest accuracy (88.9%; 95% confidence interval, 88.7–89.1), surpassing Thailand’s national average by more than 2 standard deviations. Claude 3.5 Sonnet (80.1%) and Gemini 1.5 Pro (72.8%) followed hierarchically. Models demonstrated robustness across 17 of 20 medical domains, but variability was noted in genetics (74.0%) and cardiovascular topics (58.3%). While models demonstrated proficiency with images (Gemini 1.0 Pro: +9.9% vs. text), text-only accuracy remained superior (GPT-4o: 90.0% vs. 82.6%).
Conclusion
General-purpose LLMs show promise as equitable preparatory tools for ThaiNLE Step 1. However, domain-specific knowledge gaps and inconsistent multi-modal integration warrant refinement before clinical deployment.

Editorial

Halted medical education and medical residents’ training in Korea, journal metrics, and appreciation to reviewers and volunteers: Sun Huh; J Educ Eval Health Prof. 2025;22:1. Published online January 13, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.1

1,225 View
151 Download
1 Web of Science
2 Crossref

PDF Supplementary Material

Citations

Citations to this article as recorded by

How a medical journal can survive the freezing era of article production in Korea, and highlights in this issue of the Ewha Medical Journal
Ji Yeon Byun
The Ewha Medical Journal.2025;[Epub] CrossRef
Korea’s 2024 reduction in medical research output amid physician residents’ resignation
Jeong-Ju Yoo, Hyun Bin Choi, Young-Seok Kim, Sang Gyune Kim
Ewha Medical Journal.2025; 48(2): e36. CrossRef

Educational/Faculty development material

The role of large language models in the peer-review process: opportunities and challenges for medical journal reviewers and editors: Jisoo Lee, Jieun Lee, Jeong-Ju Yoo; J Educ Eval Health Prof. 2025;22:4. Published online January 16, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.4

3,156 View
242 Download

Abstract PDF Supplementary Material: The peer review process ensures the integrity of scientific research. This is particularly important in the medical field, where research findings directly impact patient care. However, the rapid growth of publications has strained reviewers, causing delays and potential declines in quality. Generative artificial intelligence, especially large language models (LLMs) such as ChatGPT, may assist researchers with efficient, high-quality reviews. This review explores the integration of LLMs into peer review, highlighting their strengths in linguistic tasks and challenges in assessing scientific validity, particularly in clinical medicine. Key points for integration include initial screening, reviewer matching, feedback support, and language review. However, implementing LLMs for these purposes will necessitate addressing biases, privacy concerns, and data confidentiality. We recommend using LLMs as complementary tools under clear guidelines to support, not replace, human expertise in maintaining rigorous peer review standards.

Correspondence

Accuracy of ChatGPT in answering cardiology board-style questions: Albert Andrew; J Educ Eval Health Prof. 2025;22:9. Published online February 27, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.9

1,879 View
149 Download

PDF Supplementary Material

Research articles

Simulation-based teaching versus traditional small group teaching for first-year medical students among high and low scorers in respiratory physiology, India: a randomized controlled trial: Nalini Yelahanka Channegowda, Dinker Ramanand Pai, Shivasakthy Manivasakan; J Educ Eval Health Prof. 2025;22:8. Published online February 21, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.8

857 View
185 Download
1 Crossref

Abstract PDF Supplementary Material

Purpose
Although it is widely utilized in clinical subjects for skill training, using simulation-based education (SBE) for teaching basic science concepts to phase I medical students or pre-clinical students is limited. Simulation-based education/teaching is preferred in cardiovascular and respiratory physiology when compared to other systems because it is easy to recreate both the normal physiological component and alterations in the simulated environment, thus a promoting deep understanding of the core concepts.
Methods
A block randomized study was conducted among 107 phase 1 (first-year) medical undergraduate students at a Deemed to be University in India. Group A received SBE and Group B traditional small group teaching. The effectiveness of the teaching intervention was assessed using pre- and post-tests. Student feedback was obtained through a self administered structured questionnaire via an anonymous online survey and by in-depth interview.
Results
The intervention group showed a statistically significant improvement in post-test scores compared to the control group. A sub-analysis revealed that high scorers performed better than low scorers in both groups, but the knowledge gain among low scorers was more significant in the intervention group.
Conclusion
This teaching strategy offers a valuable supplement to traditional methods, fostering a deeper comprehension of clinical concepts from the outset of medical training.

Citations

Citations to this article as recorded by

Simulation and Augmented Reality on Academic Performance and Engagement in Grade 11 Earth and Life Science
Abigail G. Dumaguing, Wilfred G. Alava Jr.
International Journal of Innovative Science and Research Technology.2025; : 2817. CrossRef

Pharmacy students’ perspective on remote flipped classrooms in Malaysia: a qualitative study: Wei Jin Wong, Shaun Wen Huey Lee, Ronald Fook Seng Lee; J Educ Eval Health Prof. 2025;22:2. Published online January 14, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.2

916 View
196 Download

Abstract PDF Supplementary Material: Purpose
This study aimed to explore pharmacy students’ perceptions of remote flipped classrooms in Malaysia, focusing on their learning experiences and identifying areas for potential improvement to inform future educational strategies.
Methods
A qualitative approach was employed, utilizing inductive thematic analysis. Twenty Bachelor of Pharmacy students (18 women, 2 men; age range, 19–24 years) from Monash University participated in 8 focus group discussions over 2 rounds during the coronavirus disease 2019 pandemic. Participants were recruited via convenience sampling. The focus group discussions, led by experienced academics, were conducted in English via Zoom, recorded, and transcribed for analysis using NVivo. Themes were identified through emergent coding and iterative discussions to ensure thematic saturation.
Results
Five major themes emerged: flexibility, communication, technological challenges, skill-based learning challenges, and time-based effects. Students appreciated the flexibility of accessing and reviewing pre-class materials at their convenience. Increased engagement through anonymous question submission was noted, yet communication difficulties and lack of non-verbal cues in remote workshops were significant drawbacks. Technological issues, such as internet connectivity problems, hindered learning, especially during assessments. Skill-based learning faced challenges in remote settings, including lab activities and clinical examinations. Additionally, prolonged remote learning led to feelings of isolation, fatigue, and a desire to return to in-person interactions.
Conclusion
Remote flipped classrooms offer flexibility and engagement benefits but present notable challenges related to communication, technology, and skill-based learning. To improve remote education, institutions should integrate robust technological support, enhance communication strategies, and incorporate virtual simulations for practical skills. Balancing asynchronous and synchronous methods while addressing academic success and socioemotional wellness is essential for effective remote learning environments.

Empirical effect of the Dr LEE Jong-wook Fellowship Program to empower sustainable change for the health workforce in Tanzania: a mixed-methods study: Masoud Dauda, Swabaha Aidarus Yusuph, Harouni Yasini, Issa Mmbaga, Perpetua Mwambinngu, Hansol Park, Gyeongbae Seo, Kyoung Kyun Oh; J Educ Eval Health Prof. 2025;22:6. Published online January 20, 2025; DOI: https://doi.org/10.3352/jeehp.2025.22.6

1,487 View
229 Download

Abstract PDF Supplementary Material: Purpose
This study evaluated the Dr LEE Jong-wook Fellowship Program’s impact on Tanzania’s health workforce, focusing on relevance, effectiveness, efficiency, impact, and sustainability in addressing healthcare gaps.
Methods
A mixed-methods research design was employed. Data were collected from 97 out of 140 alumni through an online survey, 35 in-depth interviews, and one focus group discussion. The study was conducted from November to December 2023 and included alumni from 2009 to 2022. Measurement instruments included structured questionnaires for quantitative data and semi-structured guides for qualitative data. Quantitative analysis involved descriptive and inferential statistics (Spearman’s rank correlation, non-parametric tests) using Python ver. 3.11.0 and Stata ver. 14.0. Thematic analysis was employed to analyze qualitative data using NVivo ver. 12.0.
Results
Findings indicated high relevance (mean=91.6, standard deviation [SD]=8.6), effectiveness (mean=86.1, SD=11.2), efficiency (mean=82.7, SD=10.2), and impact (mean=87.7, SD=9.9), with improved skills, confidence, and institutional service quality. However, sustainability had a lower score (mean=58.0, SD=11.1), reflecting challenges in follow-up support and resource allocation. Effectiveness strongly correlated with impact (ρ=0.746, P<0.001). The qualitative findings revealed that participants valued tailored training but highlighted barriers, such as language challenges and insufficient practical components. Alumni-led initiatives contributed to knowledge sharing, but limited resources constrained sustainability.
Conclusion
The Fellowship Program enhanced Tanzania’s health workforce capacity, but it requires localized curricula and strengthened alumni networks for sustainability. These findings provide actionable insights for improving similar programs globally, confirming the hypothesis that tailored training positively influences workforce and institutional outcomes.

Review

Opportunities, challenges, and future directions of large language models, including ChatGPT in medical education: a systematic scoping review: Xiaojun Xu, Yixiao Chen, Jing Miao; J Educ Eval Health Prof. 2024;21:6. Published online March 15, 2024; DOI: https://doi.org/10.3352/jeehp.2024.21.6

9,789 View
685 Download
24 Web of Science
28 Crossref

Abstract PDF Supplementary Material

Background
ChatGPT is a large language model (LLM) based on artificial intelligence (AI) capable of responding in multiple languages and generating nuanced and highly complex responses. While ChatGPT holds promising applications in medical education, its limitations and potential risks cannot be ignored.
Methods
A scoping review was conducted for English articles discussing ChatGPT in the context of medical education published after 2022. A literature search was performed using PubMed/MEDLINE, Embase, and Web of Science databases, and information was extracted from the relevant studies that were ultimately included.
Results
ChatGPT exhibits various potential applications in medical education, such as providing personalized learning plans and materials, creating clinical practice simulation scenarios, and assisting in writing articles. However, challenges associated with academic integrity, data accuracy, and potential harm to learning were also highlighted in the literature. The paper emphasizes certain recommendations for using ChatGPT, including the establishment of guidelines. Based on the review, 3 key research areas were proposed: cultivating the ability of medical students to use ChatGPT correctly, integrating ChatGPT into teaching activities and processes, and proposing standards for the use of AI by medical students.
Conclusion
ChatGPT has the potential to transform medical education, but careful consideration is required for its full integration. To harness the full potential of ChatGPT in medical education, attention should not only be given to the capabilities of AI but also to its impact on students and teachers.

Citations

Citations to this article as recorded by

AI-assisted patient education: Challenges and solutions in pediatric kidney transplantation
MZ Ihsan, Dony Apriatama, Pithriani, Riza Amalia
Patient Education and Counseling.2025; 131: 108575. CrossRef
Exploring predictors of AI chatbot usage intensity among students: Within- and between-person relationships based on the technology acceptance model
Anne-Kathrin Kleine, Insa Schaffernak, Eva Lermer
Computers in Human Behavior: Artificial Humans.2025; 3: 100113. CrossRef
AI-powered standardised patients: evaluating ChatGPT-4o’s impact on clinical case management in intern physicians
Selcen Öncü, Fulya Torun, Hilal Hatice Ülkü
BMC Medical Education.2025;[Epub] CrossRef
UsmleGPT: An AI application for developing MCQs via multi-agent system
Zhehan Jiang, Shicong Feng
Software Impacts.2025; 23: 100742. CrossRef
ChatGPT’s Performance on Portuguese Medical Examination Questions: Comparative Analysis of ChatGPT-3.5 Turbo and ChatGPT-4o Mini
Filipe Prazeres
JMIR Medical Education.2025; 11: e65108. CrossRef
Transforming medical education: leveraging large language models to enhance PBL—a proof-of-concept study
Shoukat Ali Arain, Shahid Akhtar Akhund, Muhammad Abrar Barakzai, Sultan Ayoub Meo
Advances in Physiology Education.2025; 49(2): 398. CrossRef
Integrating artificial intelligence into pre-clinical medical education: challenges, opportunities, and recommendations
Birgit Pohn, Lars Mehnen, Sebastian Fitzek, Kyung-Eun (Anna) Choi, Ralf J. Braun, Sepideh Hatamikia
Frontiers in Education.2025;[Epub] CrossRef
Evaluating the Accuracy and Reliability of Large Language Models (ChatGPT, Claude, DeepSeek, Gemini, Grok, and Le Chat) in Answering Item-Analyzed Multiple-Choice Questions on Blood Physiology
Mayank Agarwal, Priyanka Sharma, Pinaki Wani
Cureus.2025;[Epub] CrossRef
Artificial intelligence-assisted academic writing: recommendations for ethical use
Adam Cheng, Aaron Calhoun, Gabriel Reedy
Advances in Simulation.2025;[Epub] CrossRef
University Educators Perspectives on ChatGPT: A Technology Acceptance Model-Based Study
Muna Barakat, Nesreen A. Salim, Malik Sallam
Open Praxis.2025; 17(1): 129. CrossRef
Knowledge and use, perceptions of benefits and limitations of artificial intelligence chatbots among Italian physiotherapy students: a cross-sectional national study
Fabio Tortella, Alvisa Palese, Andrea Turolla, Greta Castellini, Paolo Pillastrini, Maria Gabriella Landuzzi, Chad Cook, Giovanni Galeoto, Giuseppe Giovannico, Lia Rodeghiero, Silvia Gianola, Giacomo Rossettini
BMC Medical Education.2025;[Epub] CrossRef
Digital and Intelligence Education in Medicine: A Bibliometric and Visualization Analysis Using CiteSpace and VOSviewer
Bing Xiang Yang, FuLing Zhou, Nan Bai, Sichen Zhou, Chunyan Luo, Qing Wang, Arkers Kwan Ching Wong, Frances Lin
Frontiers of Digital Education.2025;[Epub] CrossRef
Prompts, privacy, and personalized learning: integrating AI into nursing education—a qualitative study
Mingyan Shen, Yanping Shen, Fangchi Liu, Jiawen Jin
BMC Nursing.2025;[Epub] CrossRef
The role of ChatGPT-4o in differential diagnosis and management of vertigo-related disorders
Xu Liu, Suming Shi, Xin Zhang, Qianwen Gao, Wuqing Wang
Scientific Reports.2025;[Epub] CrossRef
Situating governance and regulatory concerns for generative artificial intelligence and large language models in medical education
Michael Tran, Chinthaka Balasooriya, Jitendra Jonnagaddala, Gilberto Ka-Kit Leung, Neeraj Mahboobani, Subha Ramani, Joel Rhee, Lambert Schuwirth, Neysan Sedaghat Najafzadeh-Tabrizi, Carolyn Semmler, Zoie SY Wong
npj Digital Medicine.2025;[Epub] CrossRef
Chatbots in neurology and neuroscience: Interactions with students, patients and neurologists
Stefano Sandrone
Brain Disorders.2024; 15: 100145. CrossRef
ChatGPT in education: unveiling frontiers and future directions through systematic literature review and bibliometric analysis
Buddhini Amarathunga
Asian Education and Development Studies.2024; 13(5): 412. CrossRef
Evaluating the performance of ChatGPT-3.5 and ChatGPT-4 on the Taiwan plastic surgery board examination
Ching-Hua Hsieh, Hsiao-Yun Hsieh, Hui-Ping Lin
Heliyon.2024; 10(14): e34851. CrossRef
Preparing for Artificial General Intelligence (AGI) in Health Professions Education: AMEE Guide No. 172
Ken Masters, Anne Herrmann-Werner, Teresa Festl-Wietek, David Taylor
Medical Teacher.2024; 46(10): 1258. CrossRef
A Comparative Analysis of ChatGPT and Medical Faculty Graduates in Medical Specialization Exams: Uncovering the Potential of Artificial Intelligence in Medical Education
Gülcan Gencer, Kerem Gencer
Cureus.2024;[Epub] CrossRef
Research ethics and issues regarding the use of ChatGPT-like artificial intelligence platforms by authors and reviewers: a narrative review
Sang-Jun Kim
Science Editing.2024; 11(2): 96. CrossRef
Innovation Off the Bat: Bridging the ChatGPT Gap in Digital Competence among English as a Foreign Language Teachers
Gulsara Urazbayeva, Raisa Kussainova, Aikumis Aibergen, Assel Kaliyeva, Gulnur Kantayeva
Education Sciences.2024; 14(9): 946. CrossRef
Exploring the perceptions of Chinese pre-service teachers on the integration of generative AI in English language teaching: Benefits, challenges, and educational implications
Ji Young Chung, Seung-Hoon Jeong
Online Journal of Communication and Media Technologies.2024; 14(4): e202457. CrossRef
Unveiling the bright side and dark side of AI-based ChatGPT : a bibliographic and thematic approach
Chandan Kumar Tiwari, Mohd. Abass Bhat, Abel Dula Wedajo, Shagufta Tariq Khan
Journal of Decision Systems.2024; : 1. CrossRef
Artificial Intelligence in Medical Education and Mentoring in Rehabilitation Medicine
Julie K. Silver, Mustafa Reha Dodurgali, Nara Gavini
American Journal of Physical Medicine & Rehabilitation.2024; 103(11): 1039. CrossRef
The Potential of Artificial Intelligence Tools for Reducing Uncertainty in Medicine and Directions for Medical Education
Sauliha Rabia Alli, Soaad Qahhār Hossain, Sunit Das, Ross Upshur
JMIR Medical Education.2024; 10: e51446. CrossRef
A Systematic Literature Review of Empirical Research on Applying Generative Artificial Intelligence in Education
Xin Zhang, Peng Zhang, Yuan Shen, Min Liu, Qiong Wang, Dragan Gašević, Yizhou Fan
Frontiers of Digital Education.2024; 1(3): 223. CrossRef
Artificial intelligence in medical problem-based learning: opportunities and challenges
Yaoxing Chen, Hong Qi, Yu Qiu, Juan Li, Liang Zhu, Xiaoling Gao, Hao Wang, Gan Jiang
Global Medical Education.2024;[Epub] CrossRef

First
Prev
Page of 7
Next
Last

Most download articles