Journal of Educational Evaluation for Health Professions

Research articles

Inter-rater reliability and content validity of the measurement tool for portfolio assessments used in the Introduction to Clinical Medicine course at Ewha Womans University College of Medicine: a methodological study: Dong-Mi Yoo, Jae Jin Han; J Educ Eval Health Prof. 2024;21:39. Published online December 10, 2024; DOI: https://doi.org/10.3352/jeehp.2024.21.39

880 View
166 Download

Abstract PDF Supplementary Material: Purpose
This study aimed to examine the reliability and validity of a measurement tool for portfolio assessments in medical education. Specifically, it investigated scoring consistency among raters and assessment criteria appropriateness according to an expert panel.
Methods
A cross-sectional observational study was conducted from September to December 2018 for the Introduction to Clinical Medicine course at the Ewha Womans University College of Medicine. Data were collected for 5 randomly selected portfolios scored by a gold-standard rater and 6 trained raters. An expert panel assessed the validity of 12 assessment items using the content validity index (CVI). Statistical analysis included Pearson correlation coefficients for rater alignment, the intraclass correlation coefficient (ICC) for inter-rater reliability, and the CVI for item-level validity.
Results
Rater 1 had the highest Pearson correlation (0.8916) with the gold-standard rater, while Rater 5 had the lowest (0.4203). The ICC for all raters was 0.3821, improving to 0.4415 after excluding Raters 1 and 5, indicating a 15.6% reliability increase. All assessment items met the CVI threshold of ≥0.75, with some achieving a perfect score (CVI=1.0). However, items like “sources” and “level and degree of performance” showed lower validity (CVI=0.72).
Conclusion
The present measurement tool for portfolio assessments demonstrated moderate reliability and strong validity, supporting its use as a credible tool. For a more reliable portfolio assessment, more faculty training is needed.

Are we teaching health science students in the United States what they need to know about death and dying coping strategies?: Randy D. Case, Erica Judie, Tammy Kurszewski, Wenica Brodie, Pollyann Bethel; J Educ Eval Health Prof. 2021;18:29. Published online November 11, 2021; DOI: https://doi.org/10.3352/jeehp.2021.18.29

5,648 View
241 Download
2 Web of Science
2 Crossref

Purpose
This investigation aimed to answer the following questions: are health science students provided with death and dying education before attending clinical rotations, and if so, do the students receiving this type of education perceive it as effective?
Methods
In this descriptive cross-sectional survey, 96 Midwestern State University health science students were surveyed to determine the percentage of students who had received death and dying education before clinical rotations, as well as the students’ perception of educational effectiveness for those who had received end-of-life training. A self-report questionnaire presented nursing, radiologic sciences, and respiratory care students with a series of questions pertaining to the education they had received concerning the death and dying process of patients.
Results
Of the 93 students who had already started their clinical rotations, 55 stated they had not received death and dying education before starting clinical courses. Of the 38 who had received death and dying education, only 17 students believed the training was effective.
Conclusion
It is imperative that health science educational programs implement death and dying education and training into the curriculum, and that criteria for evaluating effectiveness be an essential part of death and dying education and training in order to ensure effectiveness.

Citations

Citations to this article as recorded by

Death education, communication, and happiness: An unlikely general education triad?
Kurt Wise, Laura Bruns
Policy Futures in Education.2025;[Epub] CrossRef
Communication skills training in advance care planning: a survey among medical students at the University of Antwerp
Mick van de Wiel, Katrien Bombeke, Annelies Janssens
BMC Palliative Care.2022;[Epub] CrossRef

Research Articles

Learning styles and academic achievement among undergraduate medical students in Thailand: Wichuda Jiraporncharoen, Chaisiri Angkurawaranon, Manoch Chockjamsai, Athavudh Deesomchok, Juntima Euathrongchit; J Educ Eval Health Prof. 2015;12:38. Published online July 8, 2015; DOI: https://doi.org/10.3352/jeehp.2015.12.38

37,942 View
344 Download
18 Web of Science
26 Crossref

Abstract PDF

Purpose
This study aimed to explore the associations between learning styles and high academic achievement and to ascertain whether the factors associated with high academic achievement differed between preclinical and clinical students. Methods: A survey was conducted among undergraduate medical students in Chiang Mai University, Thailand. The Index of Learning Styles questionnaire was used to assess each student’s learning style across four domains. High academic achievement was defined as a grade point average of at least 3.0. Results: Of the 1,248 eligible medical students, 1,014 (81.3%) participated. Learning styles differed between the preclinical and clinical students in the active/reflective domain. A sequential learning style was associated with high academic achievement in both preclinical and clinical students. A reflective learning style was only associated with high academic achievement among preclinical students. Conclusion: The association between learning styles and academic achievement may have differed between preclinical and clinical students due to different learning content and teaching methods. Students should be encouraged to be flexible in their own learning styles in order to engage successfully with various and changing teaching methods across the curriculum. Instructors should be also encouraged to provide a variety of teaching materials and resources to suit different learning styles.

Citations

Citations to this article as recorded by

Eye-tracking insights into cognitive strategies, learning styles, and academic outcomes of Turkish medicine students
Hande Argunsah, Levent Altıntaş, Melike Şahiner
BMC Medical Education.2025;[Epub] CrossRef
Identifying Learning Preferences and Strategies in Health Data Science Courses: Systematic Review
Narjes Rohani, Stephen Sowa, Areti Manataki
JMIR Medical Education.2024; 10: e50667. CrossRef
Educational technology for the formation of project competence for engineering students
Liudmyla V. Hapon-Baida, Tetiana M. Derkach
Educational Dimension.2024; 11: 81. CrossRef
Tapping into Efficient Learning: An Exploration of the Impact of Sequential Learning on Skill Gains and Learning Curves in Central Venous Catheterization Simulator Training
Haroula Tzamaras, Dailen Brown, Jason Moore, Scarlett R. Miller
Journal of Medical Education and Curricular Development.2024;[Epub] CrossRef
Estilos de aprendizagem de estudantes de graduação em medicina: comparação entre duas escolas com diferentes metodologias de ensino da cidade de Mossoró-RN
Patrícia Jovelina de Freitas, Ligiane Medeiros Diógenes, Thiago Gurgel Regis, José Rodolfo Lopes de Paiva Cavalcanti
Cuadernos de Educación y Desarrollo.2024; 16(11): e6203. CrossRef
Educational data mining: factors influencing medical student success and the exploration of visualization techniques
Ploywarong Rueangket, Chulaluck Thaebanpakul, Boonsub Sakboonyarat, Akara Prayote
Frontiers in Education.2024;[Epub] CrossRef
ESTILOS DE APRENDIZAGEM DE ESTUDANTES DE GRADUAÇÃO EM MEDICINA: COMPARAÇÃO ENTRE DUAS ESCOLAS COM DIFERENTES METODOLOGIAS DE ENSINO DA CIDADE DE MOSSORÓ-RN
Rilva Lopes de Sousa Muñoz, Ligiane Medeiros Diógenes
REVISTA FOCO.2023; 16(4): e1538. CrossRef
Learning styles in science education at university level: A systematic review
Albina R. Shaidullina, Natalia A. Orekhovskaya, Evgeny G. Panov, Marina N. Svintsova, Oksana N. Petyukova, Nataliya S. Zhuykova, Elena V. Grigoryeva
Eurasia Journal of Mathematics, Science and Technology Education.2023; 19(7): em2293. CrossRef
Современные образовательные технологии и их использование при изучении физиологии в медицинском вузе
Б. Ю. Бадалян, А. Л. Торгомян
Biological Journal of Armenia.2023; : 180. CrossRef
Learning style preference and the academic achievements of medical students in an integrated curriculum
Adel Mohamed Aboregela
Journal of Medicine and Life.2023; 16(12): 1802. CrossRef
Crossword puzzle as a learning tool to enhance learning about anticoagulant therapeutics
Ghada Bawazeer, Ibrahim Sales, Huda Albogami, Ahmed Aldemerdash, Mansour Mahmoud, Majidah A. Aljohani, Abdullah Alhammad
BMC Medical Education.2022;[Epub] CrossRef
Do learning style preferences influence the cumulative gross point average and self directed learning hours in dental students: a preliminary study
Kiran Kumar Ganji, Mohammad Khursheed Alam, Ravi Kumar Gudipaneni, Hmoud Algarni, Manay Srinivas Munisekhar, May Osman Hamza, Mohammed Assayed Mousa, Mohammed Ghazi Sghaireen
BMC Medical Education.2022;[Epub] CrossRef
Changes in the learning styles and approaches of students following incorporation of drawing during cadaveric dissection
Joydeep Dutta Chaudhuri
Clinical Anatomy.2021; 34(3): 437. CrossRef
Analyzing the relationship between learning styles (Kolb and VARK) and creativity with the academic achievement of dental students
Mahdokht Taheri, Mehran Falahchai, Mandana Javanak, Yasamin Babaee Hemmati, Mehdi Dasht Bozorgi
Journal of Education and Health Promotion.2021; 10(1): 252. CrossRef
An Assessment of Learning Styles of Undergraduate Medical Students in Three Different Types of Curriculum
Abdulrahman Alfawzan, Moeber Mahzari, Sajida Agha, Aamir Omair, Omar Alfawzan, Reema Alessa, Abdulaziz Alturki, Kholoud Alshiha
Journal of Nature and Science of Medicine.2021; 4(3): 267. CrossRef
Cuestionario Honey-Alonso de Estilos de Aprendizaje: Nuevas evidencias psicométricas en población argentina
Agustín Freiberg Hoffmann, Facundo Abal, Mercedes Fernández Liporace
Acta Colombiana de Psicología.2020; 23(2): 328. CrossRef
Cuestionario Honey-Alonso de Estilos de Aprendizaje: Nuevas evidencias psicométricas en población argentina
Agustín Freiberg Hoffmann, Facundo Abal, Mercedes Fernández Liporace
Acta Colombiana de Psicología.2020; 23(2): 328. CrossRef
A cross-sectional study of learning styles among continuing medical education participants
C. Scott Collins, Sanjeev Nanda, Brian A. Palmer, Arya B. Mohabbat, Cathy D. Schleck, Jayawant N. Mandrekar, Saswati Mahapatra, Thomas J. Beckman, Christopher M. Wittich
Medical Teacher.2019; 41(3): 318. CrossRef
Snapshot of academic dishonesty among Malaysian nursing students: A single university experience
Ali H. Abusafia, Nurhanis Syazni Roslan, Dariah Mohd Yusoff, Mohd Zarawi Mat Nor
Journal of Taibah University Medical Sciences.2018; 13(4): 370. CrossRef
Does learning style preferences influence academic performance among dental students in Isfahan, Iran?
Najmeh Akhlaghi, Hosein Mirkazemi, Mehdi Jafarzade, Narjes Akhlaghi
Journal of Educational Evaluation for Health Professions.2018; 15: 8. CrossRef
Learning styles preferences and e-learning experience of undergraduate dental students
Ana Cláudia DALMOLIN, Giselle Ariana Otto MACKEIVICZ, Márcia Thaís POCHAPSKI, Gibson Luiz PILATTI, Fábio André SANTOS
Revista de Odontologia da UNESP.2018; 47(3): 175. CrossRef
A significant association between examination results and self-satisfaction with English language proficiency: preliminary findings among pre-clinical undergraduates
Madushika Wijesundara, Chamindi Wijerathna, Kasun Wijerathna, Rasangi Wijerathna, Srimali Wijethunga, Ashan Wijewardana, Anuprabha Wickramasinghe, Devarajan Rathish
BMC Research Notes.2018;[Epub] CrossRef
Learning Style and Academic Achievement among Students at Tabriz University of Medical Sciences, Iran
Horyeh Sarbazvatan, Abolghasem Amini, Nayyereh Aminisani, SeyedMorteza Shamshirgaran, Saeideh Ghaffarifar
Research and Development in Medical Education.2018; 7(2): 77. CrossRef
The Mathematics Learning Styles of Vocational College Students
Serpil Yorganci
European Journal of Educational Research.2018; volume-7-2(volume7-is): 935. CrossRef
INFLUENCE OF LEARNING STRATEGIES ON LEARNING STYLES: THEIR IMPACT ON ACADEMIC ACHIEVEMENT OF COLLEGE STUDENTS FROM BUENOS AIRES
Agustín Freiberg-Hoffmann, Juliana Beatriz Stover, Natalia Donis
Problems of Education in the 21st Century.2017; 75(1): 6. CrossRef
Learning styles, academic achievement, and mental health problems among medical students in Thailand
Salilthip Paiboonsithiwong, Natchaya Kunanitthaworn, Natchaphon Songtrijuck, Nahathai Wongpakaran, Tinakon Wongpakaran
Journal of Educational Evaluation for Health Professions.2016; 13: 38. CrossRef

Medical students’ achievement on the Bachelor of Medicine, Bachelor of Surgery/Chirurgery Final Part I and II licensing examination: a comparison of students in problem-based learning, community-based education and service, and conventional curricula in Ghana: Victor Mogre, Anthony Amalba, Mark Saaka, Kwabena Kyei-Aboagye; J Educ Eval Health Prof. 2014;11:10. Published online May 8, 2014; DOI: https://doi.org/10.3352/jeehp.2014.11.10

32,285 View
155 Download
6 Web of Science
10 Crossref

Abstract PDF

Purpose
Problem-based learning is an established method of teaching and learning in medical education. However, its impact on students’ achievement on examinations is varied and inconsistent. We compared the levels of achievement on the Bachelor of Medicine, Bachelor of Surgery/Chirurgery (MB ChB) Part I and II licensing examination of students in problem-based learning, community-based education and service (PBL/COBES), and conventional curricula.
Methods
In 2014, we analyzed the MB ChB Final Part I and II licensing examination results of students in three classes (2004, 2005, and 2006) of the School of Medicine and Health Sciences, University for Development Studies, Tamale, Ghana. Ninety-three students in the 2004 and 2005 cohorts followed a conventional curriculum, and 82 students in the 2006 cohort followed a PBL/COBES curriculum. Using appropriate statistical tools, the analysis compared individual discipline scores and the proportions of students who received distinction/credit/pass grades among the classes.
Results
The PBL students had significantly higher mean and median scores than the conventional students in Obstetrics and Gynecology, Internal Medicine, Community Health and Family Medicine, Surgery, and Psychiatry, but not in Child Health and Pediatrics. Also, a significantly (P=0.0010) higher percentage, 95.1% (n=78), of the PBL students passed all the disciplines, compared to 79.6% (n=74) of the conventional students.
Conclusion
The PBL students significantly performed better in all the disciplines except child health and pediatrics, where the conventional students scored higher. These findings demonstrate that the benefits of the PBL/COBES curriculum are tangible and should be fostered.

Citations

Citations to this article as recorded by

Transforming medical education in Liberia through an international community of inquiry
Kristina Talbert-Slagle, Ibrahim Ajami, Braden Currey, Rachel Galvao, Jerusalem Hadush, Serene Silin Li, Javaughn T. Flowers, Moses Ziah, Desmond Amuh, Mikaela Rabb, Olayinka Stephen Ilesanmi, Nikole Allen, Marie Martin, Mary Miller, Attila Yaman, Tej Nut
PLOS Global Public Health.2023; 3(3): e0001610. CrossRef
Preparedness of medical students to provide nutrition care following a nutrition education intervention
Bright Yammaha Amoore, Patience Kanyiri Gaa, Shamsu-Deen Ziblim, Victor Mogre
BMC Research Notes.2023;[Epub] CrossRef
The effectiveness of problem-based learning compared with lecture-based learning in surgical education: a systematic review and meta-analysis
Qi-Ming Zheng, Yuan-Yuan Li, Qing Yin, Na Zhang, Ye-Peng Wang, Guo-Xiang Li, Zhi-Gang Sun
BMC Medical Education.2023;[Epub] CrossRef
Evaluating the Academic Performance of Mustansiriyah Medical College Teaching Staff vs. Final-Year Students Failure Rates
Wassan Nori, Wisam Akram , Saad Mubarak Rasheed, Nabeeha Najatee Akram, Taqi Mohammed Jwad Taher, Mustafa Ali Kassim Kassim, Alexandru Cosmin Pantazi
Al-Rafidain Journal of Medical Sciences ( ISSN 2789-3219 ).2023; 5(1S): S151. CrossRef
Perceptions of education quality and influence of language barrier: graduation survey of international medical students at four universities in China
Wen Li, Chang Liu, Shenjun Liu, Xin Zhang, Rong-gen Shi, Hailan Jiang, Yi Ling, Hong Sun
BMC Medical Education.2020;[Epub] CrossRef
Nutrition in Medicine: Medical Students׳ Satisfaction, Perceived Relevance and Preparedness for Practice
Victor Mogre, Fred Stevens, Paul A. Aryee, Albert J.J.A. Scherpbier
Health Professions Education.2018; 4(1): 31. CrossRef
Perception of Ghanaian Medical Students of Cadaveric Dissection in a Problem-Based Learning Curriculum
Abass Alhassan, Saeed Majeed
Anatomy Research International.2018; 2018: 1. CrossRef
Learning effectiveness and satisfaction of international medical students: Introducing a Hybrid–PBL curriculum in biochemistry
Qiu Yan, Li Ma, Lina Zhu, Wenli Zhang
Biochemistry and Molecular Biology Education.2017; 45(4): 336. CrossRef
Future Doctors’ Nutrition-Related Knowledge, Attitudes and Self-Efficacy Regarding Nutrition Care in the General Practice Setting: A Cross-Sectional Survey
Victor Mogre, Paul A. Aryee, Fred C. J. Stevens, Albert J. J. A Scherpbier
Medical Science Educator.2017; 27(3): 481. CrossRef
Assessing the reliability and validity of the Revised Two Factor Study Process Questionnaire (R-SPQ2F) in Ghanaian medical students
Victor Mogre, Anthony Amalba
Journal of Educational Evaluation for Health Professions.2014; 11: 19. CrossRef

First
Prev
Page of 1
Next
Last

Search