Journal of Educational Evaluation for Health Professions

Effects of Rating Training on Inter-Rater Consistency for Developing a Dental Hygiene Clinical Rater Qualification System: Jeong Ran Park, Jung Sook Oh, Moungae Chae, Jae Yeon Jung, Sung Suk Bae; J Educ Eval Health Prof. 2007;4:5. Published online December 20, 2007; DOI: https://doi.org/10.3352/jeehp.2007.4.5

26,518 View
142 Download

Abstract PDF: We tried to develop itemized evaluation criteria and a clinical rater qualification system through rating training of inter-rater consistency for experienced clinical dental hygienists and dental hygiene clinical educators. A total of 15 clinical dental hygienists with 1-year careers participated as clinical examination candidates, while 5 dental hygienists with 3-year educations and clinical careers or longer participated as clinical raters. They all took the clinical examination as examinees. The results were compared, and the consistency of competence was measured. The comparison of clinical competence between candidates and clinical raters showed that the candidate group?占퐏 mean clinical competence ranged from 2.96 to 3.55 on a 5-point system in a total of 3 instruments (Probe, Explorer, Curet), while the clinical rater group?占퐏 mean clinical competence ranged from 4.05 to 4.29. There was a higher inter-rater consistency after education of raters in the following 4 items: Probe, Explorer, Curet, and insertion on distal surface. The mean score distribution of clinical raters ranged from 75% to 100%, which was more uniform in the competence to detect an artificial calculus than that of candidates (25% to 100%). According to the above results, there was a necessity in the operating clinical rater qualification system for comprehensive dental hygiene clinicians. Furthermore, in order to execute the clinical rater qualification system, it will be necessary to keep conducting a series of studies on educational content, time, frequency, and educator level.

Revised Subjects of the Current Korean Oriental Pharmacists' Licensing Examination: Jong-Pil Lim, Seon-Pyo Hong, Young-Mi Lee, Hoon Jeon; J Educ Eval Health Prof. 2007;4:4. Published online December 20, 2007; DOI: https://doi.org/10.3352/jeehp.2007.4.4

28,510 View
153 Download

Abstract PDF: This study is designed to draw out new integrated subjects of the Korean Oriental Pharmacists??Licensing Examination (KOPLE). In 2004, for the revision of subjects, we have analyzed the curriculums of the Oriental Pharmacy department, the oriental pharmacist?占퐏 (OP?占퐏) job description book, and the elementary items of KOPLE. We also examined the system of the Chinese Herb Pharmacists??Examination and other health personnel licensing examinations and studied the data of items and compared them with KOPLE. We heard the public opinion on the present KOPLE. We developed a subfield of 18 subjects, a middle category of 188 items, and a small category of 1,026 items. We proposed a new KOPLE that consists of three subjects: basic oriental pharmacy, applied oriental pharmacy, and laws and regulations.

Is the Pass/Fail System Applicable to a Medical School in Korea?: Mee Young Kim; J Educ Eval Health Prof. 2007;4:3. Published online December 20, 2007; DOI: https://doi.org/10.3352/jeehp.2007.4.3

38,559 View
146 Download

Abstract PDF: To determine whether a pass/fail system is more appropriate for medical education instead of a grade-based system, a survey of medical students and faculty members of Hallym University, Korea, was taken. A questionnaire was delivered to 54 junior students and 36 faculty members from a medical school in Korea and analyzed. Of these participants, 37.7% of students and 36.1% of faculty agreed to the pass/fail system, while 28.3% of students and 52.8% of faculty objected to it. The most frequent reason for objection was the potential decrease in learning achievement. A pass/fail system should be considered after persuasion of the students and faculty to think positively of this system.

What Should be Prepared for the Mutual Accreditation for Medical Health Licenses When Korea Opens to Physicians and Dentists from the Rest of the World: Sun Huh; J Educ Eval Health Prof. 2007;4:2. Published online May 14, 2007; DOI: https://doi.org/10.3352/jeehp.2007.4.2

23,837 View
148 Download
2 Crossref

PDF

Citations

Citations to this article as recorded by

Can a medical regulatory system be implemented in Korea?
Sun Huh, Myung-Hyun Chung
Journal of the Korean Medical Association.2013; 56(3): 158. CrossRef
Can computerized tests be introduced to the Korean Medical Licensing Examination?
Sun Huh
Journal of the Korean Medical Association.2012; 55(2): 124. CrossRef

Reconsidering the Cut Score of Korean National Medical Licensing Examination: Duck Sun Ahn, Sowon Ahn; J Educ Eval Health Prof. 2007;4:1. Published online April 28, 2007; DOI: https://doi.org/10.3352/jeehp.2007.4.1

42,031 View
177 Download
4 Crossref

Abstract PDF

After briefly reviewing theories of standard setting we analyzed the problems of the current cut scores. Then, we reported the results of need assessment on the standard setting among medical educators and psychometricians. Analyses of the standard setting methods of developed countries were reported as well. Based on these findings, we suggested the Bookmark and the modified Angoff methods as alternative methods for setting standard. Possible problems and challenges were discussed when these methods were applied to the National Medical Licensing Examination.

Citations

Citations to this article as recorded by

Predicting medical graduates’ clinical performance using national competency examination results in Indonesia
Prattama Santoso Utomo, Amandha Boy Timor Randita, Rilani Riskiyana, Felicia Kurniawan, Irwin Aras, Cholis Abrori, Gandes Retno Rahayu
BMC Medical Education.2022;[Epub] CrossRef
Possibility of independent use of the yes/no Angoff and Hofstee methods for the standard setting of the Korean Medical Licensing Examination written test: a descriptive study
Do-Hwan Kim, Ye Ji Kang, Hoon-Ki Park
Journal of Educational Evaluation for Health Professions.2022; 19: 33. CrossRef
Applying the Bookmark method to medical education: Standard setting for an aseptic technique station
Monica L. Lypson, Steven M. Downing, Larry D. Gruppen, Rachel Yudkowsky
Medical Teacher.2013; 35(7): 581. CrossRef
Standard Setting in Student Assessment: Is a Defensible Method Yet to Come?
A Barman
Annals of the Academy of Medicine, Singapore.2008; 37(11): 957. CrossRef

Previous issues