Journal of Educational Evaluation for Health Professions

Research articles

Similarity of the cut score in test sets with different item amounts using the modified Angoff, modified Ebel, and Hofstee standard-setting methods for the Korean Medical Licensing Examination: Janghee Park, Mi Kyoung Yim, Na Jin Kim, Duck Sun Ahn, Young-Min Kim; J Educ Eval Health Prof. 2020;17:28. Published online October 5, 2020; DOI: https://doi.org/10.3352/jeehp.2020.17.28

6,131 View
188 Download
7 Web of Science
6 Crossref

Purpose
The Korea Medical Licensing Exam (KMLE) typically contains a large number of items. The purpose of this study was to investigate whether there is a difference in the cut score between evaluating all items of the exam and evaluating only some items when conducting standard-setting.
Methods
We divided the item sets that appeared on 3 recent KMLEs for the past 3 years into 4 subsets of each year of 25% each based on their item content categories, discrimination index, and difficulty index. The entire panel of 15 members assessed all the items (360 items, 100%) of the year 2017. In split-half set 1, each item set contained 184 (51%) items of year 2018 and each set from split-half set 2 contained 182 (51%) items of the year 2019 using the same method. We used the modified Angoff, modified Ebel, and Hofstee methods in the standard-setting process.
Results
Less than a 1% cut score difference was observed when the same method was used to stratify item subsets containing 25%, 51%, or 100% of the entire set. When rating fewer items, higher rater reliability was observed.
Conclusion
When the entire item set was divided into equivalent subsets, assessing the exam using a portion of the item set (90 out of 360 items) yielded similar cut scores to those derived using the entire item set. There was a higher correlation between panelists’ individual assessments and the overall assessments.

Citations

Citations to this article as recorded by

Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers
Sun Huh
Journal of Educational Evaluation for Health Professions.2022; 19: 2. CrossRef
Possibility of using the yes/no Angoff method as a substitute for the percent Angoff method for estimating the cutoff score of the Korean Medical Licensing Examination: a simulation study
Janghee Park
Journal of Educational Evaluation for Health Professions.2022; 19: 23. CrossRef
Equal Z standard-setting method to estimate the minimum number of panelists for a medical school’s objective structured clinical examination in Taiwan: a simulation study
Ying-Ying Yang, Pin-Hsiang Huang, Ling-Yu Yang, Chia-Chang Huang, Chih-Wei Liu, Shiau-Shian Huang, Chen-Huan Chen, Fa-Yauh Lee, Shou-Yen Kao, Boaz Shulruf
Journal of Educational Evaluation for Health Professions.2022; 19: 27. CrossRef
Possibility of independent use of the yes/no Angoff and Hofstee methods for the standard setting of the Korean Medical Licensing Examination written test: a descriptive study
Do-Hwan Kim, Ye Ji Kang, Hoon-Ki Park
Journal of Educational Evaluation for Health Professions.2022; 19: 33. CrossRef
Presidential address: Quarantine guidelines to protect examinees from coronavirus disease 2019, clinical skills examination for dental licensing, and computer-based testing for medical, dental, and oriental medicine licensing
Yoon-Seong Lee
Journal of Educational Evaluation for Health Professions.2021; 18: 1. CrossRef
Comparing the cut score for the borderline group method and borderline regression method with norm-referenced standard setting in an objective structured clinical examination in medical school in Korea
Song Yi Park, Sang-Hwa Lee, Min-Jeong Kim, Ki-Hwan Ji, Ji Ho Ryu
Journal of Educational Evaluation for Health Professions.2021; 18: 25. CrossRef

Linear programming method to construct equated item sets for the implementation of periodical computer-based testing for the Korean Medical Licensing Examination: Dong Gi Seo, Myeong Gi Kim, Na Hui Kim, Hye Sook Shin, Hyun Jung Kim; J Educ Eval Health Prof. 2018;15:26. Published online October 18, 2018; DOI: https://doi.org/10.3352/jeehp.2018.15.26

20,580 View
278 Download
2 Web of Science
2 Crossref

Abstract PDF Supplementary Material

Purpose
This study aimed to identify the best way of developing equivalent item sets and to propose a stable and effective management plan for periodical licensing examinations.
Methods
Five pre-equated item sets were developed based on the predicted correct answer rate of each item using linear programming. These pre-equated item sets were compared to the ones that were developed with a random item selection method based on the actual correct answer rate (ACAR) and difficulty from item response theory (IRT). The results with and without common items were also compared in the same way. ACAR and the IRT difficulty were used to determine whether there was a significant difference between the pre-equating conditions.
Results
There was a statistically significant difference in IRT difficulty among the results from different pre-equated conditions. The predicted correct answer rate was divided using 2 or 3 difficulty categories, and the ACAR and IRT difficulty parameters of the 5 item sets were equally constructed. Comparing the item set conditions with and without common items, including common items did not make a significant contribution to the equating of the 5 item sets.
Conclusion
This study suggested that the linear programming method is applicable to construct equated-item sets that reflect each content area. The suggested best method to construct equated item sets is to divide the predicted correct answer rate using 2 or 3 difficulty categories, regardless of common items. If pre-equated item sets are required to construct a test based on the actual data, several methods should be considered by simulation studies to determine which is optimal before administering a real test.

Citations

Citations to this article as recorded by

Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers
Sun Huh
Journal of Educational Evaluation for Health Professions.2022; 19: 2. CrossRef
Reading Comprehension Tests for Children: Test Equating and Specific Age-Interval Reports
Patrícia Silva Lúcio, Fausto Coutinho Lourenço, Hugo Cogo-Moreira, Deborah Bandalos, Carolina Alves Ferreira de Carvalho, Adriana de Souza Batista Kida, Clara Regina Brandão de Ávila
Frontiers in Psychology.2021;[Epub] CrossRef

Technical report

Item development process and analysis of 50 case-based items for implementation on the Korean Nursing Licensing Examination: In Sook Park, Yeon Ok Suh, Hae Sook Park, So Young Kang, Kwang Sung Kim, Gyung Hee Kim, Yeon-Hee Choi, Hyun-Ju Kim; J Educ Eval Health Prof. 2017;14:20. Published online September 11, 2017; DOI: https://doi.org/10.3352/jeehp.2017.14.20

31,635 View
262 Download
3 Web of Science
4 Crossref

Abstract PDF

Purpose
The purpose of this study was to improve the quality of items on the Korean Nursing Licensing Examination by developing and evaluating case-based items that reflect integrated nursing knowledge.
Methods
We conducted a cross-sectional observational study to develop new case-based items. The methods for developing test items included expert workshops, brainstorming, and verification of content validity. After a mock examination of undergraduate nursing students using the newly developed case-based items, we evaluated the appropriateness of the items through classical test theory and item response theory.
Results
A total of 50 case-based items were developed for the mock examination, and content validity was evaluated. The question items integrated 34 discrete elements of integrated nursing knowledge. The mock examination was taken by 741 baccalaureate students in their fourth year of study at 13 universities. Their average score on the mock examination was 57.4, and the examination showed a reliability of 0.40. According to classical test theory, the average level of item difficulty of the items was 57.4% (80%–100% for 12 items; 60%–80% for 13 items; and less than 60% for 25 items). The mean discrimination index was 0.19, and was above 0.30 for 11 items and 0.20 to 0.29 for 15 items. According to item response theory, the item discrimination parameter (in the logistic model) was none for 10 items (0.00), very low for 20 items (0.01 to 0.34), low for 12 items (0.35 to 0.64), moderate for 6 items (0.65 to 1.34), high for 1 item (1.35 to 1.69), and very high for 1 item (above 1.70). The item difficulty was very easy for 24 items (below −2.0), easy for 8 items (−2.0 to −0.5), medium for 6 items (−0.5 to 0.5), hard for 3 items (0.5 to 2.0), and very hard for 9 items (2.0 or above). The goodness-of-fit test in terms of the 2-parameter item response model between the range of 2.0 to 0.5 revealed that 12 items had an ideal correct answer rate.
Conclusion
We surmised that the low reliability of the mock examination was influenced by the timing of the test for the examinees and the inappropriate difficulty of the items. Our study suggested a methodology for the development of future case-based items for the Korean Nursing Licensing Examination.

Citations

Citations to this article as recorded by

Suggestion for item allocation to 8 nursing activity categories of the Korean Nursing Licensing Examination: a survey-based descriptive study
Kyunghee Kim, So Young Kang, Younhee Kang, Youngran Kweon, Hyunjung Kim, Youngshin Song, Juyeon Cho, Mi-Young Choi, Hyun Su Lee
Journal of Educational Evaluation for Health Professions.2023; 20: 18. CrossRef
Automating assessment of Design exams: A case study of novelty evaluation
Nandita Bhanja Chaudhuri, Debayan Dhar, Pradeep G. Yammiyavar
Expert Systems with Applications.2021; : 116108. CrossRef
Levels, antecedents, and consequences of critical thinking among clinical nurses: a quantitative literature review
Yongmi Lee, Younjae Oh
Journal of Educational Evaluation for Health Professions.2020; 17: 26. CrossRef
Factors Influencing the Success of the National Nursing Competency Examination taken by the Nursing Diploma Students in Yogyakarta
Yulia Wardani
Jurnal Ners.2020; 14(2): 172. CrossRef

History Article

Medical licensing examination (uigwa) and the world of the physician officers (uigwan) in Korea’s Joseon Dynasty: Nam Hee Lee; J Educ Eval Health Prof. 2015;12:16. Published online May 7, 2015; DOI: https://doi.org/10.3352/jeehp.2015.12.16

30,178 View
177 Download
2 Web of Science
3 Crossref

Abstract PDF

Physicians for ordinary people in Joseon Dynasty (1392-1910) do not need to pass national medical licensing examination. They had done their job after enough period of apprenticeship. Only physician officers were licensed as technical civil servants. These physician officers were middle class, located socially between the nobility and the commoner. They had to pass a national licensing examination to be considered for high-ranking physician officers, that is, those at the rank above the 6th level out of a total of 9 ranks, where the first rank was highest. Royal physicians also had to pass this examination before accepting responsibility for the King’s healthcare. This article aims to describe the world of Physician officers during the Joseon Dynasty. Physician officers enjoyed considerable social status because they dealt with matters of life and death. Owing to the professional nature of their fields and a strong sense of group identity they came to compose a distinct social class. The physician officers’ world was marked by strong group allegiances based on shared professional knowledge; the use of marriage to gain and maintain social status; and the establishment of hereditary technical posts within the medical profession that were handed down from one generation to the next. The medical licensing examination persisted until 1894 when the civil service examination agency, of which it was part, was abolished. Until that time, the testing agency, the number of candidates who were accepted, two-step test procedures, and the method of test item selection were maintained and enforced. These aspects of the test could be considered characteristic of the medical licensing examination.

Citations

Citations to this article as recorded by

Heo Jun: physician of the people
Hyuk Joon Kwon
Journal of Community Hospital Internal Medicine Perspectives.2021; 11(1): 53. CrossRef
Suturing the Nation in South Korean Historical Television Medical Dramas
Kai Khiun Liew
Journal of Medical Humanities.2020; 41(2): 193. CrossRef
LİYAKAT TEMELLİ BÜROKRASİ: KORE KAMU SINAVLARI (GWAGEO) (958-1894) - THE MERIT-BASED BUREAUCRACY: THE CIVIL SERVICE EXAMINATION (GWAGEO) IN KOREA (958-1894)
Murat KAÇER
Mehmet Akif Ersoy Üniversitesi Sosyal Bilimler Enstitüsü Dergisi.2018; 10(26): 754. CrossRef

Technical Reports

North Korean defectors seeking health certification to take the national medical licensing examination in the Republic of Korea: figures and procedures: Yoon Hee Kim; J Educ Eval Health Prof. 2012;9:12. Published online December 1, 2012; DOI: https://doi.org/10.3352/jeehp.2012.9.12

47,658 View
169 Download
5 Crossref

Abstract PDF

In May 2011, the Ministry of Unification of the Republic of Korea (Korea) announced that 21,165 defectors from Democratic People's Republic of Korea (North Korea) had settled in Korea. Since healthcare workers are counted among these defectors, it is necessary to provide them with a pathway to certification to work in Korea. This report summarizes the vetting and approval process defectors from North Korea must pass through to be eligible to take the national medical licensing examination. Defectors must pass an oral test conducted by the National Health Personnel Licensing Examination Board to be eligible to sit for the exam. From 2002 to August 2011, 41 North Korean defectors applied for the approval process to take the exam. Twenty-nine were approved (70.7%): 23 physicians, 1 dentist, 2 oriental medical doctor, 1 nurse, and 2 pharmacists. Out of 29 approved, 11 passed the licensing examination (39.3%). This report also highlights the difficulty in assessing North Korean defectors' eligibility by oral test, and suggests that adequate competency should be emphasized to recognize their unique abilities as healthcare personnel.

Citations

Citations to this article as recorded by

Challenges Experienced By North Korean Refugee Doctors in Acquiring a Medical License in South Korea: A Qualitative Analysis
Shin Ha, Hui Ran Choi, Jong Koo Lee, Yo Han Lee
Journal of Continuing Education in the Health Professions.2019; 39(2): 112. CrossRef
Exploration of examinees’ traits that affect the score of Korean Medical Licensing Examination
Mi Kyoung Yim
Journal of Educational Evaluation for Health Professions.2015; 12: 5. CrossRef
Plan on establishment of post-unification North Korean medical safety net
Young-Jeon Shin
Journal of the Korean Medical Association.2013; 56(5): 394. CrossRef
Can a medical regulatory system be implemented in Korea?
Sun Huh, Myung-Hyun Chung
Journal of the Korean Medical Association.2013; 56(3): 158. CrossRef
The integration process of North Korean defector physicians into the South Korean medical system
Jae-Phil Choi
Journal of the Korean Medical Association.2013; 56(5): 383. CrossRef

Introduction and Administration of the Clinical Skill Test of the Medical Licensing Examination, Republic of Korea (2009): Kun Sang Kim; J Educ Eval Health Prof. 2010;7:4. Published online December 3, 2010; DOI: https://doi.org/10.3352/jeehp.2010.7.4

52,732 View
216 Download
14 Crossref

Abstract PDF

The first trial of the clinical skill test as part of the Korean Medical Licensing Examination was done from September 23 to December 1, 2009, in the clinical skill test center located in the National Health Personnel Licensing Examination Board (NHPLEB) building, Seoul. Korea is the first country to introduce the clinical skill test as part of the medical licensing examination in Asia. It is a report on the introduction and administration of the test. The NHPLEB launched researches on the validity of introducing the clinical skill test and on the best implementation methods in 2000. Since 2006, lists of subjects of test items for the clinical skill test has been developed. The test consisted of two types of evaluation, i.e., a clinical performance examination (CPX) with a standardized patient (SP) and objective structured clinical examination (OSCE). The proctor (medical faculty member) and SP rate the examinees??proficiency for the OSCE and CPX respectively. Out of 3,456 applicants, 3,289 examinees (95.2%) passed the test. Out of 167 examinees who failed the clinical skill test, 142 passed the written test. This means that the clinical skill test showed characteristics independent from the written test. This successful implementation of the clinical skill test is going to improve the medical graduates??performance of clinical skills.

Citations

Citations to this article as recorded by

Presidential address: improving item validity and adopting computer-based testing, clinical skills assessments, artificial intelligence, and virtual reality in health professions licensing examinations in Korea
Hyunjoo Pai
Journal of Educational Evaluation for Health Professions.2023; 20: 8. CrossRef
Implementation strategy for introducing a clinical skills examination to the Korean Oriental Medicine Licensing Examination: a mixed-method modified Delphi study
Chan-Young Kwon, Sanghoon Lee, Min Hwangbo, Chungsik Cho, Sangwoo Shin, Dong-Hyeon Kim, Aram Jeong, Hye-Yoon Lee
Journal of Educational Evaluation for Health Professions.2023; 20: 23. CrossRef
Authenticity, acceptability, and feasibility of a hybrid gynecology station for the Papanicolaou test as part of a clinical skills examination in Korea
Ji-Hyun Seo, Younglim Oh, Sunju Im, Do-Kyong Kim, Hyun-Hee Kong, HyeRin Roh
Journal of Educational Evaluation for Health Professions.2018; 15: 4. CrossRef
A one-day surgical-skill training course for medical students’ improved surgical skills and increased interest in surgery as a career
Ho Seok Seo, Yong Hwa Eom, Min Ki Kim, Young-Min Kim, Byung Joo Song, Kyo Young Song
BMC Medical Education.2017;[Epub] CrossRef
Presidential address: launching the Korea Health Personnel Licensing Examination Institute, a government-supported special foundation from December 23, 2015
Chang Hwi Kim
Journal of Educational Evaluation for Health Professions.2016; 13: 20. CrossRef
Reforms of the Korean Medical Licensing Examination regarding item development and performance evaluation
Mi Kyoung Yim
Journal of Educational Evaluation for Health Professions.2015; 12: 6. CrossRef
Educational intervention as an effective step for reducing blood culture contamination: a prospective cohort study
W.B. Park, S.J. Myung, M.-d. Oh, J. Lee, N.-J. Kim, E.-C. Kim, J.S. Park
Journal of Hospital Infection.2015; 91(2): 111. CrossRef
Impact of Clinical Performance Examination on Incoming Interns' Clinical Competency in Differential Diagnosis of Headache
Seong-Min Park, Yun-Mi Song, Bo-Kyoung Kim, Hyoeun Kim
Korean Journal of Family Medicine.2014; 35(2): 56. CrossRef
Can a medical regulatory system be implemented in Korea?
Sun Huh, Myung-Hyun Chung
Journal of the Korean Medical Association.2013; 56(3): 158. CrossRef
Power of the policy: how the announcement of high-stakes clinical examination altered OSCE implementation at institutional level
Chi-Wei Lin, Tsuen-Chiuan Tsai, Cheuk-Kwan Sun, Der-Fang Chen, Keh-Min Liu
BMC Medical Education.2013;[Epub] CrossRef
Can computerized tests be introduced to the Korean Medical Licensing Examination?
Sun Huh
Journal of the Korean Medical Association.2012; 55(2): 124. CrossRef
How can high stakes examination in Korean medical society be improved to the international level?
Sun Huh
Journal of the Korean Medical Association.2012; 55(2): 114. CrossRef
The impact of introducing the Korean Medical Licensing Examination clinical skills assessment on medical education
Hoon-Ki Park
Journal of the Korean Medical Association.2012; 55(2): 116. CrossRef
Failed Examinees' Legal Challenge over the Clinical Skill Test in the Korean Medical Licensing Examination
Sun Huh
Journal of Educational Evaluation for Health Professions.2010; 7: 5. CrossRef

Research Articles

Proposal of the Implementation of an International Pharmacy Graduate Preliminary Examination: Kyenghee Kwon, Jeoung Hill Park, Jinwoong Kim, Seung Ki Lee; J Educ Eval Health Prof. 2008;5:2. Published online December 22, 2008; DOI: https://doi.org/10.3352/jeehp.2008.5.2

29,336 View
128 Download
3 Crossref

Abstract PDF

At present, graduates of international pharmacy schools can apply to take the Korean Pharmacist Licensing Examination after passing a review by the Accreditation Board of the Pharmacy Schools and Licenses. However, since the educational content of different schools and the roles of pharmacists differ from country to country, a preliminary examination might be necessary before the Pharmacist Licensing Examination. To prepare to implement a preliminary examination for foreign pharmacy graduates in Korea, we summarized the preliminary examinations used in four other countries and presented a proposal for a preliminary examination. Data were collected via the internet and through telephone interviews with appropriate persons. The proposal was revised after a public forum. There are preliminary examinations in the USA, Canada, Australia, and the United Kingdom, and these involve written, oral, practice, and English proficiency tests. We proposed that the Korean preliminary examination consist of a written test on basic pharmacy, a test in the Korean language, and an interview. The preliminary examination should include suitable items that effectively evaluate international graduates. Graduates of international pharmacy schools who have an ability equivalent to graduates of Korean pharmacy schools should be eligible to write the Korean Licensing Examination.

Citations

Citations to this article as recorded by

Palestinian pharmacists’ knowledge of issues related to using psychotropic medications in older people: a cross-sectional study
Ramzi Shawahna, Mais Khaskiyyi, Hadeel Abdo, Yasmen Msarwe, Rania Odeh, Souad Salame
Journal of Educational Evaluation for Health Professions.2017; 14: 8. CrossRef
Can a medical regulatory system be implemented in Korea?
Sun Huh, Myung-Hyun Chung
Journal of the Korean Medical Association.2013; 56(3): 158. CrossRef
Career Perspectives of Future Graduates of the Newly Implemented 6-year Pharmacy Educational System in South Korea
Eunyoung Kim, Saurav Ghimire
American Journal of Pharmaceutical Education.2013; 77(2): 37. CrossRef

Revised Subjects of the Current Korean Oriental Pharmacists' Licensing Examination: Jong-Pil Lim, Seon-Pyo Hong, Young-Mi Lee, Hoon Jeon; J Educ Eval Health Prof. 2007;4:4. Published online December 20, 2007; DOI: https://doi.org/10.3352/jeehp.2007.4.4

28,504 View
153 Download

Abstract PDF: This study is designed to draw out new integrated subjects of the Korean Oriental Pharmacists??Licensing Examination (KOPLE). In 2004, for the revision of subjects, we have analyzed the curriculums of the Oriental Pharmacy department, the oriental pharmacist?占퐏 (OP?占퐏) job description book, and the elementary items of KOPLE. We also examined the system of the Chinese Herb Pharmacists??Examination and other health personnel licensing examinations and studied the data of items and compared them with KOPLE. We heard the public opinion on the present KOPLE. We developed a subfield of 18 subjects, a middle category of 188 items, and a small category of 1,026 items. We proposed a new KOPLE that consists of three subjects: basic oriental pharmacy, applied oriental pharmacy, and laws and regulations.

Test Equating of the Medical Licensing Examination in 2003 and 2004 Based on the Item Response Theory: Mi Kyoung Yim, Sun Huh; J Educ Eval Health Prof. 2006;3:2. Published online July 31, 2006; DOI: https://doi.org/10.3352/jeehp.2006.3.2

30,143 View
134 Download
2 Crossref

Abstract PDF

The passing rate of the Medical Licensing Examination has been variable, which probably originated from the difference in the difficulty of items and/or difference in the ability level of examinees. We tried to explain the origin of the difference using the test equating method based on the item response theory. The number of items and examinees were 500, 3,647 in 2003 and 550, 3,879 in 2004. Common item nonequivalent group design was used for 30 common items. Item and ability parameters were calculated by three parametric logistic models using ICL. Scale transformation and true score equating were executed using ST and PIE. The mean of difficulty index of the year 2003 was ??.957 (SD 2.628) and that of 2004 after equating was ??.456 (SD 3.399). The mean of discrimination index of year 2003 was 0.487 (SD 0.242) and that of 2004 was 0.363 (SD 0.193). The mean of ability parameter of year 2003 was 0.00617 (SD 0.96605) and that of year 2004 was 0.94636 (SD 1.32960). The difference of the equated true score at the same ability level was high at the range of score of 200??50. The reason for the difference in passing rates over two consecutive years was due to the fact that the Examination in 2004 was easier and the abilities of the examinees in 2004 were higher. In addition, the passing rates of examinees with score of 270??94 in 2003, and those with 322??43 in 2004, were affected by the examination year.

Citations

Citations to this article as recorded by

Comparison of proficiency in an anesthesiology course across distinct medical student cohorts: Psychometric approaches to test equating
Shu-Wei Liao, Kuang-Yi Chang, Chien-Kun Ting, Mei-Yung Tsou, En-Tzu Chen, Kwok-Hon Chan, Wen-Kuei Chang
Journal of the Chinese Medical Association.2014; 77(3): 150. CrossRef
Can computerized tests be introduced to the Korean Medical Licensing Examination?
Sun Huh
Journal of the Korean Medical Association.2012; 55(2): 124. CrossRef

Original Articles

Construct Validity of the Korean Dental Licensing Examination using Confirmatory Factor Analysis: Mi Kyoung Yim, Yoon Hee Kim; J Educ Eval Health Prof. 2005;2(1):75-86. Published online June 30, 2005; DOI: https://doi.org/10.3352/jeehp.2005.2.1.75

34,507 View
161 Download

Abstract PDF: Confirmatory factor analysis based on a measurement model of a structural equation model was used to test the construct validity of 13 subjects in the Korean Dental Licensing Examination (KDLE). The results of 1,086 examinees who wrote the KDLE in 2004 were analyzed. The thirteen subjects were classified into 62 major categories and 122 intermediate categories. There were 364 items. A hierarchical model was constructed, including major and intermediate categories. The impact of the variables was determined by the standardized regression coefficient that related latent and measured variables in the measurement model. The KDLE showed a high goodness-of-fit with a root mean square error of approximation of 0.030 and a non-normed fit index of 0.998. When the latent variables for the major and intermediate categories were analyzed, the standardized regression coefficients of all of the subjects, with the exception of Health and Medical Legislation, were significant. From the result, we concluded that the 13 subjects showed constructive validity. In addition, the study model and data were very compatible. The subject Health and Medical Legislation had a low explanatory impact with respect to testing the ability of dentists to perform their jobs. This study suggests that similar psychometric studies are needed before integrating or deleting subjects on the KDLE, and to improve item development.

Dental Hygienist Job Analysis for Item Development for the Korean Dental Hygienists' Licensing Examination: Sook Hyang Kim, Kyung Hee Song, Hyeon Sook Kwun, Seol Aak Kim, Jong Hwa Jang, Chang Hee Kim, Min Jung Kim, Jin Soo Kim, Sang Hwan Oh; J Educ Eval Health Prof. 2005;2(1):59-74. Published online June 30, 2005; DOI: https://doi.org/10.3352/jeehp.2005.2.1.59

65,535 View
150 Download
2 Crossref

Abstract PDF

This study aimed to develop standard items for the Korean Dental Hygienists' Licensing Examination; these items were also earmarked for use in developing the curriculum for dental hygienists, and in writing a job description, based on a job analysis using the Developing A Curriculum Method (DACUM). It also aimed to understand the significance and frequency of task elements that dental hygienists perform. Data were collected by means of a mail survey, in the form of self-entry, from a sample of dental hygienists registered with the Korean Dental Hygienists' Association. In all, 260 responses were analyzed. The tasks of dental hygienists were divided into four categories, 93 tasks, and 494 task elements. There were 281 elements (61%) that scored higher than 3.5 in significance, in the 4-scale items, and 480 elements (98%) that scored higher than 3.0. There were 30 elements (6%) that scored higher than 3.5 in frequency, and 140 elements (29%) that scored higher than 3.0 in frequency. Overall, 130 out of 494 elements (27%) scored higher than 3.0 for both significance and frequency. Therefore, those 130 elements should be included as items in the Korean Dental Hygienists' Licensing Examination. The results can also be used for curriculum development and as the basis of a job description for dental hygienists.

Citations

Citations to this article as recorded by

Performance of ChatGPT on the Korean National Examination for Dental Hygienists
Soo-Myoung Bae, Hye-Rim Jeon, Gyoung-Nam Kim, Seon-Hui Kwak, Hyo-Jin Lee
Journal of Dental Hygiene Science.2024; 24(1): 62. CrossRef
The Dental Hygienists’ Perception of the National Practical Examination
Da-Kyung Ko, Sung-Suk Bae
Journal of Dental Hygiene Science.2016; 16(6): 488. CrossRef

The Validity of Subjects in Korean Dental Technicians' Licensing Examination: Woong-chul Kim, Won-chul Lee, Young-seok Sohn, Sae-yoon Oh, Bu-sob Kim, Chin-ho Yu, Ji-hwan Kim; J Educ Eval Health Prof. 2005;2(1):43-57. Published online June 30, 2005; DOI: https://doi.org/10.3352/jeehp.2005.2.1.43

26,278 View
150 Download
4 Crossref

Abstract PDF

This study prepared a basic framework for the development and improvement of Korean Dental Technicians' Licensing Examination, based on actual test questions. A peer review was conducted to ensure relevance to current practices in dental technology. For the statistical analysis, 1000 dental laboratory technicians were selected; specialists in dental laboratory technology (laboratory owners, educators, etc.) were involved in creating valid and reliable questions. Results indicated that examination subjects should be divided into three categories: basic dental laboratory theory, dental laboratory specialties, and a practical examination. To ensure relevance to current practice, there should be less emphasis on basic dental laboratory theory, including health-related laws, and more emphasis on dental laboratory specialties. Introduction to dental anatomy should be separated from oral anatomy and tooth morphology; and fixed prosthodontics should be separated from crown and bridge technology and dental ceramics technology. Removable orthodontic appliance technology should be renamed 'orthodontic laboratory technology'. There should be less questions related to health related law, oral anatomy, dental hygiene, dental materials science and inlay, while the distribution ratio of questions related to tooth morphology should be maintained. There should be a decrease in the distribution ratio of questions related to crown and bridge technology, dental ceramics technology, complete dentures and removable partial dentures technology, and orthodontic laboratory technology. In the practical examination, the current multiple choice test should be replaced with tooth carving using wax or plaster. In dental laboratory specialties, subjects related to contemporary dental laboratory technology should be included in the test items.

Citations

Citations to this article as recorded by

A study of the opening status of the compulsory courses for the dental technologist license
Soon-Suk Kwon
Journal of Korean Acedemy of Dental Technology.2021; 43(3): 106. CrossRef
A study on the reorganization of the curriculum for produce of field-oriented dental technicians
Kim Jae-Hong, Kim Ki-Baek, Kim Won-Soo
Journal of Korean Acedemy of Dental Technology.2019; 41(4): 359. CrossRef
The Study on the improvement of dental technician practical examination II
Eun-Jeong Bae, Ki-Baek Kim, Woong-Chul Kim, Ji-Hwan Kim, Chin-Ho Yu, Gyu-Sun Lee
Journal of Korean Acedemy of Dental Technology.2014; 36(1): 39. CrossRef
The Study on the improvement of dental technician practical examination I
Eun-Jeong Bae, Woong-Chul Kim, In-Sung Chung, Sang-Yong Nam, Ji-Hwan Kim
Journal of Korean Acedemy of Dental Technology.2012; 34(4): 413. CrossRef

A study of the validity of the Korean Nurses' Licensing Examination: Hyang Yeon Lee, Cho Ja Kim, Sook Ja Lee, Ho Ran Park, In Sook Lee, Hoo Ja Kim, Young Mi Park; J Educ Eval Health Prof. 2005;2(1):31-42. Published online June 30, 2005; DOI: https://doi.org/10.3352/jeehp.2005.2.1.31

32,099 View
183 Download
5 Crossref

Abstract PDF

This study tested the validity of subjects in the Korean Nurses' Licensing Examination (KNLE). To determine the validity of test items in the KNLE, the items testing each subject in the examination and all of the test items were compared. The homogeneity and proper degree of conceptual diversity of the items in the examination were tested by comparing the frameworks of the test items in the National Council Licensure Examination for Registered Nurses (NCLEX-RN) and the KNLE. The validity of the KNLE was determined by examining the correlations between the scores that the same individuals obtained on the KNLE in 2002 and their college marks. This study showed that basic core items appeared repeatedly in the KNLE, and items in the examination were selected according to the importance of each subject examined. Therefore, a new test system based on united subjects should be considered to solve these problems. Further studies are needed to develop a framework for classifying the test items that should be included as united subjects through considering the job description and goals of study of nurses.

Citations

Citations to this article as recorded by

Item development process and analysis of 50 case-based items for implementation on the Korean Nursing Licensing Examination
In Sook Park, Yeon Ok Suh, Hae Sook Park, So Young Kang, Kwang Sung Kim, Gyung Hee Kim, Yeon-Hee Choi, Hyun-Ju Kim
Journal of Educational Evaluation for Health Professions.2017; 14: 20. CrossRef
Relevance of the test content of the Korean Nursing Licensing Examination to nursing job
In Sook Park, Yeon Ok Suh, Hae Sook Park, Soo Yeon Ahn, So Young Kang, Kwang Sung Kim
Journal of Educational Evaluation for Health Professions.2016; 13: 23. CrossRef
The Relevance between Pathophysiological Subject and Examination Workbook Items for National Nurse Licensure Examination in South Korea and the United States
Myung Sook Park, Hee Jung Choi, Youn Jung Kim, Hee Kyung Chang, Sun Ju Chang, Haeyoung Lee
Journal of Korean Biological Nursing Science.2016; 18(4): 264. CrossRef
A Six-Year Study of Relationship between Academic Performance in Dental Hygiene School and Performance on the Korean Dental Hygiene Licensing Examination at Yonsei University
So-Jung Mun, Hie-Jin Noh, Hyun-Sun Jeon, Ji-Eun Heo, Won-Gyun Chung
Journal of dental hygiene science.2014; 14(3): 332. CrossRef
A Comparative Study of the Nurse Licensure Exam Systems between the United States and South Korea
Chanyeong Kwak, Soon-Nyoung Yun, Shin-Jeong Kim
Korean Journal of Adult Nursing.2013; 25(6): 622. CrossRef

Correlations between the scores of computerized adaptive testing, paper and pencil tests, and the Korean Medical Licensing Examination: Mee Young Kim, Yoon Hwan Lee, Sun Huh; J Educ Eval Health Prof. 2005;2(1):113-118. Published online June 30, 2005; DOI: https://doi.org/10.3352/jeehp.2005.2.1.113

42,509 View
162 Download
3 Crossref

Abstract PDF

To evaluate the usefulness of computerized adaptive testing (CAT) in medical school, the General Examination for senior medical students was administered as a paper and pencil test (P&P) and using CAT. The General Examination is a graduate examination, which is also a preliminary examination for the Korean Medical Licensing Examination (KMLE). The correlations between the results of the CAT and P&P and KMLE were analyzed. The correlation between the CAT and P&P was 0.8013 (p=0.000); that between the CAT and P&P was 0.7861 (p=0.000); and that between the CAT and KMLE was 0.6436 (p=0.000). Six out of 12 students with an ability estimate below 0.52 failed the KMLE. The results showed that CAT could replace P&P in medical school. The ability of CAT to predict whether students would pass the KMLE was 0.5 when the criterion of the theta value was set at -0.52 that was chosen arbitrarily for the prediction of pass or failure.

Citations

Citations to this article as recorded by

Analysis on Validity and Academic Competency of Mock Test for Korean Medicine National Licensing Examination Using Item Response Theory
Han Chae, Eunbyul Cho, SeonKyoung Kim, DaHye Choi, Seul Lee
Keimyung Medical Journal.2023; 42(1): 7. CrossRef
Application of Computerized Adaptive Testing in Medical Education
Sun Huh
Korean Journal of Medical Education.2009; 21(2): 97. CrossRef
Estimation of an Examinee's Ability in the Web-Based Computerized Adaptive Testing Program IRT-CAT
Yoon-Hwan Lee, Jung-Ho Park, In-Yong Park
Journal of Educational Evaluation for Health Professions.2006; 3: 4. CrossRef

A score of trial examination is closely correlated with a score of Korean Medical Licensing Examination 2002: Myoung Soo Kim, Chun-Bae Kim, Byung Ho Cha, Ki Chang Park, Sang Ok Kwon, Kye Chul Shin, Hae Yong Lee, Seong Joon Kang, Bong Suk Cha; J Educ Eval Health Prof. 2004;1(1):87-98. Published online January 31, 2004; DOI: https://doi.org/10.3352/jeehp.2004.1.1.87

31,719 View
154 Download
3 Crossref

Abstract PDF

Korean Medical Licensing Examination(KMLE) 2002 focused on evaluation of the integrative medical knowledge such as primary clinical care or problem-solving competence. We analyzed the correlation among the year-wise student academic scores(grade score), trial examination scores and KMLE score by correlation analysis and multiple regression method. Four times of trial examination were taken in 2001, which were composed according to the principles of KMLE. Trial examination scores were significantly correlated with student grade scores (p<0.05). KMLE score also correlated with student grade score a nd trial examination score. The grade score at senior had higher correlation coefficient than the grade score at junior in correlation analysis. In multiple regressions, grade score at senior and mean score of trial examinatio n score were significant variants affecting KMLE score. Based on this result, regression formula such as [KMLE score] = 110.596 + 21.449*[6th grade score of student] + 0.577*[mean of trial examination score] was established (R2=0.764, p<0.001). Our results show that the trial examination is useful evaluation tool for final assessment of medical achievements. Also a trial examination is used as a reference data for student guidance and control in preparing for KMLE.

Citations

Citations to this article as recorded by

North Korean refugee doctors' preliminary examination scores
Sung Uk Chae, Jeong Hee Yang, Joon Seop Hyun, June Hee Kim, Seok Hoon Kang
Korean Journal of Medical Education.2016; 28(4): 373. CrossRef
A Six-Year Study of Relationship between Academic Performance in Dental Hygiene School and Performance on the Korean Dental Hygiene Licensing Examination at Yonsei University
So-Jung Mun, Hie-Jin Noh, Hyun-Sun Jeon, Ji-Eun Heo, Won-Gyun Chung
Journal of dental hygiene science.2014; 14(3): 332. CrossRef
The Relationship between Senior Year Examinations at a Medical School and the Korean Medical Licensing Examination
Ki Hoon Jung, Ho Keun Jung, Kwan Lee
Korean Journal of Medical Education.2009; 21(1): 17. CrossRef

First
Prev
Page of 2
Next
Last

Search