Skip Navigation
Skip to contents

JEEHP : Journal of Educational Evaluation for Health Professions

OPEN ACCESS
SEARCH
Search

Author index

Page Path
HOME > Browse articles > Author index
Search
Karly Pippitt 1 Article
Developing a situational judgment test blueprint for assessing the non-cognitive skills of applicants to the University of Utah School of Medicine, the United States  
Jorie M. Colbert-Getz, Karly Pippitt, Benjamin Chan
J Educ Eval Health Prof. 2015;12:51.   Published online October 31, 2015
DOI: https://doi.org/10.3352/jeehp.2015.12.51
  • 31,615 View
  • 221 Download
  • 9 Web of Science
  • 5 Crossref
AbstractAbstract PDF
Purpose
The situational judgment test (SJT) shows promise for assessing the non-cognitive skills of medical school applicants, but has only been used in Europe. Since the admissions processes and education levels of applicants to medical school are different in the United States and in Europe, it is necessary to obtain validity evidence of the SJT based on a sample of United States applicants. Methods: Ninety SJT items were developed and Kane’s validity framework was used to create a test blueprint. A total of 489 applicants selected for assessment/interview day at the University of Utah School of Medicine during the 2014-2015 admissions cycle completed one of five SJTs, which assessed professionalism, coping with pressure, communication, patient focus, and teamwork. Item difficulty, each item’s discrimination index, internal consistency, and the categorization of items by two experts were used to create the test blueprint. Results: The majority of item scores were within an acceptable range of difficulty, as measured by the difficulty index (0.50-0.85) and had fair to good discrimination. However, internal consistency was low for each domain, and 63% of items appeared to assess multiple domains. The concordance of categorization between the two educational experts ranged from 24% to 76% across the five domains. Conclusion: The results of this study will help medical school admissions departments determine how to begin constructing a SJT. Further testing with a more representative sample is needed to determine if the SJT is a useful assessment tool for measuring the non-cognitive skills of medical school applicants.

Citations

Citations to this article as recorded by  
  • New Advances in Physician Assistant Admissions: The History of Situational Judgement Tests and the Development of CASPer
    Shalon R. Buchs, M. Jane McDaniel
    Journal of Physician Assistant Education.2021; 32(2): 87.     CrossRef
  • The association between Situational Judgement Test (SJT) scores and professionalism concerns in undergraduate medical education
    Gurvinder S. Sahota, Jaspal S. Taggar
    Medical Teacher.2020; 42(8): 937.     CrossRef
  • Exploring Behavioral Competencies for Effective Medical Practice in Nigeria
    Adanna Chukwuma, Uche Obi, Ifunanya Agu, Chinyere Mbachu
    Journal of Medical Education and Curricular Development.2020; 7: 238212052097823.     CrossRef
  • Situational judgment test validity: an exploratory model of the participant response process using cognitive and think-aloud interviews
    Michael D. Wolcott, Nikki G. Lobczowski, Jacqueline M. Zeeman, Jacqueline E. McLaughlin
    BMC Medical Education.2020;[Epub]     CrossRef
  • Computerized test versus personal interview as admission methods for graduate nursing studies: A retrospective cohort study
    Koren Hazut, Pnina Romem, Smadar Malkin, Ilana Livshiz‐Riven
    Nursing & Health Sciences.2016; 18(4): 503.     CrossRef

JEEHP : Journal of Educational Evaluation for Health Professions
TOP