Does emotional intelligence influence success during medical school admissions and program matriculation?: a systematic review
Article information
Abstract
Purpose
It aimed at determining whether emotional intelligence is a predictor for success in a medical school program and whether the emotional intelligence construct correlated with other markers for admission into medical school.
Methods
Three databases (PubMed, CINAHL, and ERIC) were searched up to and including July 2016, using relevant terms. Studies written in English were selected if they included emotional intelligence as a predictor for success in medical school, markers of success such as examination scores and grade point average and association with success defined through traditional medical school admission criteria and failures, and details about the sample. Data extraction included the study authors and year, population description, emotional intelligence I tool, outcome variables, and results. Associations between emotional intelligence scores and reported data were extracted and recorded.
Results
Six manuscripts were included. Overall, study quality was high. Four of the manuscripts examined emotional intelligence as a predictor for success while in medical school. Three of these four studies supported a weak positive relationship between emotional intelligence scores and success during matriculation. Two of manuscripts examined the relationship of emotional intelligence to medical school admissions. There were no significant relevant correlations between emotional intelligence and medical school admission selection.
Conclusion
Emotional intelligence was correlated with some, but not all, measures of success during medical school matriculation and none of the measures associated with medical school admissions. Variability in success measures across studies likely explains the variable findings.
Introduction
Processes involved with medical admissions commonly evaluate applicants based on cognitive and non-cognitive factors [1], with a majority associated with cognitive-intelligence factors. Because physicians often evaluate patient emotion and behavior when creating a treatment plan, having a high degree of emotional intelligence may assist future physicians in patient care. Emotional intelligence is defined as “the ability to perceive emotions, to access and generate emotions so as to assist thought, to understand emotions and emotional knowledge, and to reflectively regulate emotions so as to promote emotional and intellectual growth” [2]. To our knowledge, there are no systematic reviews that have explored the predictive capacity of emotional intelligence for success in being admitted and during matriculation of medical school. The purpose of this study was to determine whether emotional intelligence is a predictor for success in a medical school program and whether the emotional intelligence construct correlated with other markers for admission into medical school.
Methods
Study design
This systematic review used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [3]. The PRISMA guidelines are commonly used for multiple forms of research methodologies [4]. The authors also worked with a biomedical librarian on all search processes.
Eligibility criteria
Inclusion criteria required the following items: first, a study that explicitly examined emotional intelligence as a predictor for success during matriculation in medical school; second, markers of success that were defined by written examination scores, continuous assessments, final examinations, weighted grade point average (wGPA), and association with success defined through traditional medical school admission criteria and failures; third, details provided about the sample including demographics, etc.; and fourth, published in English. Excluded papers were those that were examined a single construct of emotional intelligence (e.g., empathy).
Information sources
Three databases were used during the search strategy: PubMed, Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Education Resources Information Center (ERIC). All three were searched from their establishment to July 2016.
Search
Search terms used in the systematic review were (MH “school admissions+”) AND (MH “emotional intelligence”) in CINAHL, “School admission criteria” [MeSH terms] OR “medical school” [all fields] AND “emotional intelligence” [MeSH terms] in PubMed, and Admission criteria and emotional intelligence in ERIC. Key terms used in each search included: school admissions, medical school, emotional intelligence, and admission criteria. The search was designed to be sensitive, and not specific, since emotional intelligence is recent terminology within the medical search engines.
Study selection
One author (CJC) performed a title screen and abstract review in PubMed. Two authors (CJC and CEC) then completed full-text reads to determine appropriateness for inclusion of each article, with a 100% consensus. The same screening process was repeated in CINAHL and ERIC, with duplicate articles removed when found. One author (CEC) also performed a hand search of references from the included papers.
Data collection process
One author (CJC) read each of the studies for associations between emotional intelligence scores and the measured success subjects experienced in medical school, along with associations between emotional intelligence and traditional selection measures. This author extracted the relevant data, noting the statistical relationships to emotional intelligence.
Data items-emotional intelligence measures
The study included any papers with explicit mechanisms to evaluate emotional intelligence in self-report format. We considered the measures of Mayer-Salovey-Caruso Emotional intelligence Test (MSCEIT) [5], Situational Test of Emotional Understanding (STEU) [6], Situational Test of Emotion Management (STEM) [6], and the Emotional Intelligence Inventory (EQ-I) [7] as qualifying emotional intelligence measures. The MSCEIT is an ability-based test created to measure the four branches of the emotional intelligence model that was developed by Mayer et al. [5] and consists of 141 items and takes 30–45 minutes to complete, providing 15 main scores: total emotional intelligence score, two area scores, four branch scores, and eight task scores [5]. The STEU is a test developed by MacCann and Roberts [6] that examines emotional understanding, a key component of emotional intelligence. The test-taker is required to choose which five emotions is most likely to result from an emotional situation in each item. STEM, a test also developed by MacCann and Roberts [6], assesses emotion management, the capacity of individuals to regulate their emotions by reducing negative feelings and enhancing positive ones. Subjects are given a situation then must choose from four strategies to apply to improve emotions and manage the problem. EQ-I [7] was developed to assess the Bar-On model of emotional-social intelligence. This test is a self-report measure designed to examine a number of constructs related to emotional intelligence, consisting of 133 items and taking approximately 30 minutes to complete.
Data items-outcomes measures
We accepted medical school success measures such as written examination scores, continuous program-based assessments, final examinations, wGPA, and failures such as failing grades and dropouts. With respect to medical school admission assessments, we accepted scores on interviews, Undergraduate Medicine and Health Sciences Admission (UMAT) scores, Tertiary Entrance Rank (TER), wGPA, and autobiographical test scores. UMAT is an admissions test that was developed by the Australian Council for Educational Research and used to assist with selection of students into the medicine, dentistry and health science degree programs at undergraduate level. The TER was a tertiary entrance score used as a tool for selection to universities in Australia that was replaced by the Australian Tertiary Admission Rank in 2010, in all territories except Queensland. The wGPA is a grade point average that takes into account the difficulty of classes and increases accordingly. Autobiographical scores could include materials such as personal statements, essays, and letters.
Risk of bias in individual studies
Methodological quality was assessed by one author (CJC) using the Newcastle-Ottawa Scale [8] for assessing the quality of nonrandomized studies in meta-analyses. A ‘star system’ is used through which a study is judged based on three broad perspectives: the selection of the study groups; the comparability of the groups; and the method of achieving the outcome of interest for cohort studies (Appendix 1).
Risk of bias across studies
Risk of bias across studies was evaluated by examining grey literature, conference proceeding, and other environments to identify research on emotional intelligence and medical admissions that had not been formally published.
Strength of association parameters
Strength of association measures included any acceptable correlation coefficient (measure used depended on the data used), which represents the strength of the presumed linear association between the variables in question, and ranges from −1 to +1 [9]. A correlation coefficient of zero indicates that no linear relationship exists between two tested variables, whereas a value closer to +1 suggests a positive correlation and a value of -1 suggests a negative correlation.
Ethical approval
This study was exempt from the local institutional human ethics review board of both institutions.
Results
Study selection
In total, 1,332 articles were initially identified through database search of PubMed, CINAHL, and ERIC. A hand search also resulted in seven articles. Once duplicates were removed, a total of 1,336 articles remained. After title screening and abstract review, 26 articles were pulled and reviewed in full. The final search yielded six manuscripts [10,11,12,13,14,15], analyzing emotional intelligence as a predictor for success in medical school or as a predictor for medical school admissions [16] (Fig. 1).
Study characteristics
Total population across all studies was found to be 1,859 (range, 51 to 659). Three of the studies [10,11,12] were longitudinal and three were cross-sectional [13,14,15]. The medical students who participated in the studies included undergraduate medical students (i.e., Australia), graduate medical students, and those applying to and then matriculating into medical school. Success in medical school was defined in these studies by clinical competency assessments, bio-medical knowledge based assessments, scores on written examinations, objective structures clinical examinations (OSCEs), the number of nominations for excellence in clinical performance, number of failures, interpersonal academic performance, intellectual academic performance, tests of cognitive ability, continuous assessments, and final examinations (Table 1).
There were four tools used to measure emotional intelligence. These tools included: the MSCEIT [11,12,13,14,15]; EQ-I [11]; the STEU and the STEM [10]. Emotional intelligence was compared as a predictor to success to the UMAT [13], interview, TER scores [13], and other traditional measures such as wGPA and autobiographical sketch scores.
Risk of bias within studies
The second question of the Newcastle-Ottawa Scale was excluded as it was not applicable to the design of the studies. Because of the way in which emotional intelligence is measured, the ascertainment of emotional intelligence scores among all studies were considered written self-reports. Most studies lacked controls, with the exception of one in which nonresponse bias was controlled for by having applicants respond as part of their medical school curriculum. Further trends included a lack of adequate follow-up in all but one study; however, minimal follow-up was still long enough for outcomes to occur. All but one study assessed the outcomes through record linkage. Outcomes of interest (success in medical school or a correlation between emotional intelligence and traditional measures of acceptance) appeared not to be present at the start of any studies. All studies were similar in their results of risk of bias assessment (Table 2).
Synthesized results of studies-success while matriculated
Four studies [10,11,12,14] examined emotional intelligence as a predictor for success in medical school. One study was cross-sectional [14], the remaining were longitudinal [10,11,12]. Chew et al. [14] found that students who were more emotionally intelligent tended to perform better in both the continuous assessments (r=0.24, P=0.003) and the final professional examination (r=0.21, P=0.01). Libbrecht et al. [10] found that emotional intelligence correlated positively with interpersonal academic performance (r=0.21, P<0.001). Humphrey-Murto et al. [12] found no significant correlations when evaluating associations between scores on the MSCEIT and written examination scores for interview and matriculated studies in two cohorts but did find a statistically significant positive correlation between the year 4-total OSCE score and the MSCEIT score (r=0.35, P<0.001). A final study [11] found that at first assessment EQ-I scores were negatively associated with performance on the clinical competency modules (r=-0.38, P<0.01). At a second assessment, an association between EQ-I scores and poor performance on the clinical competency module were found once again [11] (Table 1).
Synthesized results of studies-medical school admission
Two studies [13,15] examined traditional medical school admissions criteria and how it related to emotional intelligence; both studies were cross-sectional. One study found no significant correlations between emotional intelligence total and any of the selection scores for the first cohort [13]. The second study found a lack of substantial relationships between emotional intelligence scores and traditional medical school admission measures [15].
Risk of bias across studies
There were no instances in which grey literature was found, suggesting no publication bias. There were also no instances of selective reporting among accepted studies.
Discussion
The aim of this study is to gather all data about emotional intelligence as a predictor for success in medical school or admissions into medical school. Key findings were as follows: first, three of the four studies [10,12,14] appear to support a weak positive relationship between emotional intelligence and academic performance upon matriculation into a program; second, one study [11] that reported a weak negative relationship between emotional intelligence scores and success during matriculation; and third, no relationship between emotional intelligence measures and admissions criteria used in medical school selection. We posit that there are a number of reasons that the evidence is mixed.
As a whole, measures of success varied markedly across studies. While some studies based success on hard scores received from commonly used methods (written tests), others were more subjective or were based on professional development criteria. This subjectivity in the measures of success could be the cause for why no relationship was found between emotional intelligence and indicators for success in the respective studies. Other differences among studies included study populations make up and size, graduate status, locations, and assessment time (cross sectional and longitudinal).
As stated, three of four papers [10,12,14] found statistically significant relationships between emotional intelligence and academic success while matriculated into the program. However, the strengths of the associations were small, often close to zero, suggesting a weak linear relationship. Further, most studies used multiple measures with only a few finding statistical significance. Nearly all studies used simple associational statistical analyses and finding statistical significance with large samples, despite weak relationships is a known conundrum [17]. Interestingly, some scores were significant only at given timeframes throughout the longitudinal testing dates despite using similar measures of success.
When measures of success for admissions were evaluated we found no statistically significant associations [13,15]. Admissions measures included wGPA, which was calculated using the three most recent years of full-time undergraduate studies and autobiographical sketch scores. Interview scores were found when the applicants underwent independent interviews [15]. Emotional intelligence was also compared against the TER and the UMAT. The TER is the sum of the four highest courses of study scores obtained at the end of high school. Researchers suggest that TER is the strongest predictor for success in early medical school, though not as strong in predicting workplace success.
One concern about measuring emotional intelligence is the limitations associated with the tool itself. Almost every study used the MSCEIT as a measure for emotional intelligence. While having a consistent way to measure emotional intelligence is beneficial, the test itself is based on the self-reporting of the participants, which in situations that subjects are aware that they are being evaluated, can lead to self-reporting biases. Because all emotional intelligence scores are derived by self-report of the participants in the study, their respective emotional intelligence scores may not entirely be accurate representations of the participant’s true emotional intelligence. Furthermore, because the study relies on its participants to respond on their own volition, nonresponse bias can occur. Only one study succeeded in a 100% response rate, due to the study being interwoven as part of a requirement for the curriculum of the medical students [10].
After synthesizing the evidence as presented, we are skeptical that the current tools adequately capture the complex construct associated with emotional intelligence. Since the value of measuring this construct is to identify those who will be successful within an academic medical program or after graduation from a medical program, we would argue that the tools do not exclusively meet this assumption. In particular, we suggest the following inadequacies deserve attention: first, emotional intelligence is typically measured as a stand-alone construct and it likely interacts with multiple other measures of success; second, the current methods used to capture emotional intelligence may allow one to artificially elevate their scoring; thus reducing a potential effect of this construct; and third, the success criteria used was markedly different across studies, leading to notable variability in measurements across studies so that future research studies should include uniform accepted criteria to reduce variability.
This study was limited to English only journals and we were limited in synthesizing the data since the success and predictor (emotional intelligence) variables were markedly different among studies. Furthermore, population differences suggest that compiling findings is unwarranted. Much more work is necessary before incorporating or dismissing the current tools. Future studies should use accepted criteria for success and explore interactions with other markers of success.
Notes
Conflict of interest
No potential conflict of interest relevant to this article was reported.
Acknowledgements
The authors would like to acknowledge the research deputy at Kashan University of medical sciences for their support.