Introduction

In Morocco, physicians who graduate from medical schools enroll in residency programs that involve 3 to 5 years of training [1]. Thereafter, medical residents who complete residency training are certified as specialists. No previous studies in the literature have aimed to assess Moroccan residents’ perceptions of their educational environment. The clinical learning environment is an influential factor in work-based learning. This environment encompasses many important aspects, such as the quality of supervision, the quality of teachers, the facilities, and the atmosphere. Evaluation of the clinical learning environment may provide insights into the educational functioning of clinical departments. The Postgraduate Hospital Educational Environment Measure (PHEEM) is a 40-item inventory developed by Roff et al. [2] that covers a range of topics directly relevant to the educational climate of junior doctors; it has been reported to have high face validity both in the United Kingdom and in other international settings [3,4]. This inventory measures students’ perceptions of 3 domains (autonomy, teaching, and social support) during the hospital-based training period. The objectives of the present study were to assess the educational environment of residents in Morocco with the PHEEM and to compare perceptions of the educational environment among residents according to their specialty.

Methods

Ethics statement

The Rabat Ethics Committee for Biomedical Research, University Mohammed V, Faculty of Medicine (Rabat, Morocco) approved the protocol and consent procedure (IORG0006594). Written informed consent was obtained from the residents who participated.

Study design

This was a cross-sectional survey study, in which the measurement tool was the French version of the PHEEM.

Participants

In Rabat, there are 10 university hospitals that provide postgraduate training for 41 specialties, including 4-year residency training for medical specialties and 5-year training for surgical specialties. We included residents from 6 hospitals (Avicenne Hospital, Children’s Hospital of Rabat, Specialties Hospital, Maternity Hospital of Souissi, the National Oncology Institute, and the Dentistry University Center) from the first to the last year of residency over a period of 6 months from January to June 2017. Four hospitals were excluded: Errazi Hospital and Al Ayachi Hospital because they are not located in the city of Rabat, and Maternity Hospital of Orangers and Moulay Youssef Hospital because the residents at those hospitals do not receive obligatory clinical training. The total sample size required to be representative of the residents at hospitals in the city of Rabat for factor analysis of a 40-item instrument was calculated using G*Power (Heinrich-Heine-Universität Düsseldorf, Düsseldorf, Germany; http://www.gpower.hhu.de/). A sample size of 216 residents corresponded to a power of 80% at the 5% significance level when comparing PHEEM scores across 6 specialties using 1-way analysis of variance (ANOVA) to detect a medium effect size (Cohen’s d=0.25).

Procedure

The questionnaire was distributed by the first author to residents at the hospitals during the study period. All residents in the relevant departments were informed of the study and invited to participate.

Measure

For use of the French version of the PHEEM [5], permission was received from the translator and the original author [2]. Residents were asked to read each statement carefully and respond to all 40 items using a 5-point Likert scale ranging from ‘strongly disagree’ to ‘strongly agree’ to ‘strongly disagree’ (0, strongly disagree; 1, disagree; 2, uncertain; 3, agree; 4, strongly agree). Four items (numbers 7, 8, 11, and 13) were negative statements that were scored in reverse order. Any items with a mean score of 2 or less should be examined closely, as scores of 2 or lower indicate problem areas [2]. The PHEEM has 3 subscales measuring perceptions of role autonomy (containing 14 items with a maximum score of 56), teaching (containing 15 items with a maximum score of 60), and social support (containing 11 items with a maximum score of 44). Information on age, sex, specialty, residency level, and training hospital were also included as part of the questionnaire. The 40-item PHEEM has a maximum score of 160, which indicates an ideal educational environment as perceived by the respondents [2]. A global score of 0–40 indicates a very poor educational environment; 41–80 indicates plenty of problems; 81–120 indicates more positive than negative, with room for improvement; and 121–160 indicates an excellent environment.

Statistical analysis

The internal reliability of the overall questionnaire and the 3 subscales was assessed using Cronbach’s α coefficient. By calculating the α coefficient if individual items were deleted, Cronbach’s α was used to identify questions, the exclusion of which would improve the reliability of the tool. We applied factor analysis to investigate the internal structure of the PHEEM and the construct validity of the original 3 subscales. Principal component analysis was used for factor extraction. Varimax rotation was applied and factor loadings above 0.4 were interpreted. Descriptive statistics were used to summarize the survey respondents’ characteristics. Qualitative variables were presented as number and percentages. Quantitative variables were presented as mean±standard deviation for variables with a normal distribution, and as median and interquartile range for variables with skewed distributions. ANOVA was performed to compare total scores, subscale scores, and scores for each item among the residents of the 6 specialties. The threshold for statistical significance was set at P<0.05, and 95% confidence intervals were used. All statistical analyses were performed using SPSS ver. 13.0 for Windows (SPSS Inc., Chicago, IL, USA).

Results

Descriptive statistics

In total, 305 questionnaires were distributed. Thirteen residents chose not to participate and 37 questionnaires had missing responses, yielding a response rate of 83.6%. The characteristics of the study respondents are summarized in Table 1. Fig. 1 shows a box plot of the PHEEM overall scores in different specialties. The mean score for each item, each subscale, and the overall PHEEM score are presented in Table 2 (Dataset 1).

Internal consistency

The 40-item PHEEM questionnaire showed good reliability, with a Cronbach’s α of 0.91. Cronbach’s α values for the 3 subscales of the PHEEM are summarized in Supplement 1.

Factor analysis

Principal component analysis of all 40 items (Supplement 2) suggested the presence of 3 or 4 factors, as indicated by inflexion points on the scree plot (Fig. 2), or 10 factors using the criterion of an eigenvalue >1 (accounting for 82.3% of the variance). Varimax rotation identified 35 items (out of 40) that were allocated to 3 factors. Factor 1 explained 30% of the variance and comprised the majority (11 out of 17) of the items that originally belonged to the teaching subscale, 4 items from the autonomy subscale, and 2 items from the social support subscale. Factor 2 explained 10% of the variance and included items from the autonomy subscale (6 out of 14), 5 items from the social support subscale, and 3 items from the teaching subscale. Factor 3 included 2 items from the autonomy subscale and 2 items from the social support subscale and explained 8% of the variance.

Comparison of residents’ perceptions of their educational environment according to their specialty

We calculated the mean scores for each item, the overall questionnaire, and its subscales, and then compared these scores among 6 groups of residents with different specialties (Table 2). Significant differences were found in the overall and subscale scores among the 6 groups of residents. The residents in laboratory specialties perceived their learning environment more positively than the rest of the residents, particularly the residents in surgical specialties and obstetrics and gynecology. The Moroccan residents in laboratory specialties and anesthesiology and critical care had more positive perceptions of their jobs than the residents of other specialties. The Moroccan residents felt that teaching was moving in the right direction, with a significant difference between the laboratory specialties and the surgical specialties and obstetrics and gynecology. Social support was perceived as “not a pleasant place,” with a significant difference between the pediatrics residents compared to the medical and surgical residents. Table 2 presents the relevant items that accounted for differences among the 6 groups of residents. In the autonomy subscale, the items accounting for the differences were related to the lack of an informative induction program and a handbook for junior doctors, the requirement to perform inappropriate tasks with an inappropriate level of responsibility, and the lack of clear protocols and opportunities to acquire expertise in the appropriate practical procedures. In the teaching subscale, the items accounting for the differences were related to the lack of enthusiastic and organized clinical teachers providing good clinical supervision, feedback, and access to a relevant educational program. In the social support subscale, the items accounting for the differences were related to the presence of racism and sex discrimination, the lack of a “no-blame culture,” inadequate catering facilities and physical safety, failure to obtain ample enjoyment from work, and a lack of good counseling opportunities.

Discussion

Key results

In the present study, we evaluated the French version of the PHEEM as a tool to measure the clinical learning environment of Moroccan residents of university hospitals in Rabat. The French version of the PHEEM questionnaire was validated by the present study for the Moroccan learning environment, which is characterized by a high disease burden in a resource-limited country [6]. The PHEEM, which was validated among Moroccan residents recruited from 6 hospitals in this study, has also been used to evaluate the educational environment among residents by other studies in both its original and translated versions [2-5,7]. In the present study, Moroccan residents perceived their educational environment as more positive than negative, but with room for improvement. The PHEEM questionnaire showed high internal consistency, with a Cronbach’s α of 0.91 for all 40 questions, which is similar to the value reported by Roff et al. [2], suggesting that the PHEEM is a suitable multidimensional instrument to measure the educational climate for doctors in training [3]. The PHEEM subscales showed good reliability, especially the education subscale, as has been reported in previous studies [8]. Indeed, confirmatory factor analysis identified 3 factors. The first factor mostly included items from the perception of teaching subscale. The second factor contained a higher proportion of items from the autonomy subscale. The third factor contained items that were correlated poorly with social support. Thus, even if the French version of the PHEEM validated within the Moroccan context is a multidimensional instrument, the PHEEM subscales are not correlated perfectly, especially for social support. A similar finding was reported in a previous study [8].

Interpretation

The lowest recorded scores were related to the following social support subscale items: “This hospital has good quality accommodation for junior doctors, especially when on call,” “There are adequate catering facilities when I am on call,” and “I feel physically safe within the hospital environment.” These findings highlight the first set of concerns in the Moroccan learning environment, which are related to poor catering and accommodation, phenomena that reflect the lack of efficient management in our context. Moreover, about the half of the residents perceived sex discrimination. This could be explained by the high proportion of female students attending medical schools. Furthermore, more than half of the Moroccan residents felt the lack of good counseling opportunities for junior doctors who fail to complete their training satisfactorily and the absence of a “no-blame culture.” Although the highest scores in the teaching subscale were recorded for the items “My clinical teachers have good teaching skills,” “My clinical teachers are accessible,” and “My clinical teachers encourage me to be an independent learner,” the Moroccan residents perceived some items in this subscale as a problem area, highlighting the second challenge, which is related to the quality of supervision and teaching, particularly among residents of surgical specialties. There is a lack of dedicated educational time, which ultimately defines the role of teachers in practice, affecting a broad range of factors such as the educational program, its organization, learning opportunities, their ability to provide regular feedback, and their feedback on residents’ strengths and weaknesses. Surgical specialties and obstetrics and gynecology have shown lower PHEEM scores among residents in international studies, particularly in the teaching and social support domains. Senior faculty must enhance the quality of supervision and assessment to improve the educational climate of residencies in Morocco, particularly in surgical specialties. The third concern was related to the autonomy subscale, with particular problems including inappropriate tasks and level of responsibility and the lack of information on hours of work, clear clinical protocols, and an informative induction program. In light of the finding of a significant correlation between the educational environment and burnout syndrome among residents in Argentina [9], the above environmental factors may also cause burnout in Moroccan residents. Clear regulations should be applied to define the tasks and responsibility of residents and hours of work, and standardized protocols are required to safeguard the safety of residents and patients. Through this study, we were able to pinpoint specific weaknesses in the educational environment of Moroccan hospitals. However, more specific studies among residents in specific specialties and complementary studies concerning senior faculty members’ perceptions of the learning environment are necessary to identify obstacles that should be explored to create an optimal climate for medical training in Morocco.

Comparison with previous studies

Moroccan residents perceived their learning environment as more positive than negative, but with room for improvement, like most postgraduate physicians in other countries [10-12]. However residents of surgical specialties and obstetrics and gynecology perceived their educational environment as having “plenty of problems,” especially in the social support and the teaching domains, as reported by similar studies in African and Middle East countries [13-15]. Items related to social support were negatively perceived by Moroccan residents; in particular, the catering facilities, physical safety, and gender discrimination were highlighted as issues to be addressed, as in previous studies in resource-poor and resource-limited countries [10,11,13]. The quality of teaching and supervision has been a source of controversy in the literature, as some studies reported the highest scores for teaching and working together [11], but in most countries, the items on the teaching subscale presented a challenge [13,15]. The deficiencies in the teaching domain reported by the present study included a lack of protected educational time, access to suitable learning opportunities, and constructive feedback and career guidance, and similar challenges have been reported in other international evaluations of the educational climate in both resource-rich and resource-limited countries [11-13]. The nature of the tasks performed, the initial induction program, and clarity of protocols have been identified as challenging issues for improvement in the autonomy subscale, both in Morocco and in other international settings [10-13].

Limitations

The present study evaluated residents’ perceptions of their educational environment at 6 hospitals, with a high response rate and a representative sample size. However, this study was conducted in a single city, making it difficult to extrapolate these results to the entire Kingdom of Morocco. Therefore, a similar multi-center study is necessary to obtain a broader perspective on the educational environment of Moroccan residents.

Conclusion

The French version of the PHEEM was confirmed to be a valid and reliable instrument to evaluate the learning environment at university hospital centers in Rabat. Moroccan residents perceived their educational environment as more positive than negative, but with room for improvement. Particularly important challenges included poor infrastructure, inadequate quality of supervision and teaching, and inadequate work regulations.

Article information

Authors’ contributions

Conceptualization: HB, AT, RA. Data curation: HB. Formal analysis: HB, RA. Methodology: HB, RA. Writing–original draft: HB. Writing–review & editing: HB, RA, AT.

Conflict of interest

No potential conflict of interest relevant to this article was reported.

Funding

None.

Data availability

Data files are available from https://doi.org/10.7910/DVN/MSPVKH

Dataset 1. Data file and data dictionary.

jeehp-17-04-dataset1.xlsx

Acknowledgments

Supplementary materials

Fig. 1.

Box plot of overall PHEEM scores in different specialties. PHEEM, Postgraduate Hospital Educational Environment Measure.

Fig. 2.

Scree plot of the eigenvalues of the factors’ reliability in principal component analysis.

References

• 1. Faculty of Medicine and pharmacy of Fez. Residency: program and exam modalities [Internet]. Fès: Faculté de Médecine et de pharmacie de Fès; [cited 2020 Jan 10]. Available from: http://ww2.fmp-usmba.ac.ma/residanat-conditions-modalites-du-concours/.
• 2. Roff S, McAleer S, Skinner A. Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK. Med Teach 2005;27:326-331. ArticlePubMed
• 3. Chan CY, Sum MY, Lim WS, Chew NW, Samarasekera DD, Sim K. Adoption and correlates of Postgraduate Hospital Educational Environment Measure (PHEEM) in the evaluation of learning environments: a systematic review. Med Teach 2016;38:1248-1255. https://doi.org/10.1080/0142159x.2016.1210108 ArticlePubMed
• 4. Cordova-Leon K, Fernandez-Huerta L, Rojas-Vargas M. Perception of clinical educational environment by student of physiotherapy based on the Educational Environment Measurement Questionnaire of the Postgraduate Hospital in Chile. J Educ Eval Health Prof 2019;16:16. https://doi.org/10.3352/jeehp.2019.16.16 ArticlePubMedPMCPDF
• 5. Caron F, Pina A, Mahone M, Costa JP, Sansregret A, Durand M. Assessing the Postgraduate Educational Environment: translation and validation of a questionnaire assessing the educational environment. Pedagog Med 2014;15:91-98. https://doi.org/10.1051/pmed/2014012 Article
• 6. World Health Organization. Country cooperation strategy at a glace: Morocco [Internet]. Geneva: World Health Organization; 2018 [cited 2019 Nov 20]. Available from: https://apps.who.int/iris/bitstream/handle/10665/136949/ccsbrief_mar_en.pdf;sequence=1.
• 7. Koutsogiannou P, Dimoliatis ID, Mavridis D, Bellos S, Karathanos V, Jelastopulu E. Validation of the Postgraduate Hospital Educational Environment Measure (PHEEM) in a sample of 731 Greek residents. BMC Res Notes 2015;8:734. https://doi.org/10.1186/s13104-015-1720-9 ArticlePubMedPMC
• 8. Binsaleh S, Babaeer A, Alkhayal A, Madbouly K. Evaluation of the learning environment of urology residency training using the postgraduate hospital educational environment measure inventory. Adv Med Educ Pract 2015;6:271-277. https://doi.org/10.2147/AMEP.S81133 ArticlePubMedPMC
• 9. Llera J, Durante E. Correlation between the educational environment and burn-out syndrome in residency programs at a university hospital. Arch Argent Pediatr 2014;112:6-11. https://doi.org/10.1590/S0325-00752014000100003 ArticlePubMed
• 10. BuAli WH, Khan AS, Al-Qahtani MH, Aldossary S. Evaluation of hospital-learning environment for pediatric residency in eastern region of Saudi Arabia. J Educ Eval Health Prof 2015;12:14. https://doi.org/10.3352/jeehp.2015.12.14 ArticlePubMedPMCPDF
• 11. Gough J, Bullen M, Donath S. PHEEM ‘downunder’. Med Teach 2010;32:161-163. https://doi.org/10.3109/01421590903509036 ArticlePubMed
• 12. Flaherty GT, Connolly R, O'Brien T. Measurement of the postgraduate educational environment of junior doctors training in medicine at an Irish university teaching hospital. Ir J Med Sci 2016;185:565-571. https://doi.org/10.1007/s11845-015-1303-8 ArticlePubMedPDF
• 13. Naidoo KL, Van Wyk JM, Adhikari M. The learning environment of paediatric interns in South Africa. BMC Med Educ 2017;17:235. https://doi.org/10.1186/s12909-017-1080-3 ArticlePubMedPMCPDF
• 14. Khoja AT. Evaluation of the educational environment of the Saudi family medicine residency training program. J Family Community Med 2015;22:49-56. https://doi.org/10.4103/2230-8229.149591 ArticlePubMedPMC
• 15. Bigotte Vieira M, Godinho P, Gaibino N, Dias R, Sousa A, Madanelo I, Ribeiro-Mourao F, Brandao M, Duarte S, Meirinhos T, Catarino AL, Espirito Santo C, Caiado R, Marques R, Goncalves Ferreira A, Ramalheira C, Valente Jorge J, Losada M, Santos M, Oliveira E, Farias JP, Silva JM. Medical residency’ satisfaction in Portugal. Acta Med Port 2016;29:839-853. https://doi.org/10.20344/amp.8406 ArticlePubMed

Figure & Data

References

Citations

Citations to this article as recorded by  

• Ambiente educacional y bienestar mental de los residentes de posgrados médicos y quirúrgicos en Medellín, Colombia
  María Adelaida Posada Uribe, Verónica Vargas González, Clara Orrego Morales, Carolina Cataño, Elsa María Vásquez, Diana Restrepo
  Revista Colombiana de Psiquiatría.2021;[Epub]     CrossRef
• Depression and its associated factors: perceived stress, social support, substance use and related sociodemographic risk factors in medical school residents in Nairobi, Kenya
  Sayed Shah Nur Hussein Shah, Ahmed Laving, Violet Caroline Okech-Helu, Manasi Kumar
  BMC Psychiatry.2021;[Epub]     CrossRef