Evaluation of the Learning Environment for Diploma in Family Medicine with the Dundee Ready Education Environment (DREEM) Inventory

A. Sattar Khan; Zekeriya Akturk; Tarek Al-Megbil

doi:10.3352/jeehp.2010.7.2

Articles

Page Path: HOME > J Educ Eval Health Prof > Volume 7; 2010 > Article

Brief Report Evaluation of the Learning Environment for Diploma in Family Medicine with the Dundee Ready Education Environment (DREEM) Inventory: A. Sattar Khan^*, Zekeriya Akturk, Tarek Al-Megbil; DOI: https://doi.org/10.3352/jeehp.2010.7.2
Published online: November 29, 2010

Centre for Postgraduate Studies in Family Medicine, Riyadh, Saudi Arabia

*Corresponding email: drsattarkhan@gmail.com

• Received: August 5, 2010 • Accepted: November 19, 2010

This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

prev next

35,825 Views
190 Download
13 Crossref

Full Article

Download PDF

Abstract
References

Abstract

The primary healthcare system is at a turning point in Saudi Arabia. However, the sustainability of family medicine as the core element of that system is increasingly being called into question because of lack of family physicians. In keeping view this problem; a postgraduate diploma program in family medicine has started in 2008. A validated measure of educational environment i.e., Dundee Ready Education Environment (DREEM) questionnaire consisting of 50 questions having five domains of perception was administered to all 13 trainees of the diploma course at the completion of the program to check their perception about learning evironment. The trainees comprised of 4 males (40%) and 6 females (60%). The overall score showed more positive than negative side (147/200). There is no significant difference (P > 0.05) in the mean scores of five different domains of perception. The subclasses of five domains showed that teaching perceived as positive by 50%, moving towards right direction by 80%, feeling more positive by 50%, positive attitude by 80% and the 70% scored the course as not too bad. The overall high score and positive attitude towards the course assures the better teaching environment. However, there are areas to improve and it requires continuous evaluation.
Keywords: Dundee Ready Education Environment; Postgraduate Studies; Family Medicine; Teaching Environment

The learning environment has its own impact on behavior of learning and a good environment enhances the ability of learning. The importance is recognized by learners and teachers. Students’ perception of the environment within which they study has been shown to have a significant impact on their behavior, academic progress and sense of well-being [1]. Nevertheless different methodologies have been applied to investigate educational environment. Among them, the recent one includes qualitative approaches [2] or the use of questionnaires [3]. However, of these, only the Dundee Ready Educational Environment Measure (DREEM) questionnaire [4] is more focused to the environment experienced by students on medical and healthcare-related courses. This tool was build up by an international Delphi panel, and has been applied to a number of undergraduate courses for health professionals worldwide. The inventory was validated by over 1,000 students world-wide and is now being used widely in order to measure and ‘diagnose’ undergraduate educational climates in the health professions, having been translated into Spanish, Portuguese, Arabic, Swedish, Norwegian, Malay and Thai and used in several settings including the Middle East [5]. It is currently being used in the UK, Canada, Ireland, Thailand, Indonesia, Malaysia, Norway, Sweden, Venezuela, Brazil, the West Indies, Sri Lanka, Oman and the Yemen.

The Ministry of Health in Saudi Arabia at centre for postgraduate studies in Family Medicine has started first time a diploma program in family medicine. It is a comprehensive 14-month’s program covering all aspects of family medicine. Initially 13-students have been enrolled and completed their studies in year 2009. In this cross sectional pilot study, all students were asked to fill the DREEM inventory; however three did not submit their questionnaires. The DREEM inventory questionnaire includes of 50 items [5], each scored 0–4 on a 5-point scale. The statements which are negative considered in reverse order, so that high scores on these items indicate disagreement will become a positive result. This questionnaire produces an overall “score” for the course and results were analyzed with Chi Square and the Mann-Whitney U test. The overall statements may also be subdivided to provide different student perceptions in the groups of 5 different aspects [6] of the educational environment:

Perceptions of learning
Perceptions of teachers
Academic self-perception
Perceptions of atmosphere
Social self-perceptions

The results revealed that median age of the male participants was 25.50 years (4 males) and female participants was 33 years (6 females). The perception analysis shows that 50% students perceived teaching as negative whereas 80% agreed that they are moving in a right direction (Table 1). Academic self perception shows more satisfaction as 50% feeling more on positive side. The overall perception was good. Not a single perception was scored below the 2 mean values. The overall median DREEM score was 118.5/200 (59.25%) (Table 2). There is no significant difference (P > 0.05) in the mean scores of five different domains of perception. The Table 3 highlights the rating of the students responses on 50-items individually.

So far this is the first study to report results from the complete postgraduate cohort of a diploma program for family medicine. The DREEM questionnaire has provided an overview of student opinion throughout the study period (14-months) and allowed areas of concern to be highlighted. Analysis of the identified concerns will form the basis of strategic planning in order to institute remedial action, and on which to focus institutional resources. The study shows that the perception of teachers is better than the other dimensions. One reason for this might be that the diploma program in our setting is rather new and hence, the facilities are not settled yet. However, a study at the well-settled college of medicine in King Saud University found a similar result [7], which could indicate that there are other factors beyond facilities. The overall median score being at around 60% is another indication that there is some area to improve. A study in West Mislands revealed mean DREEM scores of 70% of the total [8]. DREEM global score of a Nigerian medical school was reported as 118/200 and that of a Nepalese health professions institution was reported as 130/200 [9]. DREEM global score of the faculty of medical sciences in Trinidad was reported as 109.9 [10]. Mayya and Roff [11] reported global scores of 107.44/200 in an Indian medical school and Varma [7] reported scores of 139/200 in undergraduate schools. When compared with these figures our results demonstrate that the SDFM evaluations ranks somewhere around the average in the literature. Item-wise ratings of the two questions suggest that most aspects of the climate could be enhanced. Students in general are more critical about the quality of teaching, especially in the areas of student participation in the class, provision of clear learning objectives, course being boring, trainee centred teaching, and keeping attached to the timetable. Learning atmosphere on the other hand received higher scores. Mayya’s study revealed that students in general are more critical about the quality of teaching and the general climate of the school [10]. Continuous quality improvement and innovation are very essential in a medical school. Most researchers agree upon the usefullness of the DREEM inventory as a useful basis for strategic planning and resource utilization [7, 12]. Nevertheless, due to small sample size, the generalization of results might not be good idea however, it gives some clues or hints about the program and need to follow up for coming years. Further research on the use of DREEM inventory, comparing different diploma programs with follow up surveys, may be useful for educators to ensure and maintain high quality educational environments.

This article is available from: http://jeehp.org/

Table 1.

Perception of students

Items	Frequency	Percent
Perception of learning
Teaching is viewed negatively	5	50
A more positive perception	5	50
Perception of teachers
Moving in the right direction	8	80
Model course organizers	2	20
Academic self perception
Many negative expects	4	40
Feeling more on the positive side	5	50
Confident	1	10
Perception of atmosphere
There are many issues which need changing	1	10
A more positive attitude	8	80
A good feeling overall	1	10
Social self perception
Not a nice place	3	30
Not too bad	7	70

Table 2.

Median scores of different perceptions

	No.	Min.	Max.	Median	95% CI
Students’ perception of learning	10	1.58	2.92	2.08	1.81–2.51
Students’ perception of teachers	10	2.36	3.18	2.86	2.60–3.01
Students’ academic self perception	10	1.88	3.25	2.25	1.99–2.60
Students’ perception of atmosphere	10	2.00	3.17	2.50	2.22–2.82
Social self perception	10	1.29	2.86	2.50	1.91–2.68

Table 3.

Item-wise ratings of the Dundee Ready Educational Environment Measure (DREEM) questions

#	Item	Median score
1	Encourage to particIpate	4.00
2	Knowledgeable	3.00
3	Good support system	2.50
4	Too tired to enjoy	2.00
5	Learning strategies	3.00
6	Patiented centred approach	3.00
7	Teaching stimulating	2.50
8	Organizers ridicule	2.00
9	Organizers authritarian	1.50
10	Confident for passing year	2.00
11	Atmosphere relaxed	3.00
12	Well timetabled	1.50
13	Teaching is trainee centred	1.50
14	Rarely bored on the course	1.00
15	Good friends	4.00
16	Develop competence	2.50
17	Cheating is a problem	2.00
18	Good communication skill	3.50
19	Social life is good	3.50
20	Teaching well focussed	1.00
21	Well prepared for profession	2.50
22	Develop confidence	3.50
23	Atmosphere relaxed	4.00
24	Teaching time put to good use	2.00
25	Overemphasize factual learning	1.00
26	This year good preparation	3.00
27	Able to memorise all I need	1.50
28	Seldom feel lonely	3.00
29	Good to provide feedback	3.00
30	Opport. to develop interpersonal skills	3.50
31	Learn empathy	3.00
32	Provide constructive critism	3.00
33	Comfortable in teaching session socially	4.00
34	Atmosphere relaxed In group work	4.00
35	Experience disappointing	2.50
36	Able to coentrate well	1.50
37	Give clear examples	3.00
38	Clear about learning objectives	1.00
39	Get angry during teaching	4.00
40	Well prepared for teaching	4.00
41	Problem solving skill improved	2.00
42	Enjoyment outweigh the stress	1.50
43	Atmosphere motivates	2.00
44	Active learner	3.00
45	Relevant to career	3.00
46	Accomodation pleasant	2.50
47	Ltl is emphasized over stl	3.50
48	Too teacher centred	2.50
49	Ask the question	4.00
50	The trainee irritate the organizers	0.00

References

1. Genn JM. AMEE Medical Education Guide no. 23 (part 2): curriculum, environment, climate, quality and change in medical education: a unifying perspective. Med Teach 2001;23:445-54. Article PubMed
2. Seabrook MA. Clinical students’ initial reports of the educational climate in a single medical school. Med Educ 2004;38:659-69. Article PubMed
3. Audin K, Davy J, Barkham M. University quality of life and learning (UNIQoLL) an approach to student wellbeing, satisfaction and institutional change. J Further High Educ 2003;27:365-82. Article
4. Roff S. The Dundee Ready Educational Environment Measure (DREEM): a generic instrument for measuring students’ perceptions of undergraduate health professions curricula. Med Teach 2005;27:322-5. Article PubMed
5. Roff S, McAleer S, Harden RM, Al-Qahtani M, Ahmed AU, Deza H, et al. Development and validation of the Dundee Ready Education Environment Measure (DREEM). Med Teach 1997;19:295-9. Article
6. Whittle SR, Whelan B, Murdoch-Eaton DG. DREEM and beyond; studies of the educational environment as a means for its enhancement. Educ Health 2007;20:7.Article
7. Al-Ayed IH, Sheik SA. Assessment of the educational environment at the College of Medicine of King Saud University, Riyadh. East Mediterr Health J 2008;14:953-9. PubMed
8. Varma R, Tiyagi E, Gupta JK. Determining the quality of educational climate across multiple undergraduate teaching sites using the DREEM inventory. BMC Med Educ 2005;5:8.Article PubMed PMC
9. Roff S, McAleer S, Ifere OS, Bhattacharya S. A global diagnostic tool for measuring educational environment: comparing Nigeria and Nepal. Med Teach 2001;23:378-82. Article PubMed
10. Bassaw B, Roff S, McAleer S, Roopnarinesingh S, De Lisle J, Teelucksingh S, et al. Students’ perspectives on the educational environment, Faculty of Medical Sciences, Trinidad. Med Teach 2003;25:522-6. Article PubMed
11. Mayya SS, Roff S. Students’ perceptions of educational environment: a comparison of academic achievers and under-achievers at Kasturba Medical College, India. Educ Health 2004;17:280-91. Article
12. Avalos G, Freeman C, Dunne F. Determining the quality of the medical educational environment at an Irish medical school using the DREEM inventory. Ir Med J 2007;100:522-5. PubMed

Figure & Data

References

Citations

Citations to this article as recorded by

How does postgraduate diploma in Family Medicine impact on primary care doctors?
Abdul Jalil Khan, Ahsan Sethi, Sheraz Fazid, Zia Ul Haq, Javaria Raza, Mumtaz Patel
BMC Medical Education.2022;[Epub] CrossRef
Educational Environment Assessment by Multiprofessional Residency Students: New Horizons Based on Evidence from the DREEM
Ana Carolina Arantes Coutinho Costa, Nilce Maria da Silva Campos Costa, Edna Regina Silva Pereira
Medical Science Educator.2021; 31(2): 429. CrossRef
Understanding the Mentoring Environment Through Thematic Analysis of the Learning Environment in Medical Education: a Systematic Review
Jia Min Hee, Hong Wei Yap, Zheng Xuan Ong, Simone Qian Min Quek, Ying Pin Toh, Stephen Mason, Lalit Kumar Radha Krishna
Journal of General Internal Medicine.2019; 34(10): 2190. CrossRef
Optimising the learning environment for undergraduate students in the Department of Family Medicine at Sefako Makgatho Health Sciences University
I Govender, M De Villiers
South African Family Practice.2019; 61(4): 136. CrossRef
Development and psychometric testing of an abridged version of Dundee Ready Educational Environment Measure (DREEM)
Kathiresan Jeyashree, Hemant Deepak Shewade, Soundappan Kathirvel
Environmental Health and Preventive Medicine.2018;[Epub] CrossRef
Anesthesiology residents' perception of educational environment: comparison between different years of training
Efrain Riveros-Perez, Ricardo Riveros, Nicole M. Zimmerman, Alparsian Turan
Journal of Clinical Anesthesia.2016; 35: 376. CrossRef
Student’s Perception of Their Academics and Clinical Practice on Graduation from Dental Colleges of Peshawar
Saira Afridi, Jawad Ahmad Kundi, Syed Imran Gillani, Yasir Ibad, Rohail Muhammad, Riaz Gillani, Moiz Raza, Haseeb .
Journal of Gandhara Medical and Dental Science.2016; 2(2): 32. CrossRef
A web-based survey of the motivations and challenges faced by emerging researchers in the chiropractic profession
Katie de Luca, Peter Tuchin, Rod Bonello
Journal of Chiropractic Education.2015; 29(2): 151. CrossRef
Evaluation of hospital-learning environment for pediatric residency in eastern region of Saudi Arabia
Waleed H. BuAli, Abdul Sattar Khan, Mohammad Hussain Al-Qahtani, Shaikha aldossary
Journal of Educational Evaluation for Health Professions.2015; 12: 14. CrossRef
The potential use of DREEM in assessing the perceived educational environment of postgraduate public health students
Kathiresan Jeyashree, Binod Kumar Patro
Medical Teacher.2013; 35(4): 339. CrossRef
Assessing the learning environment at Jazan medical school of Saudi Arabia
Tabinda Hasan, Puneet Gupta
Medical Teacher.2013; 35(sup1): S90. CrossRef
Analysis of the ‘Educational Climate’ in Spanish Public Schools of Dentistry using the Dundee Ready Education Environment Measure: a multicenter study
I. Tomás, U. Millán, M. A. Casares, M. Abad, L. Ceballos, G. Gómez‐Moreno, J. J. Hidalgo, C. Llena, P. López‐Jornet, M. C. Machuca, F. Monticelli, J. Palés
European Journal of Dental Education.2013; 17(3): 159. CrossRef
Students’ Perceptions of Their Education on Graduation from a Dental School in India
Vittaldas B. Shetty, Ravi V. Shirahatti, Prakash Pawar
Journal of Dental Education.2012; 76(11): 1520. CrossRef

PubReader
ePub Link
Cite

CITE

export Copy Format

Close

XML Download

Evaluation of the Learning Environment for Diploma in Family Medicine with the Dundee Ready Education Environment (DREEM) Inventory

Items	Frequency	Percent
Perception of learning
Teaching is viewed negatively	5	50
A more positive perception	5	50
Perception of teachers
Moving in the right direction	8	80
Model course organizers	2	20
Academic self perception
Many negative expects	4	40
Feeling more on the positive side	5	50
Confident	1	10
Perception of atmosphere
There are many issues which need changing	1	10
A more positive attitude	8	80
A good feeling overall	1	10
Social self perception
Not a nice place	3	30
Not too bad	7	70

	No.	Min.	Max.	Median	95% CI
Students’ perception of learning	10	1.58	2.92	2.08	1.81–2.51
Students’ perception of teachers	10	2.36	3.18	2.86	2.60–3.01
Students’ academic self perception	10	1.88	3.25	2.25	1.99–2.60
Students’ perception of atmosphere	10	2.00	3.17	2.50	2.22–2.82
Social self perception	10	1.29	2.86	2.50	1.91–2.68

#	Item	Median score
1	Encourage to particIpate	4.00
2	Knowledgeable	3.00
3	Good support system	2.50
4	Too tired to enjoy	2.00
5	Learning strategies	3.00
6	Patiented centred approach	3.00
7	Teaching stimulating	2.50
8	Organizers ridicule	2.00
9	Organizers authritarian	1.50
10	Confident for passing year	2.00
11	Atmosphere relaxed	3.00
12	Well timetabled	1.50
13	Teaching is trainee centred	1.50
14	Rarely bored on the course	1.00
15	Good friends	4.00
16	Develop competence	2.50
17	Cheating is a problem	2.00
18	Good communication skill	3.50
19	Social life is good	3.50
20	Teaching well focussed	1.00
21	Well prepared for profession	2.50
22	Develop confidence	3.50
23	Atmosphere relaxed	4.00
24	Teaching time put to good use	2.00
25	Overemphasize factual learning	1.00
26	This year good preparation	3.00
27	Able to memorise all I need	1.50
28	Seldom feel lonely	3.00
29	Good to provide feedback	3.00
30	Opport. to develop interpersonal skills	3.50
31	Learn empathy	3.00
32	Provide constructive critism	3.00
33	Comfortable in teaching session socially	4.00
34	Atmosphere relaxed In group work	4.00
35	Experience disappointing	2.50
36	Able to coentrate well	1.50
37	Give clear examples	3.00
38	Clear about learning objectives	1.00
39	Get angry during teaching	4.00
40	Well prepared for teaching	4.00
41	Problem solving skill improved	2.00
42	Enjoyment outweigh the stress	1.50
43	Atmosphere motivates	2.00
44	Active learner	3.00
45	Relevant to career	3.00
46	Accomodation pleasant	2.50
47	Ltl is emphasized over stl	3.50
48	Too teacher centred	2.50
49	Ask the question	4.00
50	The trainee irritate the organizers	0.00

Table 1. Perception of students

Table 2. Median scores of different perceptions

Table 3. Item-wise ratings of the Dundee Ready Educational Environment Measure (DREEM) questions