INTRODUCTION
In the United Kingdom, Health Education England is responsible for the education and training of all health professionals. In each of its regional offices, a postgraduate medical and dental education function supports the continuing professional development of general practitioners (GPs). Health Education North West (HENW), for example, has commissioned variations of an accredited postgraduate ‘professional education and development’ (PED) course for GPs since 1994 [1]. The rationale for the course is to support GPs, especially in their early years of practice, to enable them to access development opportunities within a supportive schema. PED is designed to encourage the development of a range of theoretical and practical leadership skills necessary to thrive in a constantly changing, increasingly complex primary healthcare landscape so that participants are better able to provide effective and efficient services, enhancing care for patients and safeguarding their own wellbeing. The course is predominantly focused on enabling professional and practice development, using reflective learning techniques in peer-groups of up to eight doctors for at least 18 months. It comprises the core modules of an MSc program accredited by one of the regional universities, devised and taught by local GP educationalists. Participants are required to submit practice development plans, personal education plans and a portfolio of work which includes a significant event analysis (SEA) and review of progress against the personal and practice plans. This approach enables participants to review and justify their work in an academically rigorous way. Table 1 illustrates the structure, content and assessment of the PED course in more detail. The aim of this study is to identify whether and how the PED course might benefit participating GPs resulting in, for example, well-organised practices able to offer better and safer patient care.
METHODS
A qualitative approach to data collection and analysis was adopted in order to enable a detailed exploration of the benefits of the course as a case study of such educational interventions. As part of the course, participants submit a number of academic written assignments including a portfolio which documents reflection on progress. The content of each portfolio gives individual accounts of the impact of the course on personal and practice development, including planned changes, as well as patient safety issues. The research team therefore decided to base the investigation on extant portfolio submissions rather than data collected via interviews or surveys.
Data collection
We secured permission to undertake this research from the university which accredits the PED course as well as the HENW research governance committee which reviews proposed studies for scientific quality and ethical integrity. Approval from the National Health Service (NHS) National Research Ethics Service was not required. Each academic year approximately 15 GP participants submit the requisite portfolios as part of their final assessment for their PED qualification. Between January and March 2013 we wrote to a random sample of 30 PED participants who had successfully completed the course in the past five years, requesting permission to access and analyse their portfolios for key themes in relation to personal development, practice development and patient safety issues.
Participants were sent a detailed information sheet about the study and assured that their portfolios would be rendered anonymous by an administrator before being allocated to the research team for analysis and that no participating GP, his/her patients or practice colleagues would be identifiable in any publications arising from the research. Written permission was obtained from 16 participants (53%) who returned a consent form and their portfolios formed the basis of the case study.
Data analysis
Portfolios were analysed for recurring discourses and themes using a thematic framework analysis [2]. The research team acted as co-analysts and a coding framework was devised as a result of their deliberations. This construction of codes and thematic categories was done by the co-analysts working independently, and deliberating together on interpretations until agreement was reached. The quality of the findings is highly dependent on the rigour of the data collection and subsequent analysis and interpretation. We attempted to achieve rigour by using established techniques to ensure credibility, transferability, dependability, and confirmability [3]. Inter-rater reliability ensured that multiple coders were involved in identifying areas of agreement to ensure consistency and to minimise any potential for bias in interpretation. There were very limited disagreements about coding definitions and all were successfully resolved. The research team engaged in constant comparison, involving checking the consistency and accuracy of interpretation and especially the application of codes, as well as careful consideration of negative cases. Records of all data analysis activities were maintained so that genesis of interpretation could be tracked, ensuring auditability.
RESULTS
We identified seven major thematic categories in the data, as summarized in Fig. 1. Themes with illustrative data extracts from participants are in Appendix 1. Seven major thematic categories can be described as follows.
Leadership
Increasing leadership skills was an important goal for participants and a motivating factor in deciding to undertake the PED course. The most consistently reported areas which were felt to be useful by participants were the development of non-clinical managerial skills (e.g., staff employment skills, chairpersonship and planning/timetabling), self-awareness and self-confidence, assertiveness, change management, team working, and skills in negotiating conflicts. These correlate closely with areas of the Medical Leadership Competence Framework [4]. The increase in leadership skills was not without disadvantage; however, as participants reported finding themselves exposed to assuming responsibility for resolving conflicts in their work environment.
Resilience
Participants were often working in difficult situations, with challenging patients and colleagues. The portfolios provide evidence of their developing hardiness in dealing with challenges through descriptions of increased resilience or approaches and attitudes that were likely to increase resilience. Recurrent themes attributed to PED included improved positivity; enthusiasm; flexibility, particularly for problem solving; personal and team resilience; team building, with the ideas prompted from the course material and discussions facilitating a happier and more effective practice team; peer support, including its beneficial role in burnout prevention; and a greater awareness of maintaining work-life balance. Increased confidence was a strongly emergent theme and was mentioned in various contexts including leadership, colleague interaction, educational expertise, practice management, and problem solving.
Quality improvement
Improving quality in general practice is an outcome which course participants were keen to achieve. Every portfolio was found to have references to finding better ways of doing things and the great majority also commented about strategies to more effectively monitor performance. All participants documented how their experience on the PED course had resulted in improved services at their practice. The evidence suggests that the tools used within the course are transferable to everyday practice. A number of portfolios reflected upon providing enhanced services beyond the requirements of the quality outcomes framework. We also found evidence of specific learning tools from the course, especially the use of SEA, being used to directly enhance services.
Change management
Practice plans illustrated how management of day-to-day challenges affected participants’ ability to respond to external changes, including those implemented by Government. The PED course looked at change management specifically and how to approach it. Participants reflected that attempting to bring about change was often difficult, both emotionally and practically. A new awareness of the possibility of change led some participants to feel frustration towards partners and staff who did not share their vision and to unrealistic expectations. Becoming a change-maker could also affect how the individual was perceived by the practice, both positively and negatively.
New services
Participants’ practice plans revealed a range of new services, including new clinics, improved access and the development of services open to other practice patients. Whilst many of these would have happened anyway, it is possible the rigour of producing the plan with smart objectives may have supported the process. In addition, plans reveal the use of Gantt charts, SWOT (strengths, weaknesses, opportunities, and threats), and a range of other tools introduced by the course. Participants’ reflected on what had aided success, such as the benefits of project management techniques, which may help in the development of future services and plans. We also found evidence of a range of methods being used to evaluate new services, often involving both user- and staff feedback, whilst also acknowledging the difficulties of evaluation. In some instances there were helpful reflections on why planned services did not go ahead.
Educational expertise
The increased confidence gained by participants in using reflection and in planning their own learning is frequently mentioned in the portfolios. Education of self and others was an important theme, as was developing an educational environment within the practice, both through improving the fabric of the building and by developing resources and approaches to learning. We found evidence of the development of self-directed learning, as well as reflection on the way that an organization learned and then modified the approach taken (i.e., triple loop learning). A significant number of participants also highlighted that they had been able to improve staff training or the staff appraisal processes within their organization in order to improve quality. On a personal level, PED written assignments can be challenging and we found evidence that participants’ writing and analytical skills had been developed by the course.
Patient safety
A wide range of incidents were discussed relating to patient safety. The SEA described in the portfolios demonstrate the amount of thought that goes into analysis of each incident as well as the impact that adverse events can have on the ability of GPs to cope with work stress. We found evidence of significant learning from reflection and through complaints. Discussing patient safety issues with the team at practice meetings was thought to significantly assist in ensuring positive outcomes and reduce the possibility of staff burnout. Recurrent outcomes of the SEA were specific actions agreed by a practice to improve patient safety. It is notable that in the instances where GPs are not part of a team the potential stress of the incidents was particularly noted, as well as identifying the loss of ability to share learning more widely with the team.
DISCUSSION
In considering whether this type of educational intervention may be of benefit to GPs, we purposefully focused upon extant documentation produced for personal and practice development planning. The plans formed a significant component of participants’ coursework submitted for formal assessment and in totality this reflective material provided a rich seam of qualitative data on the impact of the PED course. In each of the seven thematic categories extrapolated from the data, we found evidence that the supportive framework provided by the course did enable development of practitioners by enhancing knowledge and skills which, in turn, had a positive impact upon their self-perceived effectiveness and motivation.
The successful integration of newly-acquired managerial skills into the working environment appears to involve a complex interaction of self-awareness, team awareness, confidence factors and assertiveness. The structure of the PED course would appear to be facilitative in allowing participants to try out their skills and rehearse new techniques in a safe group environment before transferring them to the workplace. As well as evidence of developing leadership competencies we also identified perceptions of PED as a positive influence on confidence, hardiness and other indicators of resilience. The impact of PED on levels of resilience may lie in providing participants with opportunities for discussion and analysis of potentially stressful situations that occur in general practice combined with peer support and the development of creative problem solving and organizational skills.
The portfolios reveal evidence of increasing skills in reflection and self-directed learning, with improved educational skills being used to help others within the practice. PED’s promotion of leadership and creative approaches to problem solving appear to have helped with the development of an educational environment and learning cultures within several practices. In an NHS which is seeing significant emphasis on accountability for quality of service and additional regulation, participants evidently value the acquisition of quality improvement, monitoring, and evaluative skills.
Participants clearly welcomed the opportunity to develop change management skills, although a number of them subsequently encountered a reluctance to change in their partners and staff. The extended period of the course, however, allowed participants to receive on-going support as they handled these issues of resistance and learned how to overcome the associated challenges. Substantial changes are required in primary care to incorporate developments in medicine and new models of delivering care [5]. PED’s facilitation of reflection on both successful and failed practice-based initiatives will arguably stand participants in good stead, given that delivering new services will underpin general practice in future and practitioners will require clinical and strategic understanding to identify the most appropriate developments, as well as the skills to plan and implement them [6].
Our case study relates to a small sample of participants who have undertaken a PED course in a single region, so there are inevitable limitations in terms of generalizability in the quantitative sense. A further limitation relates to the fact that the study was based on analysing portfolio entries that have been completed as part of an assessment process. There is a possibility that the entries were completed by students in a way that met learning outcomes and satisfied tutors rather than reflect their own views, although the likelihood of this happening is perhaps minimised by the fact that students were encouraged to draw upon both positive and negative aspects of their professional lives and day-to-day experiences in general practice, a profession where reflective practice is ingrained. In addition, although all portfolios were made anonymous by an administrator before being allocated to researchers for analysis, some of the researchers had previous experience of the PED as course tutors. Because of this connection, the whole research team collectively discussed each developing theme during data analysis in order to minimise any potential bias in interpretation. The team also included a non-clinical education researcher, with no prior knowledge or experience of the PED course, as an additional safeguard.
In conclusion, in seeking to determine the impact of PED on participants, we found evidence of positive benefits in terms of the acquisition of enhanced leadership skills, confidence in developing/delivering new services and continuous quality improvement. We also found evidence of PED’s contribution to the development of resilient, reflective practitioners, attuned and responsive to personal, practice and health service need. Leadership development amongst participants appears to translate into improved and safer patient care, as well as positivity in doctors. The costs of running PED-type courses, whilst significant, are small compared to the overall cost of training a GP and this study suggests the added benefits they can bring to primary care. There are significant potential changes in postgraduate medical training as a result of the ‘shape of training’ review [7]. The situation in general practice is particularly dynamic given the potential extension of GP specialty training from three to four years. Research into recent pilot programs suggests that extended training may be an effective method of developing leadership capabilities in future GPs [8]. Courses like PED, however, can provide a bridge for those completing three year programmes as the graduates of longer training enter the workforce. Such courses may also serve a valuable purpose for the existing workforce which will be responsible for leading the shift towards community-based service delivery in the NHS alongside a clear and continuing role for the specialist-generalist-the GP.