Measuring Success – Top Tips for Assessing the Effectiveness of Training

Article By Michelle Yeomans Operations Manager for EPiC Auditors Limited

The Covid-19 pandemic led to  changes in the amount and delivery method used by Pharmaceutical companies to conduct training. Some companies cut back on training to conserve resource for core functions, whilst others invested in virtual training and e-learning to provide continued development opportunities for their employees. The situation was no different for regulators.

During the pandemic, I was the Unit Manager of the GMP and GDP Inspectorate at the MHRA, and as well as developing remote inspection approaches to ensure a continued level of regulatory oversight, MHRA used the opportunity to dedicate Inspectorate resource to enhance the range of training materials available within the ‘Inspector Academy’ knowledge hub and developed virtual training modules and competency frameworks. At the time it was a case of adapting to the situation and being innovative in exploring available tools and techniques to identify the “least worst” available option.

Post pandemic, several conferences and training events have now returned to being run as face-to-face events, while others are continuing to offer virtual or hybrid options to maximise accessibility and minimise costs. EU GMP Chapter 2, 2.11 refers to the need for “continuing training” to be given and for its “practical effectiveness” to be periodically assessed. Continuing training is an ongoing process of learning and acquiring new skills and knowledge to help individuals stay up to date with the latest developments and changes relevant to their role and industry sector. Continuing training can include self-learning so is not just limited to attending workshops, seminars, conferences, or specialist courses. The key point is finding a way to stay current with industry trends, which will help increase expertise and proficiency, and support compliance with GMP requirements. Another key consideration is the need to keep a record to document the training, as training records are routinely reviewed during a regulatory inspection and provide evidence of continuing professional development.

With different training opportunities and formats on offer, it is important to have clearly defined learning objectives and ways of collecting information to determine whether the training provided has produced the desired effect and contributed to the development of the trainee.

Here are our top tips for assessing the practical effectiveness of training:

1. Pre and post-assessments: Conducting assessments, questionnaires, or quizzes before and after the training can help measure the knowledge, skills, or behaviour changes that have occurred as a result of the training. Comparing the scores or performance levels before and after the training provides an indication of the impact of the training.
2. Observations and simulations: Observing participants during or after the training session can help assess their application of the newly acquired knowledge and skills. This can be done through simulations or real-world scenarios to evaluate their ability to transfer the learning into practical situations.
3. Follow-up assessments: Conducting assessments weeks or months after the training has taken place can help evaluate the long-term impact and effectiveness of the training. This can provide insights into whether the learning has been retained, and if it has influenced the individual’s work performance over time.
4. Feedback: Soliciting feedback from trainees and supervisors or managers who work closely with the individuals can provide an additional perspective on the effectiveness of the training. They can assess whether the training has positively impacted the individuals’ job performance, productivity, or overall contribution to the organisation.
5. Performance metrics: Comparing PQS performance, KPIs or Quality metrics before and after the training can yield insights into any improvements or changes in the workplace performance of individuals or teams who participated in the training. An overview of GMP related training completed, and a review of PQS performance to identify compliance improvement topics for inclusion in further GMP refresher training should be included as agenda items at periodic Management Review meetings.

By using a combination of these assessment methods, organisations can gain a comprehensive understanding of the effectiveness of their training efforts and identify areas for improvement.

Please get in touch if you what to know more about our virtual symposia and bespoke inhouse training courses.

Telephone: +44 (0)1244 980544 or email us

We are thrilled to welcome Ex MHRA Inspector Alan Moon as an Independent Consultant at EPiC Auditors.

Alan Moon began his career in the pharmaceutical industry in February 1994 and has extensive experience of pharmaceutical manufacture, particularly associated with sterile products and investigational medicinal products (IMPs). He spent approximately 19 years working within the pharmaceutical industry before joining the UK Medicines Regulator (MHRA) in 2013.

During his ten years at MHRA Alan reached the level of Lead Senior Inspector and in addition to supporting the GMP Inspectorate’s risk-based inspection programme and being the nominated chair for the Compliance Management Team, he was also the technical lead within the GMP team for both sterile products and IMPs.

He was the principal UK representative for the GMP Annex 1 drafting group from 2019 through to its publication in August 2022, and continued to support the associated PIC/S inspector training group and participate in conferences on the subject until leaving the Agency in March 2023.

Alan was also part of the EU working group for the revision and update to GMP Annex 13 and as part of the UK’s exit from the EU, he prepared the framework and guidance for implementation of the UK MIA(IMP) oversight process for the import of QP-certified IMPs from listed countries into Great Britain, and the associated aspects relating to the Northern Ireland Protocol.

Prior to joining the MHRA GMP Inspectorate, Alan worked in a variety of roles within the pharmaceutical industry, including QA, QC Microbiology, Sterility Assurance, Validation and Production, with significant experience of aseptic and terminal sterilisation manufacturing processes.

Alan’s exceptional skills, extensive experience, and unique expertise make him the perfect addition to our team.

QUOTE FROM RICHARD ANDREWS

We are thrilled to welcome Ex MHRA inspector Alan as an independent consultant at EPiC Auditors. Having been involved with the manufacture and regulation of medicines for nearly three decades Alan’s expertise is a key resource for the industry, and he is a great addition to the EPiC team.

Richard Andrew, EPiC Managing Director & Senior Consultant

Pharmaceutical Industry Experts

Auditors used by EPIC are former Regulatory Inspectors, typically ex MHRA Inspectors. All auditors have extensive industry experience and many years of experience auditing and inspecting within the pharmaceutical industry.

To read the bio and full CV for Alan Moon and our other experts’ visit Meet Our Experts

If you need our help and support then please contact us on +44 (0)1244 980544 or e mail us at

 “Mind the Gap” – 5 Top Tips for Improved Self-Inspection

Article By Michelle Yeomans Operations Manager for EPiC Auditors Limited

During our time as MHRA Inspectors and now as pharmaceutical consultants, at EPiC we routinely see non-compliant sites i.e., those referred to MHRA’s Inspection Action Group (IAG) with a series of self-inspection reports indicating a high level of compliance. This begs the question why do some self-inspection programmes fail to adequately appraise the effectiveness and applicability of pharmaceutical quality systems (PQS)? 

Here are our top tips on how to avoid gaps between self-inspection and regulators findings: 

1. Remember why you are performing self-inspections Self-inspections are often not taken as seriously as regulatory inspections, but ultimately have the same objective to protect patients and product quality. Self-inspections can help identify and address deficiencies to support maintaining an “inspection ready” status by providing confidence that you as a licence holder are meeting your legal obligations to comply with EU GMP and GDP requirements.   

2. Self-inspection perception – Unless sufficient time and resources are allocated to self-inspection, programmes can become too informal and rushed. Taking the time to objectively evaluate a process, facility, or document should be seen as value adding by providing an opportunity to gather information about compliance and is a way for Senior management including QPs/RPs to have oversight of the performance of all areas of the business.​ 

3. Self-inspection focus – Consider whether audits should be horizontal audits i.e., follow the process flow from goods receipt to product release for example or be focussed on just one area of the process.​ Use a risk-based approach by researching the most common deficiencies found during inspections and audits e.g., consider examples which are published by MHRA, or featured in EPiC Seminar presentations, to ensure “hot topics” are include as an area of focus during the audit. Identify the high-risk areas of the process which will require more of your attention. This can be done by looking at the past performance of the area – deviations, change controls, previous audit findings etc​. 

4. Invest in Auditor training – Audits drive big decisions such as capex, awarding contracts, supplier approval, compliance level assessment, etc. so it is important auditors are trained. This includes having an understanding and ability to apply a broad range of softer behavioural and questioning skills, follow good practice guidance on the principles of auditing, and can demonstrate an understanding of the applicable GXP rules and regulations. 

5. Post audit activity – It’s not all about performing the audit, it is equally important to maintain a focus on CAPA completion and ongoing effectiveness checks. Successful completion of CAPA is integral to achieving the objective to protect patient and product quality and drives sustainable compliance. 

By following these 5 tips, you can improve the effectiveness of self-inspections, ensure that the PQS is continuously improving and “mind the gap” between self-inspection and regulatory findings! 

Get in touch if you what to know more about our bespoke inhouse training course on effective and value adding self-inspection and how we train auditors.  

Call to speak to one of our pharmaceutical consultants: +44 (0)1244 980544 or email us at"> 

Top Tips for Implementing Effective Knowledge Management Practices

Article By Michelle Yeomans Operations Manager for EPiC Auditors Limited

At the EPiC Autumn Compliance Seminar, I delivered a presentation outlining the direction of travel in demonstrating compliance  (Session 1. GMP Seminar 10th November 2022 9am to 10am) which highlighted how global regulators are looking at new ways to be agile and make best use of resources and reduce regulatory complexity. The aim is to benefit patients by supporting access to quality medicines by adopting the same requirements for the formats and data expectations in regulatory submissions and applying the same standards in regulatory review, assessment, and inspection to support reliance. Such approaches will require companies to demonstrate effective use of data, knowledge management and to implement a culture of continuous improvement throughout the product lifecycle.  

How organisations create, manage, and use knowledge is a key component of an effective Pharmaceutical Quality System (PQS) as defined by ICH Q10. The need to minimise knowledge loss is a primary concern, as loss of knowledge can lead to poor risk-based decision making and inefficiencies in trying to retrieve past knowledge or having to  “reinvent the wheel” to replace lost knowledge.

Hardly a week goes by without seeing a post on LinkedIn from a network connection who is “happy to share” that they are starting a new position. Whilst this is exciting for the individual to be embarking on a new chapter in their career, what can organisations do to minimise the risk of specialist knowledge walking out of the door with them?

Tips for implementing effective knowledge management practices:

1. It’s important to recognise that it is the people and not the data that underpin an organisations’ knowledge base. Compile and maintain a list or matrix of subject matter experts (SMEs) to increase awareness of “go to” people and encourage communication, networking and sharing of past and current knowledge.
2. Don’t wait until someone is working their notice to try to capture all that they know, as there won’t be enough time to transfer valuable knowledge to colleagues. Think about how you can capture and manage knowledge as a continuous improvement activity e.g., capturing and implementing lessons learned and after-action reviews.
3. Advances in technology to support remote collaborative working accelerated during the Covid-19 pandemic and has increased the availability and accessibility of creative tools to capture and share information. Explore what options are available with IT and Data Management colleagues to make use of available tools to help build and improve your knowledge management systems.
4. Asking someone to write down everything they know about a particular product, process, system, operation is a daunting task. People may not be aware of the knowledge they possess or how valuable it is to others. Indecision on what to include could result in a lot of the implicit knowledge remaining in people’s heads and at risk of being lost. As implicit knowledge is often difficult to articulate, transfer of knowledge can be achieved more effectively by encouraging regular interaction with colleagues e.g., networking forums, and sharing practical experiences through coaching and mentoring opportunities.  
5. For knowledge to be usable, it needs to be captured in an effective manner. Consider using a variety of formats to encourage information sharing and capturing knowledge e.g., video recordings, voice notes, whiteboards, story boards etc. Look at how the resulting output could be adopted into workflows, SOPs, Work Instructions, etc. as continuous improvement helping to retain current knowledge and support the development of new knowledge.

The above practical tips are intended to help minimise the risk of knowledge loss and support compliance with the EU GMP requirement to implement quality improvements appropriate to the current level of process and products knowledge (EU GMP Chapter 1, 1.4 (xi)) and ICH Q10 principles.

If you need our help and support, then please don’t hesitate to contact us.

Telephone: +44 (0)1244 980544 or email us at 

Lewis Corbett joins EPiC as Business Manager & Senior Consultant

EPIC Auditors are delighted to announce that Ex MHRA Inspector Lewis Corbett has joined EPiC Auditors as Business Manager and Senior Consultant.

Lewis has over 25 years experience of pharmaceutical manufacture and distribution gained from working within the industry and for the GMP Inspectorate of the UK medicines regulator (MHRA) as a Senior GMP Inspector and Head of GMP Team 1. During his 5 years at the MHRA Lewis had responsibility for the licensing and inspection of pharmaceutical manufacturers and distributors both in the UK and overseas, managing and leading a team of GMP Inspectors, implementing changes to regulations and ways of working as a result of EU Exit, and supporting elements of the agency’s Covid-19 pandemic response. 

Prior to joining the MHRA Inspectorate Lewis spent 22 years working in the pharmaceutical industry in various QC, QA and management roles, and as a Qualified Person for a range of active pharmaceutical ingredients and non-sterile product dosage forms.

Lewis was trained and accredited by the MHRA to inspect:

• API manufacturers, importers and distributors  
• Importation of medicinal products 
• Non-Sterile manufacturing sites   
• Contract laboratories   
• Excipient manufacturers  
• Storage and distribution sites

He has expertise in MHRA and EU Inspection preparation and remediation, Pharmaceutical Quality Management Systems, and training in EU GMP Regulatory requirements and is eligible to act as an EU Qualified Person.

With his wide portfolio of experience, Lewis is a great addition to the core EPiC team and with his help we are confident we can extend our GXP support across the medicinal product lifecycle and help all our clients to improve their GXP quality systems and regulatory compliance.

If you need our help and support from an Ex MHRA Inspector then please contact us on +44 (0)1244 980544 or e mail us at