Measuring Success – Top Tips for Assessing the Effectiveness of Training

Article By Michelle Yeomans Operations Manager for EPiC Auditors

The Covid-19 pandemic led to changes in the amount and delivery method used by Pharmaceutical companies to conduct training. Some companies cut back on training to conserve resources for core functions, whilst others invested in virtual training and e-learning to provide continued development opportunities for their employees. The situation was no different for regulators.

During the pandemic, I was the Unit Manager of the GMP and GDP Inspectorate at the MHRA, and as well as developing remote inspection approaches to ensure a continued level of regulatory oversight, MHRA used the opportunity to dedicate Inspectorate resource to enhance the range of training materials available within the ‘Inspector Academy’ knowledge hub and developed virtual training modules and competency frameworks. At the time, it was a case of adapting to the situation and being innovative in exploring available tools and techniques to identify the “least worst” available option.

Post pandemic, several conferences and training events have now returned to being run as face-to-face events, while others are continuing to offer virtual or hybrid options to maximise accessibility and minimise costs. EU GMP Chapter 2, 2.11 refers to the need for “continuing training” to be given and for its “practical effectiveness” to be periodically assessed. Continuing training is an ongoing process of learning and acquiring new skills and knowledge to help individuals stay updated with the latest developments and changes relevant to their role and industry sector. Continuing training can include self-learning so is not just limited to attending workshops, seminars, conferences, or specialist courses. The key point is finding a way to stay current with industry trends, which will help increase expertise and proficiency and support compliance with GMP requirements. Another key consideration is the need to keep a record to document the training, as training records are routinely reviewed during a regulatory inspection and provide evidence of continuing professional development.

With different training opportunities and formats on offer, it is important to have clearly defined learning objectives and ways of collecting information to determine whether the training provided has produced the desired effect and contributed to the development of the trainee.

Here are our top tips for assessing the practical effectiveness of training:

1. Pre and post-assessments: Conducting assessments, questionnaires, or quizzes before and after the training can help measure the knowledge, skills, or behaviour changes that have occurred as a result of the training. Comparing the scores or performance levels before and after the training provides an indication of the impact of the training.
2. Observations and simulations: Observing participants during or after the training session can help assess their application of the newly acquired knowledge and skills. This can be done through simulations or real-world scenarios to evaluate their ability to transfer the learning into practical situations.
3. Follow-up assessments: Conducting assessments weeks or months after the training has taken place can help evaluate the long-term impact and effectiveness of the training. This can provide insights into whether the learning has been retained, and if it has influenced the individual’s work performance over time.
4. Feedback: Soliciting feedback from trainees and supervisors or managers who work closely with the individuals can provide an additional perspective on the effectiveness of the training. They can assess whether the training has positively impacted the individuals’ job performance, productivity, or overall contribution to the organisation.
5. Performance metrics: Comparing PQS performance, KPIs or Quality metrics before and after the training can yield insights into any improvements or changes in the workplace performance of individuals or teams who participated in the training. An overview of GMP related training completed, and a review of PQS performance to identify compliance improvement topics for inclusion in further GMP refresher training should be included as agenda items at periodic Management Review meetings.

By using a combination of these assessment methods, organisations can gain a comprehensive understanding of the effectiveness of their training efforts and identify areas for improvement.

Please get in touch if you want to know more about our virtual symposia and bespoke in-house training courses.

Telephone: +44 (0)1244 980544 or email us at enquiries@epic-auditors.com