Verifying training effectiveness for procedure changes

lisasolo

Starting to get Involved
#1
Hi all,

My company implemented all required changes for ISO 13485:2016, including verification of training effectiveness based on risk. Our procedure includes quizzes or demonstration of knowledge for high risk, discussions for medium risk and monitoring for low risk.

This has been working for us, but we have come upon an issue when documents are changed. When documents are changed, we always retrain employees that were trained on that document. We do not have a method of verifying the effectiveness of this retraining. It does not make sense to have employees retake a quiz each time a high risk procedure is minorly changed. Does anyone have any ideas for this situation? Thank you!
 
Elsmar Forum Sponsor

normzone

Trusted Information Resource
#2
In my previous life our training document had a signoff block at the bottom, where the trainer signed one of three blocks attesting that they verified the effectiveness of the training through one of these:

Question and answer
Test
Observation
 
#3
My company is ISO certified. Whenever changes are made to SOPs, the quiz is also updated/revised to incorporate the changes. Everyone who was trained originally has to retake the new quiz for effectiveness training.
 

yodon

Staff member
Super Moderator
#4
To me, quizzes and Q/A sessions are often used to satisfy the ISO requirement (and admittedly, I use them, too) but are they truly a measure of effectiveness? Are you seeing deviations or NCs after the procedures are changed? We also monitor this aspect and discuss in Management Review.
 

insect warfare

QA=Question Authority
Trusted Information Resource
#5
Hi all,

My company implemented all required changes for ISO 13485:2016, including verification of training effectiveness based on risk. Our procedure includes quizzes or demonstration of knowledge for high risk, discussions for medium risk and monitoring for low risk.

This has been working for us, but we have come upon an issue when documents are changed. When documents are changed, we always retrain employees that were trained on that document. We do not have a method of verifying the effectiveness of this retraining. It does not make sense to have employees retake a quiz each time a high risk procedure is minorly changed. Does anyone have any ideas for this situation? Thank you!
First things first - welcome to the Cove!

You stated that you do not have a method of verifying effectiveness of this re-training, which essentially means that you first need to define (and possibly document) such method(s).

For example (and this is just a suggestion), you could document in your training process that the following activities are acceptable as evaluation methods: 1) interactive Q&A, 2) completing quizzes, tests or other types of assessments, and/or 3) applied demonstrations by the worker of knowledge gained through training or instruction. This may provide the flexibility you need to escape the "retaking a quiz each time a high risk procedure is minorly changed" trap.

If you use a form to capture evidence of training, you could insert separate signature fields into the form, such as "Trained by" and "Evaluated by" to show evidence of training and evaluation together, even though they may or may not be done by the same person (it would not matter how the evaluation was done as long as it was done according to the documented training process, although you may want to track this specifically). The signatures, of course, then serve as an acknowledgment of the activities performed.

Please keep in mind that competency is the ultimate goal, but it is also prudent for your organization to have appropriate records of training and evaluation, notwithstanding any management system certifications.

Brian :rolleyes:
 
Thread starter Similar threads Forum Replies Date
K Verifying gas tight glass syringe used for making standards General Measurement Device and Calibration Topics 4
D Tolerance when verifying an analytical balance General Measurement Device and Calibration Topics 3
X Heat Treat - Verifying mechanical properties on heat treated material per the ASTM Manufacturing and Related Processes 6
F Checking Gages In and Out and Verifying Calibration Status Calibration and Metrology Software and Hardware 8
G Verifying Calibration of Thermocouples at different Temperatures General Measurement Device and Calibration Topics 9
G Acceptance Criteria when Verifying a Gauge General Measurement Device and Calibration Topics 2
G Verifying the Documents we have in place AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 2
C Verifying In House Laboratory Weight Sets General Measurement Device and Calibration Topics 2
N Verifying Calibration of Hardness Gauge vs Actually Calibrating It General Measurement Device and Calibration Topics 2
T What is clause ISO9001:2008 for Acc/Rej Criteria and Verifying QA process Internal Auditing 2
R Verifying Documents have been removed or destroyed once the Retention Period expires ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 12
J Verifying a Standard with a Standard using Micrometers General Measurement Device and Calibration Topics 10
Q Basis for Verifying Corrective Actions and Effectiveness ISO 13485:2016 - Medical Device Quality Management Systems 12
AnaMariaVR2 Tracking Water Resistivity - Verifying Reverse Osmosis Water Purification Misc. Quality Assurance and Business Systems Related Topics 3
J Verifying the Effectiveness of Corrective Action - Challenge with an external auditor Nonconformance and Corrective Action 16
D Difficult Inspection Level/AQL - Verifying it is the correct part AQL - Acceptable Quality Level 5
N Sampling Plan for Verifying Inventory Status Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
A Different Methodologies for Verifying Legal Compliance Under ISO 22000:2005 Food Safety - ISO 22000, HACCP (21 CFR 120) 5
T Calibrating or Verifying Metal or Steel Tape Measures General Measurement Device and Calibration Topics 195
B Are there any guidelines / procedures / books to verifying a new equipment? Manufacturing and Related Processes 1
P Verifying Applied Torque General Measurement Device and Calibration Topics 11
P Verifying improvement results - Indication that controls have worked Statistical Analysis Tools, Techniques and SPC 5
C Need help verifying certification for 3000 psi pressure gauge General Measurement Device and Calibration Topics 3
C I need help verifying formula's in a database for LCL UCL Cp Cpk PPk Statistical Analysis Tools, Techniques and SPC 14
B Verifying Accuracy Automated Measurement Device - Width of a strip of steel Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 10
I Verifying our process to approve suppliers for indirect material Supplier Quality Assurance and other Supplier Issues 2
T Closing Out Corrective Actions and Verifying their Effectiveness ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 29
S Corrective Actions - Specifically closing out and verifying effectiveness Nonconformance and Corrective Action 30
A Self-training or Self-studying ISO 13485:2016 - Medical Device Quality Management Systems 8
N ISO 9001 - Training business with fewer than 5 employees ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
S Employees training database Document Control Systems, Procedures, Forms and Templates 4
optomist1 Rates Daily or Hourly Process Improvement Training Consultants and Consulting 2
Le Chiffre Online training available for ISO/IEC 17021-1: Requirements for bodies providing audit and certification of management systems Training - Internal, External, Online and Distance Learning 3
S IEC60601-1 Training recommendations Training - Internal, External, Online and Distance Learning 1
P Training department ideas and development for automotive supplier Training - Internal, External, Online and Distance Learning 6
A Document release vs its related training. Which should come first? ISO 13485:2016 - Medical Device Quality Management Systems 18
C RA (Regulatory Assurance) Training (FDA) looking for resources Training - Internal, External, Online and Distance Learning 5
was named killer Onsite Level II N.D.T. Training in Florida Training - Internal, External, Online and Distance Learning 0
T Training recommendations? Bringing our RoHS and REACH compliance efforts in-house REACH and RoHS Conversations 2
S Quality Audit Training Activities Quality Manager and Management Related Issues 2
M Audit Criteria Training Materials Internal Auditing 1
B Looking for 10 Internal Audit Online Training Participants ISO 17025 related Discussions 2
optomist1 Informational Training IMDS - Management of Product Chemical Regulatory Compliance RoHS, REACH, ELV, IMDS and Restricted Substances 2
Anonymous16-2 Labelling Training Training - Internal, External, Online and Distance Learning 3
J Recommendations for online ISO 19011 training? Training - Internal, External, Online and Distance Learning 8
J Looking for a training organization that can provide in house DFMEA training FMEA and Control Plans 4
A AS9100 Training - Where do I start? AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 14
R What's the major difference between Green Belt and Black Belt in term of training and project Six Sigma 3
S ISO 13485 Lead Auditor - Debate between our Quality Team and Regulatory Auditor - Internal Auditor Training ISO 13485:2016 - Medical Device Quality Management Systems 17
I Where can I beg, steal (just kidding of course) or borrow good training material on the ISO 9001:2015 standard? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5

Similar threads

Top Bottom