How do I measure Measuring Training Effectiveness? Performance evaluation?

Kevin Mader

One of THE Original Covers!
Staff member
Admin
#21
Energy sums up the difference between discussion and dialogue pretty well. From my perspective, the dialogue here is equally, if not more so, valuable. Digression in an open format should be encouraged, but as any of us is capable of noticing, when both the discussion and dialogue continue, it is probably better to break out the dialogue aspect (for example, I think that I might have confused Lucinda by introducing Drucker’s definitions into the discussion, hence the changeup).

As such, I will return to the discussion of training effectiveness. If we think that we should break out the ‘definition discussion’, I will post a new thread to further explore this.

I would like to use Neelanshu’s closing comments here:

“The key to a successful training program lies in identifying training needs and finding competent trainers. Thus there should be some way of measuring how well the course contents match with the identified training needs and how "competent" the trainer is/(was?).”

I like them and I identify well with them. In days of old, I was prone to give a test at the end of a program to determine comprehension. Heck, it was what I knew since this was done to me at the end of training exercises and done to me all through school. In reality however, I only measured how well folks memorized things. Memorizing information is not knowledge and classroom exercises are more education than training. The education and training are linked through knowledge: knowledge gained and knowledge applied.

The path is: information > knowledge (education/theory) > know-how (applied theory/knowledge)

(My projection to follow): Let’s look at Neelanshu’s comment “The key to a successful training program lies in identifying training needs and finding competent trainers.” How are needs determined? Generally, they are determined through detected deficiencies. Sometimes, they are determined through projected deficiencies. Either way, needs are established and provide the frame work to determine what level of mastery is required to drive improvement (corrective or preventive). This gives us a starting point in asking key questions to the training candidate. Course content should be developed to address the needs and a trainer, with the level of mastery needed to provide such training, needs to be selected (this probably should precede content development). Course content should include education and training to be most effective in developing understanding and skills required. Exit feedback is required, the measurement of training effectiveness. This can be accomplished a number of ways.

From my perspective, I do not like to use grading/ranking systems. I use a sampling method shown to me by a close colleague that serves me well. I use a pre-sample of questions (mixed open-ended and multiple choice questions) to determine an initial starting point. The course content is built around noted deficiencies and any new information contained on the pre-sample (the pre-sample questions are developed by the individual with mastery of the skills and knowledge required to perform as expected). The course is conducted to provide knowledge base and the candidate returns to work to further develop skills. At some point after, the post-sample is done to determine how effective the education/training were based on the initial starting point. Without grades, one can determine if progress was made. Sometime follow-up education/training is required to help the associate achieve the required proficiency. In addition, the trainee is allowed to give feedback in order to improve the training process itself.

Returning to Raffy’s example of daily monitoring of status of a given process, this serves to better illustrate the effectiveness of planning for that process and the efficient execution of that plan. It only serves as a possible indicator of the success of the training. For example, if the process returns to a stable process after being found out of control where the remedial action was to bolster the training program, then one could say that the training was effective by this means (training was “doing the right thing”). However, as correctly pointed out in other posts above, there are many contributing variables to any given process. One cannot assume that training and ongoing training are the underlying reasons for improvement. You can only do so through isolation. Daily monitoring here serves as a potential source for Training and I like it because it is system driven. Through cause and effect, you may determine that the likely cause was training and you present yourself with an opportunity.

Regards,

Kevin
 
Elsmar Forum Sponsor
M

M Greenaway

#22
Quote

"For example, if the process returns to a stable process after being found out of control where the remedial action was to bolster the training program, then one could say that the training was effective by this means (training was “doing the right thing”). However, as correctly pointed out in other posts above, there are many contributing variables to any given process. One cannot assume that training and ongoing training are the underlying reasons for improvement."

If you run an intelligent corrective action program you will firstly analyse the root cause of a problem. You would not assign an arbitrary corrective action to an out of control process and then assume that your action had an effect. If you found the root cause to be lack of knowledge then your corrective action would be some form of training, for which you should see an effect on the process. Thus you could conclude with some certainty the effectiveness of the training.
 
E

energy

#24
Well, I'll be!

Originally posted by M Greenaway

This can be established through written examinations.
Who and on what?
witnessing work being carried out,
by Who?
reviewing work carried out,
by Who?
to name but a few examples that spring to mind.
Sounds like performance reviews to me! And we beat that one to death!:bonk:

Keep them coming!:ko: :smokin:
 
M

M Greenaway

#25
OK energy - sounds like we should all give up and go home then. It is very easy to sit back and pick any proposal to pieces, there are pro's and con's with everything. What would you suggest ?
 
E

energy

#26
That's the problem!

Originally posted by M Greenaway
OK energy - sounds like we should all give up and go home then. It is very easy to sit back and pick any proposal to pieces, there are pro's and con's with everything. What would you suggest ?
I'm here to learn. It's always put forth as this is how you do it, with no clear cut method of how. You get text book answers with no "experience" factor. That's all. Like you, I hope, I'm still searching for solutions, not pat answers. :bonk: Relax, it's just another day.:ko: :smokin:
 

Kevin Mader

One of THE Original Covers!
Staff member
Admin
#27
skullsike,

Be sure to include M Greenway's comments when considering if improvement is attributable to training activities conducted.

Regards,

Kevin
 
Thread starter Similar threads Forum Replies Date
S Measuring Training Effectiveness - How do you measure Effectiveness? Training - Internal, External, Online and Distance Learning 50
rob73 Advice/recommendations for equipment to measure a soft pvc tube - Optical Measuring? General Measurement Device and Calibration Topics 4
J Measuring Technique - Trying to measure on-time delivery turnaround Quality Tools, Improvement and Analysis 13
L What should we do if we can't Measure an Aspect? Measuring and monitoring Miscellaneous Environmental Standards and EMS Related Discussions 5
J Linear measuring device that can accurately measure 0.00001 or better - Suggestions? General Measurement Device and Calibration Topics 10
D What is the best gage equipment to measure an ID bore? Coordinate Measuring Machine? General Measurement Device and Calibration Topics 11
C First Article Inspections - 'how to measure' General Measurement Device and Calibration Topics 11
lanley liao Question regarding the calibration of monitoring and measure equipment. Oil and Gas Industry Standards and Regulations 0
J Should a Class 1 medical device with an option to measure body weight be considered Class 1m? EU Medical Device Regulations 0
M Gage R&R and right way to measure Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 16
P How to measure DPPM in Chemical batch manufacturing Quality Tools, Improvement and Analysis 1
silentmonkey How to measure severity if my product is designed for emergency use and failure would result in death? ISO 14971 - Medical Device Risk Management 9
A Looking for a third party to calibrate our measure equipment - South Carolina General Measurement Device and Calibration Topics 6
J Validity / outcomes measure for custom made medical device ISO 13485:2016 - Medical Device Quality Management Systems 2
D Performance specification as a Risk Control Measure, EN 14971 ISO 14971 - Medical Device Risk Management 7
J KPIs or Metrics to Measure a New Complaint Handling Process 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 9
D Torque fractional unit of measure; cN-m or N-cm? General Measurement Device and Calibration Topics 2
qualprod ISO 9001 5.1.1 - How to measure System effectiveness ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
J How to measure a Critical Characteristic that is a Basic Dimension Misc. Quality Assurance and Business Systems Related Topics 6
I Can we use pin gauges to measure an accurate Cpk ? Capability, Accuracy and Stability - Processes, Machines, etc. 9
qualprod Best criteria to measure Corrective Action effectiveness - Poor Maintenance ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
1 How to measure straightness on a HEX Long Bar Manufacturing and Related Processes 7
Ron Rompen Measurement Method Challenge - Measure feature #91 Inspection, Prints (Drawings), Testing, Sampling and Related Topics 9
G Measure 3 times, for calibration report? Customer Owned Reference Standard General Measurement Device and Calibration Topics 4
M Informational The ANSM decides, as a precautionary measure, to withdraw from the market macrotextured breast implants and breast implants with polyurethane-coated s Medical Device and FDA Regulations and Standards News 0
M Informational Health Canada advises Allergan of its intent to suspend its licences for Biocell breast implants as a precautionary measure Medical Device and FDA Regulations and Standards News 0
U SI 13 - Not Every Process Requires an Efficiency Measure IATF 16949 - Automotive Quality Systems Standard 1
P NPR Metric - What if Customer has relaxed measure? TL 9000 Telecommunications Standard and QuEST 1
T Tape Measure, the right device for 2 or 3 decimals accuracy on prints General Measurement Device and Calibration Topics 8
M How do we document and measure a service we do not provide? IATF 16949 - Automotive Quality Systems Standard 1
M For a Type 1 Gage R&R I want to use 1 unit and measure it 30 times Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
M How to Measure Paper considering Variation and Humidity General Measurement Device and Calibration Topics 10
R Height gauge to measure short hard to access heights General Measurement Device and Calibration Topics 3
D Proper Tool to Measure Wall Thickness (ISO 3611 - Micrometers) Manufacturing and Related Processes 7
S Quality Measure for Engineering Services Misc. Quality Assurance and Business Systems Related Topics 1
A What are methods and tools to measure Workload analysis ? Human Factors and Ergonomics in Engineering 1
M How do I measure variation in my process ? Capability, Accuracy and Stability - Processes, Machines, etc. 3
J How to measure process quality? Is DPPM the correct metric? Capability, Accuracy and Stability - Processes, Machines, etc. 5
M Micrometer Anvil Placement to measure the diameter of Steel Wires Measurement Uncertainty (MU) 6
S Where to Get SPC Training to Measure our Processes? Training - Internal, External, Online and Distance Learning 12
M A question on Measurement System Analysis - Stability to measure got Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
Jim Wynne Measure Twice, Cut Once: The French Railroad Snafu World News 18
S Measure water activity for fresh raw chicken meat and giblets Food Safety - ISO 22000, HACCP (21 CFR 120) 1
O Metrology Devices to Measure the Basic Dimensions of Plastic Specimens General Measurement Device and Calibration Topics 6
L How to Measure Paint Thickness for an Enclosure Manufacturing and Related Processes 5
C Chamfer Measurements - Do you measure the height and width or the hypotenuse? Manufacturing and Related Processes 15
R Repeatability in MSA - Is repeatability a measure of Location Error Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
E How can I measure three true positions? GD&T basic question General Measurement Device and Calibration Topics 5
V How to use a Calibration Certificate in Uncertainty Calculation for a Test Measure Measurement Uncertainty (MU) 13
R How do companies measure QC Productivity? Quality Manager and Management Related Issues 3

Similar threads

Top Bottom