How do I measure Measuring Training Effectiveness? Performance evaluation?

Raffy

Quite Involved in Discussions
#1
Training

Hi everyone, :bigwave:
Can anybody from the group on how I will measure the training effectiveness? Does a follow-up audit would help to guide me on measuring such training? :confused:
Any feedback would be appreciated.
Thanks in advance,
Raffy
 
Elsmar Forum Sponsor
J

Jim Biz

#2
Just 2 cents worth

Follow-up audit would be one way.

A "final examination" test could be another.

There are most likely a number of ways to get it documented as Effective.
 
#3
Training Effectiveness

Raffy,

I read a book about 10 years ago or so by a guy named Kilpatrick (spelling). In this book, he outlined 4 levels of measuring training effectiveness. Quickly;

Level 1: Smile sheets, did the trainee enjoy the training. The worst method, no real effectiveness measured.

Level 2: Pre/Post tests. Better, it measures knowledge gain, but doesn’t answer if the trainee can perform.

Level 3: On-the-job evaluation. This is the best level (IMHO). It asks if the trainee can now perform what was trained.

Level 4: Economic impact: This measures how much the organization gained as a result of the training. Excellent idea, but there are so many competing factors in financial impact, it would be almost impossible to determine (once again, IMHO)

I checked Amazon.com. I couldn’t find any reference to the book, which makes me think I have the name wrong. Can anyone else fill in the gaps?

Dave B (the other Dave)
 

CarolX

Super Moderator
Super Moderator
#4
go with level 3

Hi Raffy,

I have to agree with Dave and say performance evaluation is the way to measure effectiveness. Really gets to the issue...did the employee learn from the training?

CarolX
 
#6
Kirkpatrick's model

Atul,

Thanks for setting me straight. I was looking for Kilpatrick, not KirkpatricK. That is why I couldn't find anything. It helps to get the name right. But when you get to be as old as I there are somethings you forget.

Dave B (the other Dave):D
 
D

David Mullins

#7
A view from downunder

1. There's a whole pile of info at the egroup on ROI. This group has been going for about 2 years and covers numerous facets of ROI, including the problmes with Kirkpatrick and his model.

worth a look before drowning in searches on the subject.

http://groups.yahoo.com/group/roinet


2. If you've done any courses in training you wouldn't be asking this question or even going down the ROI path.

Get on a "train the trainer" type course. It'll teach you about training plans, outcomes, key competencies, assessing/confirming competency, etc. This will provide objective evidence of the success, or otherwise, of the training provided.

3. The other dave certainly put it neatly into levels - which really makes it simple and clear (the way I like it). Just watch out when you go for level 4, as measures have to be meaningful and economically sound to collect and process.

Cheers.
 

Raffy

Quite Involved in Discussions
#8
First of all, I would like to thank everybody who answers on my questions.
Thank you.

Our specifications says "that all in-house trainer must undergo the training the trainer training program before conducting the training." However, with this on the specification, it limits us to provide a technical training because we must undergo first training the trainers program. That's why I'm asking questions regarding measuring training effectiveness.

I myself did not undergo the training the trainers program. My problem started when our boss transferred the responsibility with regards to training in our department. I insert a grandfathering clause in our specs.
Since I don't undergo such training, measuring training effectiveness is not clear to me.

I look the Kirkpatrick model, its great to google search. There's a lot of information on the net. It helps. I think I have to document the Kirkpatrick Model. Hmmm....I think I should have to incorporate training effectiveness in our document.

Hi CarolX, in our case, superiors perfomed "performance evaluation" annually / semi-annually.

Do we need to immediately perform performance evaluation after the training?

Originally quoted by CarolX:
"Really gets to the issue...did the employee learn from the training? "
Yes, because our productivity increased and less downtime. It is documented through our daily monitoring status and not using a form for measuring training effectiveness.

I have another thing that bothers me, "Do i need to document it using our form in measuring training effectiveness?"

Best regards,
Raffy
 

Raffy

Quite Involved in Discussions
#10
Hi Marc,
Thanks for the immediate reply. The thread is very informative, for sure it would answer all my queries. Thank you very much. and Happy New Year in advance.
Best regards,
Raffy
 
Thread starter Similar threads Forum Replies Date
S Measuring Training Effectiveness - How do you measure Effectiveness? Training - Internal, External, Online and Distance Learning 50
rob73 Advice/recommendations for equipment to measure a soft pvc tube - Optical Measuring? General Measurement Device and Calibration Topics 4
J Measuring Technique - Trying to measure on-time delivery turnaround Quality Tools, Improvement and Analysis 13
L What should we do if we can't Measure an Aspect? Measuring and monitoring Miscellaneous Environmental Standards and EMS Related Discussions 5
J Linear measuring device that can accurately measure 0.00001 or better - Suggestions? General Measurement Device and Calibration Topics 10
D What is the best gage equipment to measure an ID bore? Coordinate Measuring Machine? General Measurement Device and Calibration Topics 11
S How to measure severity if my product is designed for emergency use and failure would result in death? ISO 14971 - Medical Device Risk Management 6
A Looking for a third party to calibrate our measure equipment - South Carolina General Measurement Device and Calibration Topics 6
J Validity / outcomes measure for custom made medical device ISO 13485:2016 - Medical Device Quality Management Systems 2
D Performance specification as a Risk Control Measure, EN 14971 ISO 14971 - Medical Device Risk Management 7
J KPIs or Metrics to Measure a New Complaint Handling Process 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 5
D Torque fractional unit of measure; cN-m or N-cm? General Measurement Device and Calibration Topics 2
qualprod ISO 9001 5.1.1 - How to measure System effectiveness ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
J How to measure a Critical Characteristic that is a Basic Dimension Misc. Quality Assurance and Business Systems Related Topics 6
I Can we use pin gauges to measure an accurate Cpk ? Capability, Accuracy and Stability - Processes, Machines, etc. 9
qualprod Best criteria to measure Corrective Action effectiveness - Poor Maintenance ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
1 How to measure straightness on a HEX Long Bar Manufacturing and Related Processes 7
Ron Rompen Measurement Method Challenge - Measure feature #91 Inspection, Prints (Drawings), Testing, Sampling and Related Topics 9
G Measure 3 times, for calibration report? Customer Owned Reference Standard General Measurement Device and Calibration Topics 4
M Informational The ANSM decides, as a precautionary measure, to withdraw from the market macrotextured breast implants and breast implants with polyurethane-coated s Medical Device and FDA Regulations and Standards News 0
M Informational Health Canada advises Allergan of its intent to suspend its licences for Biocell breast implants as a precautionary measure Medical Device and FDA Regulations and Standards News 0
U SI 13 - Not Every Process Requires an Efficiency Measure IATF 16949 - Automotive Quality Systems Standard 1
P NPR Metric - What if Customer has relaxed measure? TL 9000 Telecommunications Standard and QuEST 1
T Tape Measure, the right device for 2 or 3 decimals accuracy on prints General Measurement Device and Calibration Topics 8
M How do we document and measure a service we do not provide? IATF 16949 - Automotive Quality Systems Standard 1
M For a Type 1 Gage R&R I want to use 1 unit and measure it 30 times Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
M How to Measure Paper considering Variation and Humidity General Measurement Device and Calibration Topics 10
R Height gauge to measure short hard to access heights General Measurement Device and Calibration Topics 3
D Proper Tool to Measure Wall Thickness (ISO 3611 - Micrometers) Manufacturing and Related Processes 7
S Quality Measure for Engineering Services Misc. Quality Assurance and Business Systems Related Topics 1
A What are methods and tools to measure Workload analysis ? Human Factors and Ergonomics in Engineering 1
M How do I measure variation in my process ? Capability, Accuracy and Stability - Processes, Machines, etc. 3
J How to measure process quality? Is DPPM the correct metric? Capability, Accuracy and Stability - Processes, Machines, etc. 5
M Micrometer Anvil Placement to measure the diameter of Steel Wires Measurement Uncertainty (MU) 6
S Where to Get SPC Training to Measure our Processes? Training - Internal, External, Online and Distance Learning 12
M A question on Measurement System Analysis - Stability to measure got Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
Jim Wynne Measure Twice, Cut Once: The French Railroad Snafu World News 18
S Measure water activity for fresh raw chicken meat and giblets Food Safety - ISO 22000, HACCP (21 CFR 120) 1
O Metrology Devices to Measure the Basic Dimensions of Plastic Specimens General Measurement Device and Calibration Topics 6
L How to Measure Paint Thickness for an Enclosure Manufacturing and Related Processes 5
C Chamfer Measurements - Do you measure the height and width or the hypotenuse? Manufacturing and Related Processes 15
R Repeatability in MSA - Is repeatability a measure of Location Error Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
E How can I measure three true positions? GD&T basic question General Measurement Device and Calibration Topics 5
V How to use a Calibration Certificate in Uncertainty Calculation for a Test Measure Measurement Uncertainty (MU) 13
R How do companies measure QC Productivity? Quality Manager and Management Related Issues 3
V How to measure radius without radius gages APQP and PPAP 4
A Device to measure "Straightness & Deformation" of a metal that's under water Manufacturing and Related Processes 4
M How to measure effectiveness and efficiency of the established QMS as Auditors ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 14
F Specification for how to measure lengths of hose assemblies Various Other Specifications, Standards, and related Requirements 1
P MSA requirements for Systems that Measure Process Parameters Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3

Similar threads

Top Bottom