The Elsmar Cove Business Standards Discussion Forums More Free Files Forum Discussion Thread Post Attachments Listing Elsmar Cove Discussion Forums Main Page
Welcome to what was The Original Cayman Cove Forums!
This thread is carried over and continued in the Current Elsmar Cove Forums

Search the Elsmar Cove!

Wooden Line
This is a "Frozen" Legacy Forum.
Most links on this page do NOT work.
Discussions since 2001 are HERE

Owl Line
The New Elsmar Cove Forums   The New Elsmar Cove Forums
  QS-9000
  Measuring Training Effectiveness

Post New Topic  Post A Reply
profile | register | preferences | faq | search

UBBFriend: Email This Page to Someone! next newest topic | next oldest topic
Author Topic:   Measuring Training Effectiveness
Steven Sulkin
Forum Contributor

Posts: 75
From:Columbus, Ohio
Registered:

posted 29 June 1998 04:13 PM     Click Here to See the Profile for Steven Sulkin   Click Here to Email Steven Sulkin     Edit/Delete Message   Reply w/Quote
How do you folks meet this requirement?

IP: Logged

Marc Smith
Cheech Wizard

Posts: 4119
From:West Chester, OH, USA
Registered:

posted 29 June 1998 04:28 PM     Click Here to See the Profile for Marc Smith   Click Here to Email Marc Smith     Edit/Delete Message   Reply w/Quote
There are lots of ways to 'measure' training effectiveness.

It depends upon the training. On the job training versus (for example) managers training. You have to look at the training. Some OJT is a matter of observation by the trainer. Some OJT (particularly for 'hi-tech' jobs) is verified by certification testing.

I suggest you check out the following from the 'old' forum:

A Short Relevant Thread

and

A *Better* Relevant Thread - Do read this one!

Then come back to this forum with more specific questions! Hope this helps!
[Note: This message was edited by Marc Smith]

IP: Logged

Ram narayan
Lurker (<10 Posts)

Posts: 8
From:Chennai,TamilNadu, India
Registered:

posted 15 July 1998 04:24 AM     Click Here to See the Profile for Ram narayan   Click Here to Email Ram narayan     Edit/Delete Message   Reply w/Quote
Mr. Stevan and Mr. Mark,

I would like to share with you one of my approaches for measuring Training effectiveness. As such, measuring training effectiveness is highly subjective but some sort of approach can be followed as follows:

1. One week after the completion of the training programme, a feedback should be obtained from the students/participants on how much of knowledge they had gained during training are they retaining. We all know, that we tend to forget things if not implemented immediately. This feedback is only to check whether they have got sufficient knowledge for implementation. People generally forget 70% of things they learnt within one week.

2. After 3 months, a feedback should be obtained for the effective implementation of the training got. This is to check how they are using what they have learnt. Whether any additional training has to be given or some sort of help is required.

3. After 6 months, the training effectiveness should be monitored using Performance Appraisal by the respective Department Managers. The effectivenss of the training they have got should be linked to their appraisal system, because I feel that then only the training will be very effective.

The above is one of the many methodologies. I am expecting your comments on this.

IP: Logged

Marc Smith
Cheech Wizard

Posts: 4119
From:West Chester, OH, USA
Registered:

posted 16 September 1999 08:28 PM     Click Here to See the Profile for Marc Smith   Click Here to Email Marc Smith     Edit/Delete Message   Reply w/Quote
Subject: Training Effectiveness
Date: Thu, 16 Sep 1999 15:53:25 -0400
From: "Kelly Speiser"
To: "QS List Post"

QS Listserv Members: I pass this along from a Training Listserv for which I am a member. I thought this is of specific interest to those complying with ISO.

"If you are involved in measuring the effectiveness of training, this might be of interest. The U.S. Department of Energy (DOE) and Westinghouse are making TRANS-MEASURE, a transfer of training measurement and improvement tool, available to U.S. businesses, consultants, educational institutions, government agencies, non-profit organizations, and individual citizens at no-cost to recipients through a federal sharing program. TRANS-MEASURE provides organizations with the following information for their training courses:

+ Transfer of Training Rate -- the percentage of skills successfully transferred from the learning setting to the job.
+ Prior Knowledge Rate -- the percentage of skills that trainees already knew how to perform before taking the training.
+ "Didn't Stick" Rate -- the percentage of skills presented in a training course that the trainee cannot perform six months after training.
+ Value-Added Rating -- the amount of skills critical to the success of the organization learned during the training and performed frequently on themjob.

TRANS-MEASURE is an streamlined, user-friendly offspring of the Westinghouse-developed Transfer of Training Evaluation Model. This is a complete, turnkey package that can be administered by nearly every type of organization with no modification necessary. To obtain TRANS-MEASURE at no cost, fill out an application at the DOE/Westinghouse technology transfer website:"
http://www.t2ed.com

Forwarded to you by
Kelly Speiser
Jackson MI

IP: Logged

Andy Bassett
Forum Contributor

Posts: 274
From:Donegal Ireland
Registered: Jun 1999

posted 17 September 1999 04:04 AM     Click Here to See the Profile for Andy Bassett   Click Here to Email Andy Bassett     Edit/Delete Message   Reply w/Quote
I am interested in the Training Effectiveness Model mentioned above, i have registered and requested the notes, but being Ireland based i am not sure they will give it to me.

Can anybody tell me what it is all about?. Is it a software package, or a questionnaire that tests employees on what they have learnt from the training.?

Regards

------------------
Andy B

IP: Logged

Marc Smith
Cheech Wizard

Posts: 4119
From:West Chester, OH, USA
Registered:

posted 17 September 1999 05:42 AM     Click Here to See the Profile for Marc Smith   Click Here to Email Marc Smith     Edit/Delete Message   Reply w/Quote
I don't know myself. You might want to contact the sender of the info --> "Kelly Speiser" whose e-mail is pqc@jacksonmi.com

[This message has been edited by Marc Smith (edited 17 September 1999).]

IP: Logged

Sam
Forum Contributor

Posts: 244
From:
Registered: Sep 1999

posted 29 September 1999 10:16 AM     Click Here to See the Profile for Sam   Click Here to Email Sam     Edit/Delete Message   Reply w/Quote
Just downloaded the info Kelly is talking about; passed it around and received positive feedback for content and "user friendly" format.

IP: Logged

Marc Smith
Cheech Wizard

Posts: 4119
From:West Chester, OH, USA
Registered:

posted 19 March 2000 06:32 PM     Click Here to See the Profile for Marc Smith   Click Here to Email Marc Smith     Edit/Delete Message   Reply w/Quote
Date: Wed, 15 Mar 2000 12:39:09 -0500
From: Mike Tillmans EyeDee@aol.com
Subject: Re: TQM--- tRAINING EFFECTIVENESS MEASUREMENT

On 3/13 Anil writes:

<< I would be very thankful if you could give your views on these points:

How is training effectiveness measured?

Is it done through a questionnaire? or by the boss on the performance?

After what time frame this is to be done?

Any standard/Guideline available to control this .>>

Several years ago Kirkpatrick identified four levels of measures of training
effectiveness that are widely used in business training. Although I'm not
restating them exactly, you'll get the picture.

Level 1: student opinion--collected in end-of-course student questionnaires

Level 2: student learning--test data collected by performance tests at the end ofthe course or by activities during the course

Level 3: impact on the job--follow up survey/test/study is done to determine how well the skills are applied on the job

Level 4: impact on the business--study is done to see how the skills contributed to the business growth/profitability/customer service/etc.

Each level gives you more important information, but each level is usually harder (read: more time consuming and expensive) to collect and interpret. If this looks useful to you, I'll dig out the original reference and/or some of the recent articles written on his approach.

Mike Tillmans, Director of Training
Wizdom Systems, Inc. 630-357-3000 x-3056
tillmans@wizdom.com www.wizdomsystems.com

IP: Logged

Marc Smith
Cheech Wizard

Posts: 4119
From:West Chester, OH, USA
Registered:

posted 19 March 2000 06:33 PM     Click Here to See the Profile for Marc Smith   Click Here to Email Marc Smith     Edit/Delete Message   Reply w/Quote
Also see https://elsmar.com/ubb/Forum1/HTML/000259.html

[This message has been edited by Marc Smith (edited 05 May 2001).]

IP: Logged

Marc Smith
Cheech Wizard

Posts: 4119
From:West Chester, OH, USA
Registered:

posted 19 March 2000 06:57 PM     Click Here to See the Profile for Marc Smith   Click Here to Email Marc Smith     Edit/Delete Message   Reply w/Quote
From: ISO Standards Discussion
Date: Thu, 16 Mar 2000 09:41:22 -0600
Subject: Re: ISO 9000- Training Effectiveness /../Arbuckle

From: Don Arbuckle iso9kda@doitnow.com

Without trying to present a seminar on training and training evaluation, let me see if I can help here. The first step in evaluation training is to establish what the outcome is supposed to be. This is done by defining objectives for the training itself, whether they are knowledge or behavioral based. With objectives defined, then the measurement and metrics can be established to determine if the training had the desired effect. All of this can sound very time consuming until you apply it realistically to real business.

Typically training is offered as a method for change. If the change happened, then the training was effective. For example, the change is to enable the employee to operate the equipment according to procedure(s) XYZ001 (and XYZ003...XYZ005). When the training is completed, the trainer, or other authorized personnel, evaluates if the employee can perform the operation as required by the document. Whether the training was classroom or OJT, the verification is the same...the evaluator reviews performance and determines if it is done correctly. If so, then the training was effective. If not, then the training was not effective and needs modification (time for a CAR?).

For those of you familiar with the Kirkpatrick Model of Evaluation of Training, we are really talking about a level four evaluation. (1=reaction; 2=learning; 3=behavior; 4=results). While Kirkpatrick goes into more detail than I would ever suggest to any of you, it is a good model to follow. For more detail please feel free to contact me.

Don Arbuckle
iso9kda@doitnow.com

--------------snippo----------------

From: ISO Standards Discussion
Date: Thu, 16 Mar 2000 09:43:50 -0600
Subject: Re: ISO 9000- Training Effectiveness /../Kiely/Humphries

From: Edwin Humphries edwin@e-quality.com.au

> From: GKiely@kanzakiusa.com
>
> At a recent ISO 9001:2000 Transition Seminar that I attended the issue of
> "effectiveness" was a hot topic of discussion. This seminar was attended by
> quality management professionals from all levels as well as by Auditors
> from our assessing body. When asked, the Auditor's stated that they would
> by definition be looking for some type of "quantifiable" measure to
> illustrate what the Organization (formerly called the supplier) considers
> "effective"...

Why am I generally unsurprised? ISO does NOT specify quantifiable measures ANYWHERE; but I'm sure you're right: auditors will take it on themselves to define how their clients must interpret the Standard. I guess it's up to us (still) to defend the territory of "reasonableness".

> The Auditors stopped just short of saying that a test score would suffice...

I would hope so (although what other type of quantifiable measure is there?). Can you imagine running tests in every aspect of training?

> I believe the more pressing issue however will be with how
> our individual assessing bodies interpret the words "competent" and
> "competency" (hopefully these words will be dropped from the final draft).

I have less problems with these: the world is heading towards using these concepts, and they have a value if implemented reasonably (that word again!).

Best Regards
Edwin Humphries
edwin@e-quality.com.au

IP: Logged

All times are Eastern Standard Time (USA)

next newest topic | next oldest topic

Administrative Options: Close Topic | Archive/Move | Delete Topic
Post New Topic  Post A Reply Hop to:

Contact Us | The Elsmar Cove Home Page

Your Input Into These Forums Is Appreciated! Thanks!


Main Site Search
Y'All Come Back Now, Ya Hear?
Powered by FreeBSD!Made With A Mac!Powered by Apache!