ISO9000 Performance Metrics

Marc

Hunkered Down for the Duration
Staff member
Admin
#1
Subject: Re: Q: Metrics For ISO Performance /../Peter/Russo/Hodges
Date: Wed, 30 Dec 1998 12:17:26 -0600
From: ISO Standards Discussion

From: Jrhodges
Subject: Re: Q: Metrics For ISO Performance /../Peter/Russo/Hodges

It is true that 'quality systems' and 'business management systems' are inseparatable; however, no matter what terminology you call it there is a need to measure performance. Project manager's use cost, schedule, and performance to ascertain their failures and success. Why shouldn't the ISO Representative do the same -- just ensure the metrics he/she uses is not based on emotionalism but fact of data?

I use several metrics to ascertain the performance of those elements in which I am ultimately responsible (i.e., Management Responsibility, Quality System, Corrective and Preventive Action, and Internal Audits).

Management Systems - bar graphs showing the attendance of functional
areas and project/program management representatives at quality
meetings.

Quality System - Pareto charts showing the findings related to element
4.2 (e.g., finding not related to a specific element like 15,
procedures/processes not being used, etc)

Corrective and Preventive Action - A cumulative bar chart showing
(by month) the number of corrective and preventive actions opened,
overdue, and closed as well as a chart of all elements regarding Root
Cause quantities.

Internal Audits - A pareto analysis of last year's findings compared
to this year's finding and each audit showing the areas of findings.
This provides a clear picture -- try it.

Last but not least, I developed a nine question opinion survey which I provide to all of the management and project representatives. This opinion survey addresses all of the aforementioned areas (with validity questions) as well as Training. I ask their opinion and then develop a Radar Chart for presentation.

I find the results (anonymous) usually match the metrics -- what people say in private matches the results. If they don't truly support the ISO program, the metrics and radar chart clearly shows it.

If you have any questions, feel free to contact me.

Jake Hodges
Quality Manager & Adjunct Faculty
 
Elsmar Forum Sponsor

Marc

Hunkered Down for the Duration
Staff member
Admin
#2
Subject: Re: Q: Metrics For ISO Performance /../Peter/Russo/Hodges/Scalies
Date: Wed, 6 Jan 1999 11:04:59 -0600
From: ISO Standards Discussion

From: Charley Scalies
Subject: Re: Q: Metrics For ISO Performance /../Peter/Russo/Hodges/Scalies

SNIP....ISO Standards Discussion wrote:

> I use several metrics to ascertain the performance of those elements in which
> I am ultimately responsible (i.e., Management Responsibility, Quality System,
> Corrective and Preventive Action, and Internal Audits).

Are these the only metrics you are using for these elements? My comments (following) assume they are.

> Management Systems - bar graphs showing the attendance of functional
> areas and project/program management representatives at quality
> meetings.

I once worked for a company where very little real progress was made because everyone was always in meetings. How does this metric confirm/refute that you're system is effective at meeting the intent of 4.1?

> Quality System - Pareto charts showing the findings related to element
> 4.2 (e.g., finding not related to a specific element like 15,
> procedures/processes not being used, etc)

This has some limited value, but IMHO an effective quality system is not a collection of 20 disparate elements, but is one thing. Are your inquiries limited to "documenting what we do" or do they extend to measuring the effectiveness of the documented system at achieving the desired results? Can we assume that there are others in your organization who are responsible for other micro elements? And who is responsible for determining if the whole thing works? That's what it really is all about.

> Corrective and Preventive Action - A cumulative bar chart showing
> (by month) the number of corrective and preventive actions opened,
> overdue, and closed as well as a chart of all elements regarding Root
> Cause quantities.

Again this has some limited value. However, how would you interpret a sharp reduction in the number of CARs/PARs opened? Is that "good" - the system is performing better - or "bad" - we stopped counting?

> Internal Audits - A pareto analysis of last year's findings compared
> to this year's finding and each audit showing the areas of findings.
> This provides a clear picture -- try it.

Limited value. Findings without verified causes are just clues.

> Last but not least, I developed a nine question opinion survey which I provide
> to all of the management and project representatives. This opinion survey
> addresses all of the aforementioned areas (with validity questions) as well as
> Training. I ask their opinion and then develop a Radar Chart for
> presentation.
> I find the results (anonymous) usually match the metrics -- what people say in
> private matches the results. If they don't truly support the ISO program, the
> metrics and radar chart clearly shows it.

If people don't truly support the quality program, the nonfulfillment of the quality policy will show it.That's the Prize! My experience demonstrates that unless you are measuring at the macro level (i.e the forest) you will get lost in the trees.

Here is my challenge to anyone who cares to accept it.
1. Boil your quality policy down to its essence: 25 words or less.
2. Then list no more than five "discernables" you would assess or measure
that tell how well you are achieving that policy.

Charley
 

Marc

Hunkered Down for the Duration
Staff member
Admin
#4
Yeah - I like Charley's comments a lot of the time, too. He generally has a come back.

Metrics issues interest me a lot right now, which is why I threw this up for comment.
 

barb butrym

Quite Involved in Discussions
#5
If people don't truly support the quality program, the nonfulfillment of the quality policy will show it.That's the Prize! My experience demonstrates that unless you are measuring at the macro level (i.e the forest) you will get lost in the trees.

Here is my challenge to anyone who cares to accept it.
1. Boil your quality policy down to its essence: 25 words or less.
2. Then list no more than five "discernables" you would assess or measure
that tell how well you are achieving that policy.
----------------------------------------

YUP...thats the way I do it all the time...any more and you get lost...Less is More....my favorite quote
 

Kevin Mader

One of THE Original Covers!
Staff member
Admin
#6
Charlies comments are appropriate. I also especially like the comments made on the creation of the Quality Policy and the discernables. Short, realistic, and belivable would be my three key inputs in the creation of the Quality Policy and the key Quality System measurables. Keep it simple but effective (to Barb's point, less is more!).
 
Thread starter Similar threads Forum Replies Date
C ISO9000 and CWF (Certified Welding Fabricator) ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
L Innovation in Quality as applied to ISO9000 ISO14000 or TS16949 Service Industry Specific Topics 1
L Vertical vs Horizontal Integration ISO9000 QMS ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 7
C Explain to me the differences between ISO9000 and TQM ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 9
M ISO9000.3:2004 vs. AS9100 - What are the Differences? AS9100, IAQG 9100, Nadcap and related Aerospace Standards and Requirements 4
ScottK Which ISO9000 Registrar would you pick? (Hypothetical Situation) ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
M Certification of a Group Corporation - ISO9000/14000 vs. SONY GP certification ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 15
B The new Terms and Definitions in ISO9000:2005 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 3
Randy ISO9000:2005 vs. ISO9000:2000 - Differences and Changes ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
E Franchise of ISO9000 certified organization ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 29
M ISO9000 presentation help ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
M ISO9000 Training Presentation - Seeking introductory presentation on ISO9000 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 3
A How much objective evidence is required for ISO9000 certification? Records and Data - Quality, Legal and Other Evidence 8
N Signature for CAD / Engineering Drawings and ISO9000 requirements Quality Assurance and Compliance Software Tools and Solutions 3
S Changing from ISO9000 to ISO9001:2000 need help ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
B Deployment of an "ISO9000-ready" QMS - Multi-facility site ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
P Looking for subject matter for thesis about TQM, ISO9000, TS19649 IATF 16949 - Automotive Quality Systems Standard 4
J Can We Exclude ISO9000:2000 Clause 7.3.7 (Control Of Design And Development Changes)? Design and Development of Products and Processes 7
D Document Issue & Control in ISO9000-3 - Medical software ISO 13485:2016 - Medical Device Quality Management Systems 4
Y ISO9000-3 - Software Traceability Requirements ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
J ISO9000:2000 Scope Statement ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
B Are ISO9000 certificates ever withdrawn? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
Q Each ISO9000:2000 requirement has intent? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
A What is the difference between Validation & Verification in the context of ISO9000? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
M ISO 9001:2006 - What is the future of ISO9000? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 19
L ISO9000 Implementation in Schools and Educational Institutions ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
S How are you undertaking Supplier assessment and Educating Upper Management in ISO9000 Supplier Quality Assurance and other Supplier Issues 13
Geoff Cotton ISO9000: 2000 What are the changes? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
D QS-9000 / ISO9000 Procedures - Four Questions about Requirements Document Control Systems, Procedures, Forms and Templates 1
M ISO9000 certification in education - Higher end post graduate degree school ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
P Question for ISO9000 auditor training General Auditing Discussions 3
D Lucrative Rubber Stamp - I was once very impressed with ISO9000 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
B ISO9000 Expert Witness work with the legal profession ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
J TS 16949 - QS9000 - ISO9000:2000 QS-9000 - American Automotive Manufacturers Standard 2
K ISO9000:2000 & TS16949 EFFECTS ON QS9000 QS-9000 - American Automotive Manufacturers Standard 1
K Guidelines for implementing ISO9000 in education - ISO 21001:2018 Update June 2019 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
K Are ISO9000 and QS-9000 Quality Control or Quality Assurance Systems? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 9
A Industrial Deaths & ISO9000 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 14
Marc The Quality Farce - ISO9000, QS9000, Six Sigma, TQM, Fishbone Diagrams, etc. Philosophy, Gurus, Innovation and Evolution 17
P Will ISO 10013:1995 be revised, as a consequence of the ISO9000 revision? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
Marc Auditing R&D for ISO9000 General Auditing Discussions 1
Marc Implementing ISO9000 - Timeline showing major milestones ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 0
Marc ISO9000:2000 and QS9000 QS-9000 - American Automotive Manufacturers Standard 2
Marc Definition Process Audit - Internal and External - ISO9000 - A Definition Definitions, Acronyms, Abbreviations and Interpretations Listed Alphabetically 7
T How many companies are giving up ISO9000 registration? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
Marc ISO9000:2000 Update ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 0
F TickIT vs. ISO9000-3 vs. ISO 9001 - What are the Differences? Software Quality Assurance 7
Marc New ISO9000 E-Mail ListServe ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 0
Marc ISO9000 Internal Audit Requirements Internal Auditing 2
Marc ISO9000 Registration in Educational Institutions ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
Similar threads


















































Top Bottom