Simplifying ISO9001 Auditing by using PIs (Performance Indicators)

Brian Hunt

Involved - Posts
#1
I'm doing procss improvement work in an organisation that has previouisly created procedures for everything that can be thought of. So there are over 350 documented procedures which is far too much! And a lot of associated auditing which tends to take a compliance approach both in internal and external (BSI) forms

I think that defining process capability and performance indicators would mean that if the metrics showed that the process was under control, the need for documented procedures (other than the six mandatory ones) and audits would be significantly reduced.

In other words, if the right outputs are being achieved, then the proces is under control.

Is anyone else taking this approach and what learning points can they share?
 
Last edited:
Elsmar Forum Sponsor
#2
Re: Simpliying ISO9001 auditing by using PIs

We follow a similar approach of monitoring the outputs. Continual improvement of the performance indicators and raising the benchmark is something that you can look at if you have not already.

350 procedures definitely seem a LOT, although I'm not sure of the size or complexity of that organization you are referring to.

Thanks,
Deepak
 

John Broomfield

Staff member
Super Moderator
#3
Brian,

Your 350 procedures may not have benefited from the application of clause 4.1c (and clause 4.2.1d).

But relying on measuring the outputs of processes is not preventive.

Get the inputs right and the process right and the outputs are bound to be right.

Corrected cost of quality curves, from the fifth edition of Juran on, tell us that only by investing in prevention do we get the lowest cost.

John
 

Marcelo

Inactive Registered Visitor
#4
This seems to me like one past client that was not really sure what to document and so documented everything, and after years, always said that it was required by "someone", be it a regulatory agency, certification body, everything.

Worse, the procedures were usually not really needed and most where out of date related to current practice because, between us, to really maintain 350 procedures you would need some people focused 24/07 on then.

My solution at the time was to remap the processes and system (they did?t do that before, there was no system planning, they though planning and creating the quality system meant to create the procedures - very common mistake), but in the end we did not even finish that because people had a lot of trouble with the concept of process mapping and they wanted to KEEP a lot of the procedures, even if they were not using or updating them correctly.

But in my opinion we could have removed some 80 % or more or all the procedures.


Also, take a look at this post: http://elsmar.com/Forums/showpost.php?p=558952&postcount=6
 
Last edited:

Brian Hunt

Involved - Posts
#5
Re: Simpliying ISO9001 auditing by using PIs

Hi Deepak - It's a public sector organisation that maintains existing facilities and does some new projects. Not pushing the frontiers of technology.
 

Brian Hunt

Involved - Posts
#6
Hi John. My approach is measure, analyse, improve. So that addresses preventative action and continuous improvement. But the organisation also needs the right culture and approach. Too many see quality as a tick box activity
 

Brian Hunt

Involved - Posts
#7
Hi Marcelo

This seems to me like one past client that was not really sure what to document and so documented everything, and after years, always that it was required by "someone", be a regulatory agency, certification body, everything.

Yes - this is the case here. A 'consultant' (spit) told them to document everything and then bought in an army of his buddies to do this. Then the external auditor (BSI) backed up this approach - even though a process approach is supposed to be followed.

Worse, the procedures were usually not really needed and most where out of date which current practice because, between us, to really maintain 350 procedures you would need some people focused 24/07 on then.

That's what happens
My solution at the time was to remap the process and system (they did?t do that before, there no system planning, they though planning and creating the quality system meant create the procedures - very common mistake), but in the end we did not even finished that because people had a lot of trouble with the concept of process mapping and they wanted to KEEP a lot of the procedures, even if they were not using of updating them correctly.

Yes - tear it up and start again. My initial findings suggest that only about 20% of these are needed - if that.

But in my opinion we could have removed some 80 % or more or all the procedures.
 
#8
Brian:

Don't take it out on the consultant - blame the people who foster a "say what you do, do what you say" approach to management systems! But you are right, and it's actually quite normal to over document - clients do it without any outside help, too!

Internal auditing SHOULD take into consideration the "planned arrangements" - from objectives, customer requirements, inputs, process, outputs and results, of course. Simply looking at results isn't going to be validation of the process however - or the need for any documents to define the process and its control.

Don't overlook the fact that as an auditor, you are there to validate management choice of process/controls etc.
 

John Broomfield

Staff member
Super Moderator
#9
Hi John. My approach is measure, analyse, improve. So that addresses preventative action and continuous improvement. But the organisation also needs the right culture and approach. Too many see quality as a tick box activity
Brian,

Yes, I wondering how your improvement cycle would work if the process-based management system focused only on process output.

I am sure your colleagues could agree that their management system is meant to help them to determine and meet requirements.

Through this focus on requirements they can eventually understand the true nature of quality but let them realize this for themselves.

Quality is personal. Commitment to deliver quality has to come from within.

Best wishes,

John
 

RoxaneB

Super Moderator
Super Moderator
#10
I look at both documented processes and the metrics.

As much as I believe that documentation is not always needed, the organization I am with currently lacks in the area of standardization and effective training, so we're going down the route of documenting our core activities.

When it comes to evaluating metrics, I look beyond the "hitting target or not" trait. I also look for a positive historical trend over several years, if the site is the benchmark, if their metrics is aligned with the company metric, etc.

To keep this simple, I essentially plot a location's conformance to process and achievement of metric requirements. If they fall in the upper right (excellent performance in both), life is great! If they conform to process but aren't achieving metric requirements, we discuss things like technology, outliers, etc.. If they are achieving metric requirements but are not following the process, we discuss what they are doing differently and why (and corporately, we decide if that will become the new standard). And if they are not excelling in either area, we have really big discussion.

To audit only metrics does not allow for a in-depth discussion on procedure accuracy and applicability. To discuss only the procedure means results are ignored. The two together are what (hopefully) result in a good output for and from a process.
 
Last edited:
Thread starter Similar threads Forum Replies Date
G Simplifying Supplier Surveys and the time they take to be completed Supplier Quality Assurance and other Supplier Issues 15
M Simplifying Supplier Evaluations for hundreds of Suppliers Supplier Quality Assurance and other Supplier Issues 6
K Simplifying QMS for small machine shop? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 12
T COVID, Furlough and ISO9001 Surveillance Audit Coffee Break and Water Cooler Discussions 1
S Are there ISO9001:2015 Requirements for Preventive Maintenance? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 36
D ISO9001 for one man company ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
S What's meant by ISO9001 clause 8.7 non conforming output? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
A ISO9001:2015 Document control and training aids ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 7
G Calibration: Conforming to ISO9001 Requirements General Measurement Device and Calibration Topics 6
H Communication plan according to ISO9001 - Pharmaceutical field Pharmaceuticals (21 CFR Part 210, 21 CFR Part 211 and related Regulations) 3
R Major nonformance finding was given during a closing meeting of a ISO9001 certification audit General Auditing Discussions 76
S ISO9001:2015 Clause 9.1 - What the external auditor will look at? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
N Is consultant prohibited in ISO9001 audit? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 66
S ISO9001:2015 6.3 - Planning of Changes - OFI from auditor ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 20
I ISO9001:2015 9.1.2 - Customer Satisfaction Feedback ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
L Is writing out the ISO9001:2015 standard full name a requirement ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 37
R ISO13485/ISO9001 Convenient Document Management System Document Control Systems, Procedures, Forms and Templates 3
E Interesting Discussion Was this the fastest ever stage 2 ISO9001:2015 audit? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 76
R ISO9001 & ISO13485 QMS for 2 types of products ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 3
ScottK Question for Auditors on 7.1.4 in the ISO9001:2015 revision ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
T In house Calibration? Measurement equipment traceability requirements - ISO9001 General Measurement Device and Calibration Topics 12
qualprod ISO9001:2015 Cl. 9.1.1 and 9.1.3 evidenced with only improvement actions? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
a_bardi Excluding ISO9001 Cl. 8.4 - Supplier Selection and Evaluation ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
G Effect of ISO9001 2015 transition on ISO IEC 80079-34 Other ISO and International Standards and European Regulations 2
A ISO9001:2015 Process Matrix with clauses General Auditing Discussions 13
S ISO9001:2015 Cl. 4.4.1 - What Processes Do I Need Documented ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
Q ISO9001:2015 Cl. 6.1 - What evidences of risk addressing is needed? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
B Bare Bones/Under the Radar ISO9001:2015 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
W Is ISO9001:2015 required for AS9100:2016 AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 2
Icy Mountain ISO9001:2015 & IATF 16949:2016 Gap Analysis Tool IATF 16949 - Automotive Quality Systems Standard 7
D Internal Audit During the Transition Period from ISO9001:2008 to ISO9001:2015 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
M Can Six sigma support ISO9001? If yes, in what ways? Lean in Manufacturing and Service Industries 5
D Does ISO9001:2015 require any specific "processes"? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 3
N ISO9001:2015 clause 7.1.5 "Resources" (Formerly "Equipment") ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
Icy Mountain ISO9001:2015 Upgrade Diary ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 9
S ISO9001:2015 and ISO14001:2015 Readiness/Self Evaluation Checklists wanted ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
J Understanding ISO9001:2015 - 8.3: Design and Development of Products and Services ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 3
W ISO9001:2015 - Clause 7.5.2 - Requirements for Creating & Updating Documents ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
C Process Map Transition from ISO9001:2008 to ISO9001:2015 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
A ISO9001:2015 Auditor Training Materials Training - Internal, External, Online and Distance Learning 2
M ISO9001:2015 Clause 8.4 Control of External Processes and Purchased Goods & Materials ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
L Corporate Manual - Global Multi-Site ISO9001:2015 Certification ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
A ISO9001:2015 comparison with AS9100:2016 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
C Auditing Clause 5 - Leadership in ISO9001:2015 Internal Auditing 4
S Informational ISO9001:2015 Process Interactions ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 65
S ISO9001:2015 Section 4.4.1 - Support Processes ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
C Checklist comparison between ISO9001:2008 and ISO 3834 Quality Management System (QMS) Manuals 1
Y The challenge of why should we have ISO9001 and process audit ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
G BCARs/EASA to ISO9001/AS9100 cross reference matrix/table wanted EASA and JAA Aviation Standards and Requirements 1
C Risks involved in requesting Cert to ISO9001:2015 right when released ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2

Similar threads

Top Bottom