SBS - The best value in QMS software

Acceptance Criteria - ISO 9001:2008 Clause 8.2.4 - Questionable Audit Finding?

Sidney Vianna

Post Responsibly
Staff member
Admin
#31
Am I missing something?
Thanks for the lively discussion you triggered. In principle, I agree with your position, but what kind of products are we talking about here? Plastic injection? Metal machined parts? Done by automated equipment? Context is always helpful.

In a "commercial setting", ISO 9001-compliant environment, initials and dates to the side of the operation in a router/traveler document as the means to show that the operation has been completed and accepted is a normally accepted practice.

If the auditor is concerned about the operators/inspectors competence in establishing product conformity, s/he can always ask them to show how they inspect the parts.

As you move towards AS9100, and if in the presence of potential critical items/key characteristics, you will have to change your approach. Key characteristics features will have to be recorded. Also, sampling inspection would have to be carefully evaluated, according to AS9100.
 
Elsmar Forum Sponsor

Jim Wynne

Staff member
Admin
#32
Thanks for the lively discussion you triggered. In principle, I agree with your position, but what kind of products are we talking about here? Plastic injection? Metal machined parts? Done by automated equipment? Context is always helpful.

In a "commercial setting", ISO 9001-compliant environment, initials and dates to the side of the operation in a router/traveler document as the means to show that the operation has been completed and accepted is a normally accepted practice.

If the auditor is concerned about the operators/inspectors competence in establishing product conformity, s/he can always ask them to show how they inspect the parts.

As you move towards AS9100, and if in the presence of potential critical items/key characteristics, you will have to change your approach. Key characteristics features will have to be recorded. Also, sampling inspection would have to be carefully evaluated, according to AS9100.
Except to ask for clarification in the beginning I haven't responded in this thread, and now there's no point in doing so. Sidney said what I would have, only more better. :D
 

Wes Bucey

Prophet of Profit
#33
Yes thank you, that's why I described "first piece" the way I did. No it's not specifically required - but it's being done anyway, perhaps as a good practice or a simple step to avoid making a bunch of scrap after a tool change.

And, since the inspection is being performed and the first piece accepted (as a part of the informal sampling plan) it does qualify to be an inspection, monitoring the process as per 8.2.3, "demonstrating the process's ability to achieve planned results." If that wasn't the intended purpose of the inspection, I'd like to be corrected but if I was auditing I would then ask how 8.2.3 is being done, if not through inspection.

So, since it is an inspection I would expect it to adhere to 8.2.4.

I think the center of our discussion is the defense of doing only what the standard/customer requires, versus the kind of good practices that can actually help us keep tight control of our processes and improve our bottom line. The standard is designed to provide a framework for a management system to do that, not just provide a set of requirements to be met.
So, Jim. As a Certification Body auditor, the fundamental principles on which ISO 9001 is built are a "red herring" and "irrelevant"? You, as an auditor, never let them enter into the thought process of evaluating a QMS for effectiveness?

I wonder, then, if so deemed irrelevant to a question about ISO 9001, why did the folks at TC 176 write the 8 Principles? Do you know more than they do?:popcorn:
Perhaps you would like to tell us, and while you are at it, explain why they left it out of the standard. I have not found any material on the topic. If you have some, please share it, but open another thread to do so.

My comment on irrelevance only applies to the discussion at hand. You have broadened it far beyond there. A discussion of the eight principles don't belong in a discussion about requirements of the standard when they are not addressed in the standard. That's what made it a red herring. Attempting to amplify the red herring does not remove it. It is nothing more than a continued attempted of a smoke screen. Creating a bigger diversion is just that, amplifying the diversion.

Let's stay on topic.
Sidney and Jim W. make some points, but Big Jim is on point in remarking the auditor in this thread's case has not cited a valid clause in either the Standard, the supplier's processes, or the customer's requirements which were violated.

Andy is absolutely accurate in pointing out that "good practice" would/should suggest the kind of record-keeping my own shop did routinely, but at best, the auditor "might" suggest an Opportunity For Improvement (OFI), not an N/C, but then he might run up against the Kwality Kops who recoil in horror if an auditor says anything which might be even remotely construed as consulting.

My advice to Ashley remains:
Pick up the phone Monday and ask the auditor for clarification and an absolute citation to the clause in

  1. Standard,
  2. Supplier QMS
  3. Customer written requirements
If he can't do that, ask him to remove the N/C in writing with copies to your manager, you, and HIS boss.

Benefits of rigorous and systematic inspection and record-keeping:
That all said, your organization might (no guarantees) benefit from a more rigorous system of inspection and record-keeping for ALL your production, not just to adhere to the narrow requirements of a Standard or of your current customers. Such a system will enable your organization to have a better chance to market your services to higher profit customers.

If your productions are running more than a day or two, the efficiencies from incorporating SPC will result in internal savings which will result in increased profit.

If your organization intends to penetrate the aerospace or medical device markets, it will be necessary to impress such customers with the RECORD of your control system so they will feel assured they will get consistent good product time after time, eventually trusting your organization to a "dock to stock" or "dock to production line" status.

These, of course, are long term improvements/changes to your organization and will require the understanding and action of your top management to implement.

We're not sure where you, Ashley, stand in the food chain of your own organization, but passing on these tips to your top management in a non-accusatory manner may benefit your own career.
 

Jen Kirley

Quality and Auditing Expert
Staff member
Admin
#34
And so, having noted the differing viewpoints and answers among the professional auditors here, the only thing that seems quite clear is that the finding is not clear - it's debatable. So my question to AsheyE is: Did your CB auditor tell you of your rights to appeal the nonconformance? This one might be reversible.
 

Jim Wynne

Staff member
Admin
#35
First of all, thank you for providing details.

I think the finding is probably misguided, although not necessarily wrong. Are the acceptance criteria specified for each product? Is actual measurement done?
We do actually measure the part to make sure the part conforms to customer specifications. The sign off indicates "I did the inspection and the measured dimension meets the customer criteria".
And so, having noted the differing viewpoints and answers among the professional auditors here, the only thing that seems quite clear is that the finding is not clear - it's debatable. So my question to AsheyE is: Did your CB auditor tell you of your rights to appeal the nonconformance? This one might be reversible.
I'm going to go out on a limb here and say the auditor, based on the information in evidence so far, is wrong. He didn't clearly demonstrate that the standard had been violated, and he provided no evidence that the OP's methods are ineffective.
 

Wes Bucey

Prophet of Profit
#36
I'm going to go out on a limb here and say the auditor, based on the information in evidence so far, is wrong. He didn't clearly demonstrate that the standard had been violated, and he provided no evidence that the OP's methods are ineffective.
Not very far out and the limb looks awfully sturdy from my viewpoint - I don't think you are in any danger of needing a trip to the ER.;)
 
A

AshleyE

#37
Thank you all for your input and helping me shed some light on this finding. I have a call in to our auditor to give us specific details of how we specifically did not conform to the standard and go from there.

I have a feeling that even though this is a debatable finding, Senior Management will want to accept it and put the corrective action plan in place. Our goal is to have an AS9100 system in place by the end of the year, so its something we'll have to do anyway.

We'll see what he comes back with. In the mean time, I've learned quite a bit on how to handle our next audit!

Thank you all again!
Cheers!
 

Wes Bucey

Prophet of Profit
#38
Thank you all for your input and helping me shed some light on this finding. I have a call in to our auditor to give us specific details of how we specifically did not conform to the standard and go from there.

I have a feeling that even though this is a debatable finding, Senior Management will want to accept it and put the corrective action plan in place. Our goal is to have an AS9100 system in place by the end of the year, so its something we'll have to do anyway.

We'll see what he comes back with. In the mean time, I've learned quite a bit on how to handle our next audit!

Thank you all again!
Cheers!
Please satisfy MY curiosity. What happened?
 
A

AshleyE

#39
Please satisfy MY curiosity. What happened?
I can't believe this was almost a year ago! It has been a while, so keep in mind, I am paraphrasing.

When I contacted the auditor, he insisted that we had not met the requirements of the 9001:2008 standard and the finding would stand unless we formally appealed the finding.

Senior Management did not want to go that route so we gathered the brains in production and quality and started scratching our heads.

The resolution was to continue our current in-process inspection process while running a few orders on a pilot program. Once we worked out the kinks from the test programs, we'd implement the final program shop-wide.

The 1st program had operators record the actual results measured during in-process inspection. We picked 10 orders to run through the shop and at the end of the pilot program (2-3 months later) gathered our team for feedback and recommendations improvement. From there we retooled the program and released 15 orders on the second pilot program. By the time the second program was released to the floor, it was time for our semi annual surveillance audit.

Our previous auditor had a scheduling conflict so we were assigned a new auditor. This new auditor reviewed the finding, our original process and the corrective actions taken to date and determined that our original process met the standard and requirements from our customers. He closed out the finding based on our original process and told us our 2nd pilot program was above and beyond the requirements, so that was where we left it!

We cancelled the 2nd pilot program and kept it on the books for when we head towards AS9100, whenever that ends up happening.

In the meantime, we're making sure we're ready for our 9001 recertification this year. What a trip that ended up being!

So again, thank you to all who offered your input! While this whole process was frustrating, it made us a better company and got our production and quality teams a little time in corrective action.
 

Wes Bucey

Prophet of Profit
#40
Thanks for the update!
I can't believe this was almost a year ago! It has been a while, so keep in mind, I am paraphrasing.

When I contacted the auditor, he insisted that we had not met the requirements of the 9001:2008 standard and the finding would stand unless we formally appealed the finding.
So he never cited an EXACT clause of the Standard?
Senior Management did not want to go that route so we gathered the brains in production and quality and started scratching our heads.

The resolution was to continue our current in-process inspection process while running a few orders on a pilot program. Once we worked out the kinks from the test programs, we'd implement the final program shop-wide.

The 1st program had operators record the actual results measured during in-process inspection. We picked 10 orders to run through the shop and at the end of the pilot program (2-3 months later) gathered our team for feedback and recommendations improvement. From there we retooled the program and released 15 orders on the second pilot program. By the time the second program was released to the floor, it was time for our semi annual surveillance audit.
Seems like a good approach for any company striving for excellence.
Our previous auditor had a scheduling conflict so we were assigned a new auditor. This new auditor reviewed the finding, our original process and the corrective actions taken to date and determined that our original process met the standard and requirements from our customers. He closed out the finding based on our original process and told us our 2nd pilot program was above and beyond the requirements, so that was where we left it!
I think the majority of us Cove members would have applauded this frankness.
We cancelled the 2nd pilot program and kept it on the books for when we head towards AS9100, whenever that ends up happening.

In the meantime, we're making sure we're ready for our 9001 recertification this year. What a trip that ended up being!

So again, thank you to all who offered your input! While this whole process was frustrating, it made us a better company and got our production and quality teams a little time in corrective action.
I hope one "take away" you, your managers, and your organization members got from this episode is that all 3rd party auditors are NOT on the same wavelength and therefore interpret events against a Standard in different ways.

It is perfectly all right to keep an auditor at a closing meeting until the interested parties at the auditee understand (not necessarily agree with) the findings of the auditor and that the auditor has been crystal clear in tying a finding to a specific clause.

The second "take away" is that the process of appeal is not fraught with danger and is certainly less costly and disruptive than the corrective action you undertook. Thus, when your senior management chose one course
Senior Management did not want to go that route so we gathered the brains in production and quality and started scratching our heads.
they did so because they would rather not face an unknown process. The management of every certifying body recognizes that some auditors can engage in mission creep or misinterpret the way a set of observations fits or doesn't fit the Standard and so the CB managers willingly participate in the appeals process. (Bad word of mouth from auditees results in lost business - hence, enlightened self-interest in participating in the appeals process in a fair manner.)
 
Thread starter Similar threads Forum Replies Date
A Risk Acceptance Criteria in ISO 14971 ISO 14971 - Medical Device Risk Management 19
Q How to meet Clause 7.1.2 Acceptance Criteria in ISO TS 16949 IATF 16949 - Automotive Quality Systems Standard 7
Q Sampling Plan Acceptance Criteria - ISO TS 16949 Clause 7.1.2 IATF 16949 - Automotive Quality Systems Standard 8
I ISO/TS-16949 Technical specification - What is the International Acceptance Criteria IATF 16949 - Automotive Quality Systems Standard 2
M ISO 9001:2000 quality objective vs acceptance criteria ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
D What are the acceptance criteria/requirements for Stability Study? General Measurement Device and Calibration Topics 7
L Gage R&R TMV Acceptance Criteria Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
M V&V phase: Justification of acceptance criteria (statistical method ) - (Medical Device) Design and Development of Products and Processes 2
O GR&R Acceptance Criteria Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
S Shore A hardness Tester Acceptance Criteria Standard Elsmar Cove Forum Suggestions, Complaints, Problems and Bug Reports 2
lanley liao Purchase Acceptance Criteria - Tensile testing Oil and Gas Industry Standards and Regulations 2
R Procedure, Frequency and Acceptance Criteria for Replicate, Recalibration, Before-After and Intermediate Checks ISO 17025 related Discussions 8
S Acceptance criteria for gauges General Measurement Device and Calibration Topics 8
M Characterization Testing - NO acceptance criteria, no minimum performance requirement Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
J AIAG PPAP: 2.2.11.3 Acceptance Criteria for Initial Study (page 9, 4th edition) APQP and PPAP 1
C FDA on changing acceptance criteria re: analytical method validation US Food and Drug Administration (FDA) 1
B IATF 16949 Cl. 8.6.6 - Acceptance Criteria - Zero Defects Attribute Data Sampling IATF 16949 - Automotive Quality Systems Standard 2
P Medical Device Validation Protocols and Reports - Acceptance Criteria Other Medical Device and Orthopedic Related Topics 3
C Software Unit Acceptance Criteria (5.5.4) IEC 62304 - Medical Device Software Life Cycle Processes 3
J Acceptance Criteria in 8.1.1 e) of IATF 16949 IATF 16949 - Automotive Quality Systems Standard 2
O Acceptance criteria bacterial endotoxins immunosera for human use Manufacturing and Related Processes 3
I As a part of validation, should i include the acceptance criteria of CPk index >1.33? Qualification and Validation (including 21 CFR Part 11) 4
V Acceptance Criteria Gage R&R - Simple vs Complex Techniques Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 8
A 5.5.3 - Software Unit Acceptance Criteria (Risk Control Measures) IEC 62304 - Medical Device Software Life Cycle Processes 3
M Establishment of Acceptance Criteria for a Weigh Balance General Measurement Device and Calibration Topics 3
X How to define Calibration Acceptance Criteria General Measurement Device and Calibration Topics 3
P Gage R (no reproducibility) - Acceptance Criteria Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
V Validation Test and Acceptance Criteria for Compressed Air Qualification and Validation (including 21 CFR Part 11) 3
I Dual Acceptance Criteria: Cpk and Individual Values Statistical Analysis Tools, Techniques and SPC 3
L Acceptance Criteria for External Calibrated Standards IATF 16949 - Automotive Quality Systems Standard 1
G Acceptance Criteria when Verifying a Gauge General Measurement Device and Calibration Topics 2
D Renault Painting Defect Acceptance Criteria Manufacturing and Related Processes 4
B Surface Roughness Tester Acceptance Criteria Calibration Frequency (Interval) 4
H Package Integrity Testing Acceptance Criteria ISO 13485:2016 - Medical Device Quality Management Systems 3
D 21 CFR 820.80 In-Process Acceptance Criteria requirements for IVDs 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 3
S Acceptance Criteria for Scratches on Medical Devices ISO 13485:2016 - Medical Device Quality Management Systems 3
JoCam Nadcap AC7120 (Audit Criteria for Circuit Card Assemblies) - Acceptance Criteria AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 3
J IPC-A-610 E Thermal Plane Acceptance Criteria for D-Pak Component Other ISO and International Standards and European Regulations 2
S Acceptance Criteria at Design Verification Inspection, Prints (Drawings), Testing, Sampling and Related Topics 2
P Labels - ASTM D3330/D3330M Acceptance Criteria for Adhesion 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 1
optomist1 Tensile Test Crimped Electrical Terminal Acceptance Criteria Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
V The approach/criteria of setting Acceptance Limits Method Validation Parameters Statistical Analysis Tools, Techniques and SPC 1
6 Acceptance Criteria For pH Meters and other Laboratory Equipment Measurement Uncertainty (MU) 16
V How to define Risk Acceptance Criteria? ISO 13485:2016 - Medical Device Quality Management Systems 3
Rameshwar25 Acceptance Criteria for Attribute MSA Study Effectiveness Summary Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
D What are API Equipment Cleaning Requirements and Acceptance Criteria? US Food and Drug Administration (FDA) 3
V How are the Acceptance Criteria for Content Uniformity & Dissolution Superior? Pharmaceuticals (21 CFR Part 210, 21 CFR Part 211 and related Regulations) 2
1 Acceptance criteria and related standard for 1 micron Lever Type dial Indicator General Measurement Device and Calibration Topics 5
M Acceptance Criteria for Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
R Acceptance Criteria for Calibration by an External Calibration Laboratory General Measurement Device and Calibration Topics 9

Similar threads

Top Bottom