Product Audit Scoring - Using a Point System for Product Audits

#1
Hi all,

Is anyone out there using a point system for product audits? We started doing that this year, and it seems the right thing to do for us. It helps getting attention to the results and above all it will help us to spot trends.

We start out with 1000 points awarded for a flawless product ( Including risk for personal injury, packaging, paperwork, marking and all we could think of ).

Anything undesirable that turns up in the audit means that points will be deducted.

If for instance, we find that the product would probably be rejected if delivered we pull 250 points. Risk for personal injury means 500 points deducted. A very slight deviation from spec ( border line case ) means 5 points deducted.... and so on...

Opinions? Ideas? Comments?

/Claes
 
Elsmar Forum Sponsor
A

Al Dyer

#2
I would just hope that the product was pulled from possible distribution to the customer under any circumstance.

5 Points for a borderline?? I don't know if I would like to cover that bet.

Maybe more info? Would a "maybe" be shipped under certain circumstances?
---------------------------------------------------------

Considering all product pulled if any failure found, how can you put a rating on a part that is bad, whether marginally or a full blown mistake?

Sounds like qualification as opposed to quantification based on specification.

Sorry Bob, your part was more out of spec than Bill's so we will have to let you go????

Process-Process-Process
 

E Wall

Just Me!
Super Moderator
#3
I think the key to remember is any audit scheme should be 'objective' not 'subjective'.

I am a bit confused about the purpose of the audit. Is this system used in lieu of final product testing? As it is described, to me this seems more like a department audit...not a product audit. More information would help...

We use final product testing where bad material is scrapped, questionable material is segregated for testing and status, and the recorded information is used to analyse scrap (along with cause) by department with qa and mgmt. The qa auditors perform department process audits each shift. This is augmented by a monthly department audit, where there attention to detail, timliness of paperwork completion, safety, housekeeping, etc.. are reviewed.

Back when we had profit sharing...the department audit scores were averages for the plant and we were awarded so many pennies per hour based on the score.

It is monday, and I'm fighting a head cold with meds that may be clouding my ability to reason...so if I have confused the issue...My appologies. Otherwise, I'll check later for more info.
Eileen
 
#4
Yes, you are right of course... I was a bit vauge there.

So: We pull a finished product (ready for delivery) back to have a look at it. And this has nothing to do with final testing. We simply use it to see that the previous processes including final testing performed as they were supposed to. Anything wrong, and it stays right here, of course.

As for borderline I mean if you find something on the tolerance limit, not out of tolerance. ( Maybe I goofed the translation there ). The points are merely a way of putting figures on findings, so we can follow trends.

/Claes
 
#5
If it works for you, Do it.
Ford has a similar process with Q!. Start with a 1000 points, get below 800 and your Q! status is revoked.
Chryaler uses PPM; greater thabn 50PPM and your status starts to decline.
Rating projects are only good for one thing,as you said to establ;ish a trend. Beyond that they are of little value.
 

E Wall

Just Me!
Super Moderator
#6
Originally posted by Claes Gefvenberg
So: We pull a finished product (ready for delivery) back to have a look at it. And this has nothing to do with final testing. We simply use it to see that the previous processes including final testing performed as they were supposed to. Anything wrong, and it stays right here, of course. /Claes
Sounds like you have a winner then! Sounds very similar to our monthly department audits. Where we use a 1-3 score and calculate the % scored out of the possible you use the 1000 pts. Do you audit each department (if this is applicable to your processes) where components are manufactured/machined and readied for the next process? or is this one final product station audit only?

Also, I didn't notice a frequency listed...how often do you do this?

Thanks for sharing Claes :)
 
#7
Thank's for your comments,

Do you audit each department (if this is applicable to your processes) where components are manufactured/machined and readied for the next process? or is this one final product station audit only?
This is a final product audit only, and we do it once a month. ( We produce stainless steel coils and plates )


Rating projects are only good for one thing,as you said to establ;ish a trend. Beyond that they are of little value.
I think there is one more point of value, actually: It creates an interest in the organisation. I may have rambled about this before: We eagerly discuss quality related topics among ourselves, but often forget to spread the word. We need to take a closer look at the PR aspect.

/Claes
 

johnnybegood

Involved In Discussions
#8
I was having the similar idea to introduce score for meeting compliance. But I am looking at activities rather then product. I thought of using NCR as a measurement for a production line. We have 15 lines running on 4 crew 12 hrs rotation. The whole idea is to use NCR to drive for compliance and ownership. The more NCR one line get the less profit sharing the line (employee) will get. Of course we have other measurement like productivity, housekeeping, product quality and NCR is just another measurement. In order to achieve this I am drafting out the audit criteria and frequency of audit. I will get the line managers to do the audit. Just wonder if anyone have done this before. If we cannot measure we cannot improve.
 

E Wall

Just Me!
Super Moderator
#9
Choices and Preferences

We chose to use the department monthly audit rahter than NCRs because it offered the same high focus in the departments while reducing "non-value added paper-pushing". This was actually comments by the QA Manager.

We use the NCRs to drive product quality issues more than anything else. Just a choice/preference the company made. We are finally starting to use it for process issues as well, but driving the program to the next level takes time. Again, I want to stress that everything that needs to get done is getting done, just there may be timeliness issues.

Since we address all critical functions every shift the thought was to create interest (just as Claes stated) in doing the mundane tasks that are required (paperwork, housekeeping, etc...) as well as a way to measure (fairly) each departments results. The overall goal is to make it an ingrained habit/activity that is done without conscious thought...Don't think twice about when to do something...do it Now!

Eileen
 

johnnybegood

Involved In Discussions
#10
Hi all,

I am almost finish drafting out the audit criteria/checklist. While I am doing this in the morning a question pop out. If a production operator is found operating a machine that is PM over due, should the NCR be issued to the operator or the Technician that forgot to carry out the PM? FYI the Technician reports to the Maintenance dept. while the audit criteria/checklist is design for Production. Pls. advised.
 
Thread starter Similar threads Forum Replies Date
N Audit non-compliance API Q1 - Use of External Documents 4.4.4 in Product Realization Oil and Gas Industry Standards and Regulations 4
F Product audit sampling plans IATF 16949 - Automotive Quality Systems Standard 3
G Addressing Non-Conformances from an Internal Audit that are not product related ISO 13485:2016 - Medical Device Quality Management Systems 11
D What are the important things to keep track of in product audit checklist? Software Quality Assurance 3
B Is it necessary to conduct product audit of entire product which is manufactured in the company as per IATF IATF 16949 - Automotive Quality Systems Standard 4
Q IATF 16949 - Product audit - Must each product be audited? IATF 16949 - Automotive Quality Systems Standard 6
U Dock Audits - Isn't waiting to do an audit when the product is "supposed" to ship a little late? Manufacturing and Related Processes 12
W Product Audit - It must be a separate and distinct activity (IATF 16949) IATF 16949 - Automotive Quality Systems Standard 4
S IATF 16949 - Manufacturing and Product Audit Approach IATF 16949 - Automotive Quality Systems Standard 19
B TS16949 Section 8.2.2.3 Product Audit - Requirements for various Customers IATF 16949 - Automotive Quality Systems Standard 10
K Please share a Product Audit Checklist for a Wafer Fab Document Control Systems, Procedures, Forms and Templates 3
Q Internal Audit of Product Quality Complaint System (21 CFR Part 820) Customer Complaints 9
C TS16949: Product Audit vs. "Regular Checks" Internal Auditing 1
P May I combine the Process Audit and Product Audit into Delphi's LSR? Customer and Company Specific Requirements 3
J Questionable Audit Finding about Revision Levels of Product Manual CD's ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 7
C Requirement for NB audit with Discontinued Product EU Medical Device Regulations 3
J Product and Process Audit according to ISO/TS 16949:2009 Process Audits and Layered Process Audits 9
S Supplier Audit Questionnaire for aerospace product suppliers AS9100, IAQG 9100, Nadcap and related Aerospace Standards and Requirements 1
C Anvisa Manufacturer Audit - Product produced at two different Sites Other Medical Device Regulations World-Wide 3
W Definition Product Audit - Definition Definitions, Acronyms, Abbreviations and Interpretations Listed Alphabetically 2
O Product Audit for Rubber Parts for Automotive Industry IATF 16949 - Automotive Quality Systems Standard 3
Q How to Audit the Client Quality System - Product Failure caused by no Maintenance ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 3
L EN 45011 (European Standard for Product Certification) Audit Checklist needed Other ISO and International Standards and European Regulations 3
A Non-Conforming Product vs. Supplier Audit Finding Supplier Quality Assurance and other Supplier Issues 8
Q Product Audit Check List according to VDA VDA Standards - Germany's Automotive Standards 1
A Seeking: documentation for intrinsically safe product audit General Auditing Discussions 6
A How to calculate the Effectiveness of the Process and Product Audit System Internal Auditing 10
michellemmm Software Product Development Quality Assurance (PDQA) Audit Checklists Software Quality Assurance 12
Q Product Characterization Audit - What is "Characterization" IATF 16949 - Automotive Quality Systems Standard 7
R Product Audit Checklist according to ISO/TS 16949 IATF 16949 - Automotive Quality Systems Standard 24
D Dock Audit (Product Audits and Process Audits) database wanted Quality Assurance and Compliance Software Tools and Solutions 20
Q What should be Audited in a Product Audit IATF 16949 - Automotive Quality Systems Standard 14
harrysons Product Audit Checklist - Please give some advice or share your opinions Software Quality Assurance 8
A Product Audit - Traceability of Sand used Internal Auditing 8
B What is in a Product Audit? TS 16949 Clause 8.2.2.3 Process Audits and Layered Process Audits 21
K Help in meeting the requirements in 8.2.2.3 Product Audit of TS 16949 IATF 16949 - Automotive Quality Systems Standard 5
I Definition Product Audit vs. Dock Audit vs. Layout Audit - Differences Definitions, Acronyms, Abbreviations and Interpretations Listed Alphabetically 29
V Is Product Audit Mandatory as per ISO 13485? ISO 13485:2016 - Medical Device Quality Management Systems 19
somashekar Product audit for using the safety mark (ETL) on label Other Medical Device and Orthopedic Related Topics 2
Ajit Basrur Process and Product Audit format needed Process Audits and Layered Process Audits 1
R Product Audit Summary Form needed IATF 16949 - Automotive Quality Systems Standard 5
B What is the full name of QKZ in product audit? IATF 16949 - Automotive Quality Systems Standard 8
H Product Audit - TS 16949 Clause 8.2.2.3 IATF 16949 - Automotive Quality Systems Standard 18
K Mock Audit Log Form Template for Product Recall/Return at Food Plant Document Control Systems, Procedures, Forms and Templates 8
P Product Audit looking at Conformity, not Effectiveness General Auditing Discussions 6
C Audit NonConformance - Evidence of Post Market Vigilance and Product Recall. ISO 13485:2016 - Medical Device Quality Management Systems 6
J AS9100 Clause 7.4.3 Verification of Purchased Product (audit Finding) AS9100, IAQG 9100, Nadcap and related Aerospace Standards and Requirements 30
Q Dock Audit - Reasons to do dimensional checks during product dock audit Inspection, Prints (Drawings), Testing, Sampling and Related Topics 5
Icy Mountain Product Audit Process Requirements - Clause 8.2.2.3 IATF 16949 - Automotive Quality Systems Standard 35
H Specification Description - Product audit on the production floor IATF 16949 - Automotive Quality Systems Standard 4
Similar threads


















































Top Bottom