How do you Objectively Score an Internal Audit?

W

wilsonmm

#1
I’d love for my question to be whether any of you score internal audits of your own 9001:2000 QMS, but our new management LOVES metrics, and not scoring isn’t an option I’m afraid. Can anyone give me an objective method of scoring requirement elements in an internal audit?

:thanx:
 
Elsmar Forum Sponsor

Miner

Forum Moderator
Staff member
Admin
#2
Re: How do you score an Internal Audit?

IMO scoring an audit will drive negative behavior such as hiding issues, not cooperating with the auditor, etc. You really want to reward the surfacing of issues so improvements may be made. In addition, I would question the effectiveness of an audit with zero findings.

A better area for metrics is the responsiveness in correcting issues surface by the audits.
 
D

Duke Okes

#3
Re: How do you score an Internal Audit?

How about the potential business impact of each nonconformity? (e.g., cost, potential lost business, ...)
 

Jim Wynne

Staff member
Admin
#4
Re: How do you score an Internal Audit?

How about the potential business impact of each nonconformity? (e.g., cost, potential lost business, ...)
Sure--why not make it as negative as possible? The very idea of "scoring" an internal audit--or any audit for that matter--runs counter to what the whole idea should be, namely confirmation that the system is operating according to plan. If something must be counted, count things that go right.
 
D

Duke Okes

#5
Re: How do you score an Internal Audit?

Sure--why not make it as negative as possible? The very idea of "scoring" an internal audit--or any audit for that matter--runs counter to what the whole idea should be, namely confirmation that the system is operating according to plan. If something must be counted, count things that go right.
I guess that's one way of looking at it. I prefer to think of it as showing the value that audits and nonconformities bring to the table ... identifying systems failures that can have a significant impact on the business ... a risk management tool.

And this would also likely improve the audit process, since many of the things often written up by auditors are trivial, mundane, a waste of time to write a CAR on. If they try to quantify the risk they'll find this out, and become better auditors. Management might like that, also.
 

Govind

Super Moderator
Staff member
Super Moderator
#6
Re: How do you score an Internal Audit?

I guess that's one way of looking at it. I prefer to think of it as showing the value that audits and nonconformities bring to the table ... identifying systems failures that can have a significant impact on the business ... a risk management tool.
Exactly. Instead of assigning some numerical scores, the book:
After the Quality Audit: Closing the Loop on the Audit Process, Second Edition
J. P. Russell and Terry Regel
http://qualitypress.asq.org/perl/catalog.cgi?item=H1070
provides an idea of Reason-Pain –Matrix that can explored for the internal audit findings.I think it is a good idea that can get Management’s attention quickly.
Regards,
Govind.
 

Sidney Vianna

Post Responsibly
Staff member
Admin
#7
Re: How do you score an Internal Audit?

Can anyone give me an objective method of scoring requirement elements in an internal audit?
It is very difficult to OBJECTIVELY quantify audit results, because the auditors themselves bring subjectivity into the picture. The company I work for has a tool called isrs[sup]7[/sup]. The tool provides for quantified audit results and contain extensive guidance to the auditors about grading results. The protocol is designed to assess a business against requirements contained in many standards, such as ISO 9001, ISO 14001, OHSAS 18001, PAS 55, GRI:2004 and more.
 

Crusader

Trusted Information Resource
#8
Re: How do you score an Internal Audit?

I’d love for my question to be whether any of you score internal audits of your own 9001:2000 QMS, but our new management LOVES metrics, and not scoring isn’t an option I’m afraid. Can anyone give me an objective method of scoring requirement elements in an internal audit?

:thanx:
Go here: http://elsmar.com/Forums/showthread.php?t=17701
to my post and see if my system will work for you. It seems to work for me so far. :)
 
C

chergh - 2008

#9
I recently returned to work after a period of extended absence. While I was gone the audit system got changed to include a score based on the number of questions in the checklist and the number of non conformances found and they used these to give a percentage score.

Personally I hate this system and it will be disappearing shortly from our system but if your management "want a metric" then this would give them one. I doubt anything useful will be obtained from it though.
 

atitheya

Quite Involved in Discussions
#10
Re: How do you score an Internal Audit?

Yes, Crusader's scoring system for Internal Quality Audits seems to be a good approach.
 
Thread starter Similar threads Forum Replies Date
A How to filter Corrective Action requests objectively? Need help! Nonconformance and Corrective Action 7
O How to give a score/yield more correctly to my suppliers Supplier Quality Assurance and other Supplier Issues 12
A ISO 2859-1 - 9.3.3.2 Switching score - Sampling Plans and PPM AQL - Acceptable Quality Level 0
A PFMEA severity score different applications FMEA and Control Plans 11
S Supplier Evaluation - Is a supplier score card a requirement under ISO and QSR? ISO 13485:2016 - Medical Device Quality Management Systems 7
C What is an Airbus Industrial Process Control Assessment (IPCA) Audit Passing Score General Auditing Discussions 1
C Visual Presentation of Supplier Score - .xls Spreadsheet Excel .xls Spreadsheet Templates and Tools 1
M Is there a calculation in Net Promoter Score (NPS) ? Statistical Analysis Tools, Techniques and SPC 3
Q Ford's Q1 Score Prediction Customer and Company Specific Requirements 2
T Response to ISO 17025 Proficiency Test z score ISO 17025 related Discussions 7
S Supplier Disruption Score and how to calculate it Quality Tools, Improvement and Analysis 4
J How do you score (rate) your suppliers? Supplier Quality Assurance and other Supplier Issues 33
E Detectability score in a use-related FMEA IEC 62366 - Medical Device Usability Engineering 5
V Definition Z Score - What is Z-score? Definitions, Acronyms, Abbreviations and Interpretations Listed Alphabetically 1
E Inter-Laboratory Proficiency Testing Result Analysis - z Score or Normalized Error General Measurement Device and Calibration Topics 3
N Does Debt Consolidation Really Help Your Credit Score? Coffee Break and Water Cooler Discussions 7
H Supplier Monthly Performance Score Card - Please Review Document Control Systems, Procedures, Forms and Templates 6
R ASQ CQE Practice Exam - Do I need to score very well to pass? Professional Certifications and Degrees 17
H Score Calculator for WORLD CUP of 2010 Coffee Break and Water Cooler Discussions 2
U Calculate Z-Score for Non-Normal Data - I have two set of data Statistical Analysis Tools, Techniques and SPC 9
N Score One for the Team - I had to ball up and tell the bosses Coffee Break and Water Cooler Discussions 7
A Score capability of measurement of gauge Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
DanteCaspian 5S Workplace Average for those that score 5 S Lean in Manufacturing and Service Industries 5
P QC Quality Circles - Assessement Score Card for Team Effectiveness Quality Manager and Management Related Issues 3
A Difference between Z score & COV? Statistical Analysis Tools, Techniques and SPC 1
R Sampling Plans - ISO 2859-1: 1999 - How to calculate the switching score? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
A How to calculate weights for customer satisfaction score? Misc. Quality Assurance and Business Systems Related Topics 4
A Net Promoter Score (NPS) for Analyzing the Client Satisfaction Misc. Quality Assurance and Business Systems Related Topics 3
R Improving our ISO 9004 score with respect to Natural Resources ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 8
A Autoline Detroit unveils its first Automotive Supplier Score Card World News 0
Stijloor Looking for a "Balanced Score Card" training program for small businesses. Training - Internal, External, Online and Distance Learning 5
ScottK Z-Score question: Is this Z related to the normal distribution Z values? Six Sigma 3
N Linking BSC (Balanced Score Card) with Six Sigma Six Sigma 18
W What condition is your company in, if you score 3.0? Lean in Manufacturing and Service Industries 12
A Is there an established RPN number or score for a DFMEA? FMEA and Control Plans 1
C Automotive OEM Score Card Templates - Supplier performance measurement tool Supplier Quality Assurance and other Supplier Issues 18
A Balance score card ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
S Process and system auditing - numerical score methods General Auditing Discussions 3
D How to Calculate Z Score Values Statistical Analysis Tools, Techniques and SPC 2
J Balanced Score Card - Using this method for performance measurement Quality Tools, Improvement and Analysis 2
Q ISO 9001-2015 Internal audit finding Internal Auditing 12
lanley liao How to understand this words that the planning of internal audit shall take into consideration the results of previous audits? Oil and Gas Industry Standards and Regulations 10
A Add MDSAP to Internal Audit Schedule Medical Device Related Regulations 0
J IATF 16949 Internal Audit question - Auditor's responsibility Internal Auditing 6
M ISO13485:2016, MDSAP and Internal Audits ISO 13485:2016 - Medical Device Quality Management Systems 8
S IATF 16949 Internal Audit Example IATF 16949 - Automotive Quality Systems Standard 7
R AS9100D internal audit checklist or ISO 9001 2015 to AS9100 D AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 2
S Would this be a second site for the purposes of internal and third party audits? General Auditing Discussions 4
V Internal Auditor Competency KPI IATF 16949 - Automotive Quality Systems Standard 14
J ISMS - Internal Audits Internal Auditing 3

Similar threads

Top Bottom