Criteria % to be useful in establishing Kpis

qualprod

Trusted Information Resource
#1
Hello all
At managing Kpis, I have found some issues who are not practical for me to be managed.
Could you share what is your experience on this?
Example:
Monthly reviews.
- % of NCR closed out within 10 days = 90%
At the end of the month, we have 3 NCRs, 2 were closed out, and
one is still pending, So my % is 66%.
If I had 2, 1 closed out and 1, and 1 pending, my % 50%
But rarely I could get the 90%.

Do you have any Idea as how to measure % of compliment with aspects like this?
Or some other method to measure them

Thanks for your help.
 
Elsmar Forum Sponsor

Cari Spears

Super Moderator
Leader
Super Moderator
#2
How did you come up with the 10 day requirement? We don't give a set number of days to close an NCR; we determine how long it will take case by case. The KPI is how many were closed within the due date we established.
 
#3
My suggestion is to get rid of that as a KPI. How is it helping you? You certainly can continue showing it is your policy to close them in whatever time you want to specify and any that take more time need to be reported to top management.

10 days is awfully short. 30 days is usually more realistic, but I would not keep it as a KPI. Find a better measure to track.
 

Ron Rompen

Trusted Information Resource
#5
Rather than track % closed within 10 days (which can easily be misleading as you pointed out) why not track 'average days to closure'.

This is useful not only for you, but to demonstrate compliance to CSR's, as they often stipulate the permitted time for corrective actions.
 

John C. Abnet

Teacher, sensei, kennari
Leader
Super Moderator
#6
As others have stated @qualprod ...a specific number days is not always relevant. I have (to our benefit) done as @Miner suggests....i.e. simply tracked all to "# of days to closure". This gave us a more wholistic look ...a macro of how we were performing ..year to year, etc...

Be well
 

Bev D

Heretical Statistician
Leader
Super Moderator
#7
Fellow posters are getting at the key issue here. It isn’t that % math is silly, nor is it that the goal is arbitrary (although both are true and way too common). The key issue here is the ‘K’ in KPI stands for KEY not Convenient.

By Key we really mean ‘critical’ or important or meaningful to the health of the process. Certainly we have shown over and over again that a goal of closing corrective actions within any arbitrary time period only results in ineffective actions, writing up corrective actions on trivial and meaningless findings or just cheating. None of which are helpful. In fact they make a mockery of the corrective action system.

to find a meaningful goal first establish a meaningful metric to measure (I suggest effectiveness of action taken to prevent reoccurrence which can’t be done quickly).

Assuming you mean corrective actions and not just each incident of nonconforming material….
 

Matt's Quality Handle

Involved In Discussions
#8
What truly measures success? Improvement? For example, why are you measuring % of NCRs closed within 10 days? Is important to your customer(s)? Another potential way to measure would be "cumulative days open for all NCR's". As you close them, the number will decrease. If you attack your oldest NCR, the number will decrease by a lot.

Another useful mental exercise is to brainstorm ways to "break" or "game" a KPI, by which bad actors can improve the KPI for their own personal rewards instead of betterment of the company.

See also: Goodhart's Law: "When a measure becomes a target, it ceases to be a good measure"

Goodhart's law - Wikipedia
 

qualprod

Trusted Information Resource
#9
Thanks to all
I agree with your comments in this sense, it seems is not a good idea to keep it as KPI
Because if I define alowable days for the closure I will got finally at the same point
Let´s say how many of CA´s am I allowing to be closed out within 10 days?
a 20 % ?
Because at certain time I have to measure the performance of the management of the CA´s, and of course, not always I will comply, so
certain % will be allowable but.....if I have 4 CA´s and 2 of them were closed out , is 50% , very
different of my target which is 20%, an approach not valid/useful.
Maybe no good idea to set a KPI for CA´s management, maybe just to have a list of them as a reference for the follow-up.

Other effective/useful Idea to measure the CA´s management?

Thanks again.
 

Johnnymo62

Haste Makes Waste
#10
I like Bev's suggestion of effectiveness.

Our registrar (for IATF16949, I know...) will give us an extra NC for an ineffective corrective action system if there was a repeat rejection between the initial corrective action and the next audit. So, for us, a recurrence within the 9 months or so is a big problem.

I have also escalated corrective actions if I had similar rejections/corrective actions on similar processes within 6 months. I usually had decent success with this because the department heads were a little more motivated to press for systemic corrective action.
 
Thread starter Similar threads Forum Replies Date
S How to determine sample size to test when the acceptance criteria is x >= Standard value? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 7
V Process revalidation periodic criteria Manufacturing and Related Processes 5
G NC criteria during internal audits ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
S Mixing criteria and sampling Qualification and Validation (including 21 CFR Part 11) 1
C Design output vs acceptance criteria ISO 13485:2016 - Medical Device Quality Management Systems 8
J Medical Device Component Change - Testing, Sampling Criteria ISO 14971 - Medical Device Risk Management 3
D IVD Accuracy and Precision Acceptance Criteria ISO 13485:2016 - Medical Device Quality Management Systems 1
T Intended purpose for devices that might not fit the IP criteria EU Medical Device Regulations 0
B Criteria for evaluating environmental aspects ISO 14001:2015 ISO 14001:2015 Specific Discussions 8
Q KPI risk assessment - Criteria for the given score IATF 16949 - Automotive Quality Systems Standard 3
A Industry Standards for Cosmetic Inspection Criteria Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
S IATF 16949 Supplier selection criteria 8.4.1.2 IATF 16949 - Automotive Quality Systems Standard 5
P Burst Test Acceptability Criteria ISO 13485:2016 - Medical Device Quality Management Systems 2
H Medical Device Label Acceptance Criteria Manufacturing and Related Processes 10
M Testing criteria - where to place Design and Development of Products and Processes 2
D What are the acceptance criteria/requirements for Stability Study? General Measurement Device and Calibration Topics 7
L Gage R&R TMV Acceptance Criteria Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
S On-time delivery CRITERIA AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 8
M V&V phase: Justification of acceptance criteria (statistical method ) - (Medical Device) Design and Development of Products and Processes 2
R Clinical accuracy and repeatability of IR(infrared) thermometer, no maximum error criteria is recommended in ISO Other Medical Device Related Standards 11
M ISO 14971:2019: Criteria for overall residual risk ISO 14971 - Medical Device Risk Management 11
O GR&R Acceptance Criteria Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
S Shore A hardness Tester Acceptance Criteria Standard Elsmar Cove Forum Suggestions, Complaints, Problems and Bug Reports 2
lanley liao Purchase Acceptance Criteria - Tensile testing Oil and Gas Industry Standards and Regulations 2
M Audit Criteria Training Materials Internal Auditing 1
R IEC 60601-1 - 11.1.3 e) Test criteria - Temperature Measurements IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
C ISO/IEC 17021-1 clause 7.1.2 - Determination of competence criteria Document Control Systems, Procedures, Forms and Templates 2
B GM GP-12 Exit Criteria - Additional Safe Launch Inspection - (Also see GM1927-28 ) Customer and Company Specific Requirements 2
B AS9100 8.4.1 Supplier Selection/Evaluation criteria and reevaluations AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 17
I Mother bobbin final inspection criteria Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
R Procedure, Frequency and Acceptance Criteria for Replicate, Recalibration, Before-After and Intermediate Checks ISO 17025 related Discussions 8
P Design FMEA - Detection Rating criteria ISO 14971 - Medical Device Risk Management 3
J Criteria Matrix To Initiate An A3 or 8D ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
qualprod Best criteria to measure Corrective Action effectiveness - Poor Maintenance ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
B ASTM F2924-14 /ASTM F3001 - Room temperature classification criteria Other US Medical Device Regulations 1
M Supplier selection criteria - Medical devices ISO 13485:2016 - Medical Device Quality Management Systems 3
qualprod Criteria to raise a Nonconformance based on KPI values ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 39
M Criteria and when to carry out Setup Approval Manufacturing and Related Processes 5
V What is the criteria to cite an good documentation practices observation as an data integrity related issue US Food and Drug Administration (FDA) 6
S Acceptance criteria for gauges General Measurement Device and Calibration Topics 9
M Characterization Testing - NO acceptance criteria, no minimum performance requirement Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
J AIAG PPAP: 2.2.11.3 Acceptance Criteria for Initial Study (page 9, 4th edition) APQP and PPAP 1
C FDA on changing acceptance criteria re: analytical method validation US Food and Drug Administration (FDA) 1
Z UDI assignment Criteria Software IVDR Other Medical Device Regulations World-Wide 0
Ashok sunder What are the criteria for setting a target KPI value against a quality objective? Benchmarking 7
qualprod Criteria for print shop - How do you consider the cycle time in a print shop? Lean in Manufacturing and Service Industries 21
eule del ayre IATF 16949 / ISO 9001:2015 audit criteria IATF 16949 - Automotive Quality Systems Standard 17
GStough Auditing Against Criteria Unfamiliar to Auditee - Yea or Nay? General Auditing Discussions 11
M Internal Audit Assessment Criteria - ISO 13485:2016 Internal Auditing 21
S Agreement for allowance for visual criteria after submission APQP and PPAP 1

Similar threads

Top Bottom