SBS - The best value in QMS software

Criteria to raise a Nonconformance based on KPI values

Mike S.

Happy to be Alive
Trusted Information Resource
#31
My experience doesn't match yours. I'm neutral about red-amber-green, but I have seen it in place in some extremely sophisticated companies with highly intellegent and educated leaders. If it works for them, don't knock it.
But does it work for them, or, does it work for them as well as if they would put some effort into understanding things better?

Not too long ago I was at a plant belonging to a multi-billion dollar aerospace company where the #2 guy in the company raved to their customer (an aerospace prime) about their red-yellow-green andon lights posted above each bulletin board, which was located in an alcove just off the main hallway. The idea was everyone who walked by could just look at the lights and see if things were going great, so-so, or badly (green, yellow, red), thus no need to bother with walking a few steps over and actually looking at any details on a chart!

After raving about his idea and how the corporate VP (his boss' boss) loved the idea so much that he was gonna see to it that every plant in the corporation copied the light idea, the VP took a breath and the customer asked a question: "I see the light here is green, but what about this data (pointing to a piece of paper on the bulletin board) showing how for 3 weeks in a row you are behind schedule in shipping this product?"

The VP got a funny look on his face, stared at the data for several seconds, conferred briefly with a subordinate who was also on the tour, and then explained that manpower had been taken off that job and moved to a hotter job because they are in a very competitive area for aerospace manufacturing and manpower is hard to find, but they have 23 unfilled employee requisitions out there right now and HR is doing their best to fill them.

So the light was green, the VP thought all was well, but all was not well, not well at all.

That's a great way to convince your customer to give you more business, right? :vfunny::vfunny::vfunny:
 
Elsmar Forum Sponsor

Jim Wynne

Staff member
Admin
#32
I was in a plant several years ago where they had a video monitors at several machines that were supposed to monitoring the SPC data. They too had red, green and yellow things to indicate...well they indicated something. I asked two managers and an operator a few questions about how these things worked in terms of the data and got three different conflicting answers.
 

RoxaneB

Super Moderator
Super Moderator
#33
After raving about his idea and how the corporate VP (his boss' boss) loved the idea so much that he was gonna see to it that every plant in the corporation copied the light idea, the VP took a breath and the customer asked a question: "I see the light here is green, but what about this data (pointing to a piece of paper on the bulletin board) showing how for 3 weeks in a row you are behind schedule in shipping this product?"
Without knowing what the "green" was reporting on, I'd offer that maybe it's not the colour-system that's the issue, but rather the metric being reported.
 

RoxaneB

Super Moderator
Super Moderator
#34
I was in a plant several years ago where they had a video monitors at several machines that were supposed to monitoring the SPC data. They too had red, green and yellow things to indicate...well they indicated something. I asked two managers and an operator a few questions about how these things worked in terms of the data and got three different conflicting answers.
Is the issue with the red/yellow/green method or is communication/training/awareness also at play there?
 

Bev D

Heretical Statistician
Staff member
Super Moderator
#35
Red yellow green can help people visualize or see the situation better. IF - and this is a big IF - the colors are assigned according to the statistical rules that properly represent differentiation of a signal from random noise AND the data are appropriately defined and measured/assessed AND the data are accurately input into the system. In the case of the Andon - as explained, it is not weakness of the colors, but the lack of changing the color as the situation changed - in other words inaccurate data into the reporting system.


In circling back to the OP's original question, we need to all remember that are 4 ways to meet a goal
1. Hope that random variation plays in your favor
- If the goal is 'small' enough you might get lucky and the random variation in the system will be within the goal during the assessment time.
2. Manipulate the system
- Negotiate the goal
- Negotiate the relevant measurement period
- Negotiate constraints: what is in your control and beyond your control. in other words, don't include results that "weren't within your control"
3. Manipulate the data
- Censor data that is “not fair”
- Censor data that is outside your ability to control
- Rationalize the data
- Lie
4. Make actual changes to the system
- the goal must match the business need, not be arbitrary, inspirational or punitive.
- must have the resources in time, people, money
- must have a method for achieving the goal
- must have a plan and strategy to meet the goal

This is why I cringe when people ask about 'raising an NC' for a missed goal. It is a complex system and requires true knowledge, profound knowledge.
 
Last edited:

Jim Wynne

Staff member
Admin
#36
Is the issue with the red/yellow/green method or is communication/training/awareness also at play there?
If we assume that the purpose of the R-Y-G stuff is to facilitate awareness of what's going on with a process, and no one seems to understand the underlying R-Y-G significance, there's a problem that training won't help. The only place I can think of where these signals can be really useful is in a real-time situation where measurements are automated.
 

Mike S.

Happy to be Alive
Trusted Information Resource
#37
Without knowing what the "green" was reporting on, I'd offer that maybe it's not the colour-system that's the issue, but rather the metric being reported.
The green was to indicate that everything with the production of that product was going fine relative to the parameters being reported on and no intervention was required. But in reality there was a problem lasting 3 weeks and yet the green light shined on. The customer who had never seen the charts before noticed the problem almost immediately because he took a few minutes to look at data and not a stoplight.
 

Bev D

Heretical Statistician
Staff member
Super Moderator
#38
Mostly I would agree with Jim.
When it comes to Andons, I have seen them work well. But they do require a true Toyota Production System culture. In this culture everyone knows, understands and expects that work will flow and when a problem is discovered, it is addressed and notification (via stopping the line) is made immediately. "Problems are precious" is the mantra.
I've seen too many 'leaders' implement things like Andons 'hoping' that they will 'do the trick' without doing the hard work to change the culture. In a non TPS culture, turning the Andon on is seen as a sign of failure, so the light wont' be turned on...
 
Thread starter Similar threads Forum Replies Date
M Testing criteria - where to place Design and Development of Products and Processes 1
D What are the acceptance criteria/requirements for Stability Study? General Measurement Device and Calibration Topics 7
L Gage R&R TMV Acceptance Criteria Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
S On-time delivery CRITERIA AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 8
M V&V phase: Justification of acceptance criteria (statistical method ) - (Medical Device) Design and Development of Products and Processes 2
R Clinical accuracy and repeatability of IR(infrared) thermometer, no maximum error criteria is recommended in ISO Other Medical Device Related Standards 11
M ISO 14971:2019: Criteria for overall residual risk ISO 14971 - Medical Device Risk Management 6
O GR&R Acceptance Criteria Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
S Shore A hardness Tester Acceptance Criteria Standard Elsmar Cove Forum Suggestions, Complaints, Problems and Bug Reports 2
lanley liao Purchase Acceptance Criteria - Tensile testing Oil and Gas Industry Standards and Regulations 2
M Audit Criteria Training Materials Internal Auditing 1
R IEC 60601-1 - 11.1.3 e) Test criteria - Temperature Measurements IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
C ISO/IEC 17021-1 clause 7.1.2 - Determination of competence criteria Document Control Systems, Procedures, Forms and Templates 2
B GM GP-12 Exit Criteria - Additional Safe Launch Inspection - (Also see GM1927-28 ) Customer and Company Specific Requirements 2
B AS9100 8.4.1 Supplier Selection/Evaluation criteria and reevaluations AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 13
I Mother bobbin final inspection criteria Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
R Procedure, Frequency and Acceptance Criteria for Replicate, Recalibration, Before-After and Intermediate Checks ISO 17025 related Discussions 8
P Design FMEA - Detection Rating criteria ISO 14971 - Medical Device Risk Management 3
J Criteria Matrix To Initiate An A3 or 8D ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
qualprod Best criteria to measure Corrective Action effectiveness - Poor Maintenance ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
B ASTM F2924-14 /ASTM F3001 - Room temperature classification criteria Other US Medical Device Regulations 0
M Supplier selection criteria - Medical devices ISO 13485:2016 - Medical Device Quality Management Systems 3
M Criteria and when to carry out Setup Approval Manufacturing and Related Processes 5
V What is the criteria to cite an good documentation practices observation as an data integrity related issue US Food and Drug Administration (FDA) 6
S Acceptance criteria for gauges General Measurement Device and Calibration Topics 8
M Characterization Testing - NO acceptance criteria, no minimum performance requirement Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
J AIAG PPAP: 2.2.11.3 Acceptance Criteria for Initial Study (page 9, 4th edition) APQP and PPAP 1
C FDA on changing acceptance criteria re: analytical method validation US Food and Drug Administration (FDA) 1
Z UDI assignment Criteria Software IVDR Other Medical Device Regulations World-Wide 0
Ashok sunder What are the criteria for setting a target KPI value against a quality objective? Benchmarking 7
qualprod Criteria for print shop - How do you consider the cycle time in a print shop? Lean in Manufacturing and Service Industries 21
eule del ayre IATF 16949 / ISO 9001:2015 audit criteria IATF 16949 - Automotive Quality Systems Standard 17
GStough Auditing Against Criteria Unfamiliar to Auditee - Yea or Nay? General Auditing Discussions 11
M Internal Audit Assessment Criteria - ISO 13485:2016 Internal Auditing 21
S Agreement for allowance for visual criteria after submission APQP and PPAP 1
V Process and Internal Audit Criteria matrix wanted Internal Auditing 8
I Writing a Cosmetic Criteria for Switches Document Control Systems, Procedures, Forms and Templates 1
M Example ISO 14971 policy and risk criteria ISO 14971 - Medical Device Risk Management 0
D How to set equipment calibration/verification criteria General Measurement Device and Calibration Topics 1
A Operating criteria for production processes - ISO 14001 Cl. 8.1 ISO 14001:2015 Specific Discussions 3
B The most important criteria of IEC 60601-1 medical devices safety IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
P Supplier (Vendor) Evaluation Criteria - IATF 16949 Cl. 8.4.1.2 IATF 16949 - Automotive Quality Systems Standard 1
H CER - Equivalent Medical Devices Criteria - MDR/MEDDEV REV 4 CE Marking (Conformité Européene) / CB Scheme 9
K Internal Audit Scope and Criteria Internal Auditing 9
K ISO 9001:2015 clause 9.2.2 a. - Define the audit criteria and scope Internal Auditing 2
Q Criteria to pursue an opportunity ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 7
V Periodic review criteria for reviewing/updating SOPs US Food and Drug Administration (FDA) 1
B IATF 16949 Cl. 8.6.6 - Acceptance Criteria - Zero Defects Attribute Data Sampling IATF 16949 - Automotive Quality Systems Standard 2
P Validation of Processes - What is meant by 7.5.6 (a) - Defined Criteria for Review ISO 13485:2016 - Medical Device Quality Management Systems 7
P Medical Device Validation Protocols and Reports - Acceptance Criteria Other Medical Device and Orthopedic Related Topics 3

Similar threads

Top Bottom