Measuring Customer Complaints in PPM - How does your company define PPM?

#11
In the door or out in the field

Let's say I ship 1M items per year to an automotive assembly line. Since I 100% test the electronics, I get 5 rejects from the line per year at plug in, turn on(5 PPM, yeah?)

So, the vehicles go out and get beat up by the end user. Over the two year warranty period, I get 5,000 warranty claims for replacement. (5,000 PPM, right?). But wait, during the 2 year period, I've fielded 2M parts, so 2,500PPM, ok? Maybe not.

I tend to view PPM as an assembly line reject measure. Fielded returns (warranty) fall into a reliability calculation for me, mean time to failure or mean time between failures, failure rate, etc. Obviously, line side rejects will be much lower than defective product in the field after 2 years of wear and tear.

Where do I measure PPM?
 
Elsmar Forum Sponsor

Jim Wynne

Staff member
Admin
#12
Since this thread was resurrected and I passed on it the first time around, I'll take the opportunity to make a blanket complaint about the concept of PPM in general.

It seems to be that unless you're actually making a million of something, the method flies in the face of good statistical sense. Let's say that we have reliable data to indicate that a given process will likely yield a PPM value of 50, and that number is acceptable to everyone involved. Now let's say that in my first shipment of 1000 parts there are 20 defectives. Given those numbers, the customer might complain that our PPM level is an unacceptable 20,000. But I say that I've verified that my process is in control (i.e., it's statistically stable) and that the idea of randomness in probability tells us that if the expected value is 50 defectives in 1mm parts, we have no basis for assuming that the 50 defectives--if in fact that prediction comes true--will be evenly distributed over the chronology of the manufacture of 1mm parts. We could, at least in theory (and that's what PPM is all about) have 20 defectives in our first 1000 and then not have another one in the ensuing 1,999,000 pieces, which would mean that what the customer has defined as a 20,000 PPM level is really 20 in practical terms.
 
M

Morcs74

#13
I personnally the most effective way to measure PPMs internally and externally is in the form of DPMO (defects per million opportunities) which then can be used to calculate the process sigma.

For example, internally a DPMO will effectively show you how good your process are:

Take an injection Moulding that goes through an assembly line that has say, 10 value added process being put into it, If you make a Million parts and 100 were scrapped off at the first step then the DPMO rating would be 10,000. On the other hand if you had ten parts out of a million being scrapped off at the 10th step then the DPMO rating would be 100,000 Hence highlighting where you should focus.
 

Jim Wynne

Staff member
Admin
#14
Morcs74 said:
Take an injection Moulding that goes through an assembly line that has say, 10 value added process being put into it, If you make a Million parts and 100 were scrapped off at the first step then the DPMO rating would be 10,000. On the other hand if you had ten parts out of a million being scrapped off at the 10th step then the DPMO rating would be 100,000 Hence highlighting where you should focus.
I admit that I'm not a six-sigma expert (my pants keep falling down because I have no belt) but this doesn't sound right to me. If there were 100 scrapped in the first operation, the DPMO (or also PPM, in this case would be 10,000, but only for that operation, no? By the same token, how does the DPMO grow to 100,000 when there have been nine prior operations with no defects? What am I missing?
 
B

Bill Pflanz

#15
The problem with DPMO is that it tells you nothing about your process. As the examples show, it is a point in time calculation of the defects that can be determined a number of ways depending on how you define an "opportunity". Even if you settled on a definition, the defects could be part of the process as common cause requiring corrective action or it could be from special causes that may require no action.

It would be better if the Six Sigma black belts returned to the basics of statistical analysis (including control charts) of the process data rather than calculating DPMO.

Just my opinion.

Bill Pflanz
(ASQ CSSBB)
 
M

Morcs74

#16
One way of saying how DPMO Works:

What would you rather have, Parts scrapped off at the first stage of the process, or Parts scrapped off after they have had say 9 value added processes go into it which would mean rework or even disposal.
 
J

jawatts - 2009

#17
Ppm

Are you using your PPM for anything else than a comparative reference to what your customer reports your PPM as?
Do it the same as your customer.
 
T

Tybee - 2011

#18
Customer Complaints

I was asked by the staff to define what a customer complaint would be as recordable.

My initial responce was anything that would cause additional cost to the customer.

Any comments on this topic?
 
V

vanputten

#19
What type of "Parts?"

PPM stands for Parts Per Million. What kind of parts? Good? Bad? With one defect? With multiple defects? DPPM before inspection? After inspection? Before test? After test? Internal? At one customer? At all customers?

PPM only defines a ratio of how many occurrences there have been if there were a million opportunities. But occurences of what?

I think most on this thread are speaking of DPPM. D = a part with at least one defect. PPM by itself is simply a ratio. We need to define what it is that we want to count per million.

If people believe there is only one way to count "PPM", and that everyone counts it the same, you are kidding yourself.

Defective parts per million? Defects per million opportunities? Defects and defective parts are different things. And at what stage in the process?

Where one measures this can make a huge difference. If someone is trying to convince you of there product performance with an internal "PPM" measure, we need to know from where in the process they have taken the measure. For example, a DPPM measure might be dramtically different before or after a 100% electrical test for electical parts.

When discussing particles suspended in a fluid, we could measure those "parts" in different ways - size, mass, density, weight, or any other characteristic.

What is it that is being counted and where in the process?

PPM by itself only indicates a ratio. It doesn't tell you anything more than that. What per a million, where, how measured, how was the data collected?

Regards,

Dirk
 

Helmut Jilling

Auditor / Consultant
#20
Tybee said:
I was asked by the staff to define what a customer complaint would be as recordable.

My initial responce was anything that would cause additional cost to the customer.

Any comments on this topic?
I would think that if the customer takes time to complain, it should be a "recordable event." You might have categories to address those compaints that end up being inappropriate. But if they took time to complain, you should record it as a starting point.
 
Thread starter Similar threads Forum Replies Date
G Measuring customer parts on a CMM - How many decimals to report to the customer? ISO 17025 related Discussions 28
B Measuring Customer Service Improvements Misc. Quality Assurance and Business Systems Related Topics 3
Sidney Vianna ISO 10004:2012 - Customer satisfaction - Guidelines for monitoring and measuring Other ISO and International Standards and European Regulations 18
D 8.2.1 Monitoring & Measuring customer satisfaction ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
E Measuring Customer Satisfaction - Memo or a survey? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
N Measuring Customer Satisfaction without Customer Feedback ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 19
Sidney Vianna All the TC 176 documents - ISO 10020 - Customer Satisfaction Monitoring and Measuring ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
T Best Method and Equipment for Measuring Porosity of Customer Supplied Castings Manufacturing and Related Processes 12
R Tools used for measuring (New to metrology) General Measurement Device and Calibration Topics 9
G Best way to calc uncert for measuring microscope without duplicating repeatability? Measurement Uncertainty (MU) 2
J Calibration cycle for monitoring & measuring tools used in medical device manufacturing General Measurement Device and Calibration Topics 5
cnbrosa Study Type 1 on a CMM using a measuring support Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
M Determining a tolerance value for Measuring devices in-house inspection General Measurement Device and Calibration Topics 12
D Accurately measuring Full Thread Length Inspection, Prints (Drawings), Testing, Sampling and Related Topics 11
R ULM Measuring Pressures General Measurement Device and Calibration Topics 1
M Missing measuring equipment General Measurement Device and Calibration Topics 6
Marco Bernardi MMC & LMC modifiers and CMM measuring techniques like diameter least squares and circularity or minimum/ maximum diameter Calibration and Metrology Software and Hardware 5
K Measuring Function MEDDEV 2.1/5 relation with MDD 93/42/EEC CE Marking (Conformité Européene) / CB Scheme 1
M Measuring FIM (TIR) - Two inside diameters - Conflicting readings between inspectors Manufacturing and Related Processes 1
ScottK Measuring thread flank angle on a screw Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
D ASTM C1064 Temperature Measuring Device General Measurement Device and Calibration Topics 2
B Measuring and monitoring equipment - Understanding which procedures to be compliant with ISO 13485 ISO 13485:2016 - Medical Device Quality Management Systems 6
C ISO 9001:2015 Monitoring and measuring resources. Application a service industry ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 7
V Ammeter calibration - Measuring head (on pic.) problem General Measurement Device and Calibration Topics 1
D Monitoring and measuring resources - Example of how section ISO 9001 7.1.5 would apply to a manufacture of software ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
A CE mark - Measuring Instruments Directive confusion! CE Marking (Conformité Européene) / CB Scheme 0
M Measuring Capability of Process with Multiple Specifications Capability, Accuracy and Stability - Processes, Machines, etc. 6
E ISO 13485 7.6 Control of monitoring and measuring equipment - Assess the Validity ISO 13485:2016 - Medical Device Quality Management Systems 4
D Measuring fine tubing (< 0.100") "Wall by weight" General Measurement Device and Calibration Topics 11
G Posting Measuring Equipment Accuracy for User Information General Measurement Device and Calibration Topics 4
S ISO 9001 7.1.5.2 - Actions Taken When Measuring Equipment is Found to be Unfit for Use General Measurement Device and Calibration Topics 13
G ISO 9001 and ISO 17025 - Measuring tools not in calibration system General Measurement Device and Calibration Topics 3
S Calibration - Isolated current meter - Measuring patient auxiliary leakage current Calibration and Metrology Software and Hardware 4
qualprod Complying with ISO 9001:2015 - 9.1.1 b - Monitoring, measuring, analyzing and evaluation ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
Tagin Measuring supplier quality with small quantities Statistical Analysis Tools, Techniques and SPC 10
G Uncertainty of staging a short line scale standard on longer measuring machine? Measurement Uncertainty (MU) 4
U Measuring a Golf Club Face/Grip/Shaft Rotation General Measurement Device and Calibration Topics 7
Q Acceptable calibration accuracy of a 60" linear measuring device General Measurement Device and Calibration Topics 16
H Measuring Design Process Design and Development of Products and Processes 4
C AS9100D 7.1.5.2 / Calibration of Employee Owned Measuring Equipment AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
M Effectiveness Measuring and Efficiency Measuring In ISO 9001:2015 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
johnny johnson New measuring equipment selection (Cg/Cgk) Capability, Accuracy and Stability - Processes, Machines, etc. 2
S Cleanrooms - Particle Measuring - ISO 14644 Other Medical Device and Orthopedic Related Topics 3
S IOQ protocol for a Micro-Vu measuring system - Is a PQ required? Qualification and Validation (including 21 CFR Part 11) 2
K ISO 13485:2016 Cl. 4.2.3 - Determine QMS Processes, Monitoring, Measuring, etc. ISO 13485:2016 - Medical Device Quality Management Systems 4
L Radius Measuring Tools General Measurement Device and Calibration Topics 4
Proud Liberal Measuring axial and radial surface finish (16 Rz) on a broached internal radius Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
J IATF 16949 Cl. 7.1.5.2.1 - Gauges (Measuring Jigs) Calibration/Verification Records IATF 16949 - Automotive Quality Systems Standard 6
Claes Gefvenberg Worst measuring equipment ever? Coffee Break and Water Cooler Discussions 6
J Measuring an Untrue Radius - Metal Stamped and Formed Parts Inspection, Prints (Drawings), Testing, Sampling and Related Topics 8

Similar threads

Top Bottom