GR&R for a Test Fixture

L

lornzky

Hi,
In our test fixture qualification procedure, it was mentioned that Pp/Ppk is to be used as a measurement to qualify a test fixture.
But I disagree to this approach, because to me GR&R is more appropriate due to the following.

- Test fixture/equipment only tells us if the board passes or fails based from the pre-defined test parameters and limits provided by our customer
- Once the customer defines those test limits, they won?t allow these limits to be changed just to have a good ppk/pp result because what they care about is just for the assembly to pass for its intended application.
- The test fixture/equipment does not have any control on the input(PCB assembly) to get a good output.

Any thoughts is much appreciated... Thanks


 

Watermelonsg

Starting to get Involved
totally agree with you.
When it comes to fixture qualification for a measurement tool, GR&R is more relevant as it will tell us the variance from the measurement system (gage and appraisers) in relation to the total variation. Based on the result, we will know whether or not it suits the requirement as a tool to measure the output from a certain process station.

When GR&R passed the requirement, lets say the GR&R STD% is less than 10, the next job for the team will be to check if the process is capable and stable. Now Cpk/Ppk comes into play. In the event Cpk fails the min requirement, then the focus is on the process rather than the measurement.

It appears that the way you mentioned skipped GR&R.
 

Semoi

Involved In Discussions
The key argument why Pp and Ppk are not relevant is that they describe the process and not only the gage. Thus, in order to qualify the gage we have to "remove" the process from the gage and consider only the later. However, note that there are two different gage RR studies: One focuses on the product specification and thus answers the question whether or not the product is within specification. The second focuses on the process optimization and answers the question whether or not we are able to use the measurements to optimise the variation of the process. The later is usually more demanding.

PS: Could anybody tell me how I am able to insert equations. Is this environment able to interpret MathJax? Usually it is much simpler to describe things using formulas.
 

Watermelonsg

Starting to get Involved
The key argument why Pp and Ppk are not relevant is that they describe the process and not only the gage. Thus, in order to qualify the gage we have to "remove" the process from the gage and consider only the later. However, note that there are two different gage RR studies: One focuses on the product specification and thus answers the question whether or not the product is within specification. The second focuses on the process optimization and answers the question whether or not we are able to use the measurements to optimise the variation of the process. The later is usually more demanding.

PS: Could anybody tell me how I am able to insert equations. Is this environment able to interpret MathJax? Usually it is much simpler to describe things using formulas.

That's good that you further detailed two types of Gage R&R people can choose to use depending on their intention.

I would suggest to use % Tolerance 1st to qualify the gage system for the process to produce parts meeting product specification --- capable. (I would say most of the time it would pass as the process variation should be less than the tolerance range. So personally I am opposed to use %Tor. Probably this is the reason you mentioned the later is usually more demanding?)

In order to control the process making it stable, we need to look at the % Gage std. This will tell us if the Gage system is sensitive enough to signal process variation rather the noise from the gage system. And we should do % Gage std regularly.
 

Semoi

Involved In Discussions
I'm neither a statistician nor a quality person, but I am certainly closer to the former. Since I have seen to many different definitions for each terminology I do not understand what you mean by
I would suggest to use % Tolerance
In this forum I have seen that many use Minitab. Thus, my best guess is that
Bildschirmfoto 2022-01-07 um 11.09.09.png
where L is one limit, and StudyVariationis the amount of variation caused by the measurement system and by the differences between parts (see Minitab homepage). StudyVariationis is calculated as 6 * the standard deviations of each source of variation (see Minitab homepage). Hence, this is the inverse Cp value, right? (omitting the factor 100 for the conversion to percentage, and assuming that xbar is centred between the limits)

However, in your first post you agreed that a Pp and Ppk value does not make sense to qualify a gage. Hence, I reckon that you are using a different program and that the definitions differ from Mintab.

PS: As I do not have enough reputation to add the links, I had to remove them.
 

Watermelonsg

Starting to get Involved
I'm neither a statistician nor a quality person, but I am certainly closer to the former. Since I have seen to many different definitions for each terminology I do not understand what you mean by

In this forum I have seen that many use Minitab. Thus, my best guess is that
View attachment 28569
where L is one limit, and StudyVariationis the amount of variation caused by the measurement system and by the differences between parts (see Minitab homepage). StudyVariationis is calculated as 6 * the standard deviations of each source of variation (see Minitab homepage). Hence, this is the inverse Cp value, right? (omitting the factor 100 for the conversion to percentage, and assuming that xbar is centred between the limits)

However, in your first post you agreed that a Pp and Ppk value does not make sense to qualify a gage. Hence, I reckon that you are using a different program and that the definitions differ from Mintab.

PS: As I do not have enough reputation to add the links, I had to remove them.

Hi Semoi, good morning to you, i assume you are from Europe or European time zone. :)

You are right, %Tor is what the formula you pasted representing. This is for one sided specifications. In the example I assume L refers to Lower specification.

When quick glance at the formula may lead ppl to the quick impression that it is inverse Cp. you might change your mind if you take a 2nd look, this is because the studyvariation refers to gage system which does not include the part to part variation. Agree?

So %Tor is not related to pp/ppk or cp/cpk. And we will compute them after the process and gage system have been validated, and probably doing regular MSA calculating % Gage R&R instead of %Tor? Thoughts?
 

Johnny Quality

Quite Involved in Discussions
Depending on the "test fixture" it might make more sense to use an attribute study, for example if the output is either a pass or fail with no continuous data.

In regards to the process indexes I have this cutout in my office to remind myself the relations between them. It helps when doing SPC studies and deciding where to focus your efforts.

1641554596924.png

This picture is from an article by Donald J.Wheeler available here.
 

Semoi

Involved In Discussions
Hi Watermelonsg,

yes, I am in Europe. Thus, I am several hours ahead of you :)

Regarding your comments, I am sorry, but I have to disagree.
2nd look, this is because the studyvariation refers to gage system which does not include the part to part variation. Agree?
As I said, when you start reading about Six Sigma you will find that the authors use different definitions. Thus, it is important to define which definition you are using. As I wrote the StudyVariationis in Minitab takes both contributions into account. The full text is as follows:
What is study variation?
In gage R&R, study variation (Study Var) is the amount of variation caused by the measurement system and by the differences between parts. It is calculated as 6 * the standard deviations of each source of variation.
You use many abbreviations and it is hard to understand them unless you tell us which reference you are using. The manual of Minitab is available online. Are you using Minitab? If the reference is not available online (for free), it would make sense to add the formulas for each of your "abbreviation", so that they become unambitious. E.g. I don't know what "% Tor" means to you. The same is true for "% Gage R&R", where some authors use the components of the standard deviation and others use the variance components. Of course you might say that this really does not matter, however, it is tiresome to discuss things, which are not well-defined. It just adds a layer of uncertainty, which is unnecessary.

Looking forward to your reply.
 

Watermelonsg

Starting to get Involved
Hi Watermelonsg,

yes, I am in Europe. Thus, I am several hours ahead of you :)

Regarding your comments, I am sorry, but I have to disagree.

As I said, when you start reading about Six Sigma you will find that the authors use different definitions. Thus, it is important to define which definition you are using. As I wrote the StudyVariationis in Minitab takes both contributions into account. The full text is as follows:

Hey Semoi, good to know you here.

After I re-read my statement "studyvariation refers to gage system which does not include the part to part variation." and help page of Minitab. I found it not right technically. I should have said each source of variation can be expressed by StudyVariation(6*SD) where SD is StdDev. And in relation to the process tolerance, the weight(technically it should be %Tolerance (SV/Toler)) of the Gage R&R can be calculated as

studyvariation(of Gage R&R)/Tolerance*100%.

This is what I meant by %Tolerance(and by default when I call it this name, i meant the ratio for Gage R&R to the tolerance, I should have been more precise), and its referred to when deciding if we should release the gage.

I have included a table to results using Minitab below:
MSA.jpg

If we calculate the %Tolerance for Total Variation, using the same formula, it is


studyvariation(of Total variation)/Tolerance*100%.

it is the reverse cp as what you commented. Thats why we have different interpretation I guess.

Speaking of % Gage R&R or % Gage std, I meant %Study Var (%SV). I guess I need to change the term from now on to avoid confusion. :)

As an expansion of the discussion, did you find any guideline for %Tolerance for gage study of destructive test? In AIAG MSA 4th edition, pg78, it says <10 - acceptable, 10-30 maybe acceptable. Does it imply it applies to destructive test as well?

I feel the requirement should be more stringent for destructive test as it does not take reproducibility into account(you can find the above snapshot in which reproducibility is 0). What is your opinion?
 
Thread starter Similar threads Forum Replies Date
A Calibration of spring loaded test fixture General Measurement Device and Calibration Topics 5
E GR&R for a test fixture that outputs variable data per measurement Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
J Adjustable Shaft for a Test Fixture to Test Perpendicularity Inspection, Prints (Drawings), Testing, Sampling and Related Topics 5
T Simulated Use Cardiac Catheter Test Fixture Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
F Gage R&R Destructive Test With Breakaway Fixture To Simulate A Part Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
H 60601 - Patient leakage current via the patient connection test IEC 60601 - Medical Electrical Equipment Safety Standards Series 0
T IVD Self-Test Notified Body Conformity Assessment Process EU Medical Device Regulations 0
T Clinical Study Design for IVD Self-Test (lay user) Products UK Medical Device Regulations 0
A Minitab normality test and stats test for date vs time? Using Minitab Software 10
T Design of Experiment - Test for Curvature Quality Tools, Improvement and Analysis 4
A MSA for wire crimp pull test. Lean in Manufacturing and Service Industries 0
A MSA for wire crimp pull test Lean in Manufacturing and Service Industries 1
C Does a Pass or Fail IP test need UoM on the report? Measurement Uncertainty (MU) 0
Z Design verification test sample size under the scope of first in human study submission in Europe Medical Device and FDA Regulations and Standards News 3
A CE Mark - How do you keep data and test reports? CE Marking (Conformité Européene) / CB Scheme 2
F Laboratory intentionally skipped the Magnetic Field Immunity test IEC 60601 - Medical Electrical Equipment Safety Standards Series 7
H A question about Null Hypothesis for 1 Sample T-test Statistical Analysis Tools, Techniques and SPC 6
H TMV on Burn in test Capability, Accuracy and Stability - Processes, Machines, etc. 0
K Hemocompatibility test EU Medical Device Regulations 1
J Test Certificates ISO 13485:2016 - Medical Device Quality Management Systems 5
M Test Lab Recommends ANSI C63.27 Wireless Coexistence Testing IEC 60601 - Medical Electrical Equipment Safety Standards Series 8
Q Attribute MSA with limited test samples Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 0
C Test Method Validation - ISO Standards Qualification and Validation (including 21 CFR Part 11) 1
M Risk-based approach to Test Method Validation for Design Verification? US Medical Device Regulations 5
G Record test data into Word document Document Control Systems, Procedures, Forms and Templates 3
R Brexit IEC 61000-4-2 test point consideration IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
S Subchronic and Implantation biocompatability test- Rabbit or Rat US Food and Drug Administration (FDA) 2
E EN 868-5:2018 Annex E - Peel Test Design and Development of Products and Processes 6
D Comparing inline Conductivity instrument with offline test results General Measurement Device and Calibration Topics 0
H DIN 12880:2007-05 Clause 7.2 Test Equipment Description CE Marking (Conformité Européene) / CB Scheme 0
E Usability for Near Patient Testing Test Kit Human Factors and Ergonomics in Engineering 2
B SAE J 524 Pressure Test/Possible conflicting requirements? Manufacturing and Related Processes 0
J Automated test lead switcher? Calibration and Metrology Software and Hardware 0
J Applicable Great Britain regulations for a custom-built test rig or evaluation kit used for research purposes only. Design and Development of Products and Processes 0
U Leakage test Standard for Medical Device IEC 60601 - Medical Electrical Equipment Safety Standards Series 3
A MSA and Poison (Red Rabbit) Test Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
K ISO 17025 Method Validation and Verification for Test Lab ISO 17025 related Discussions 5
J IEC60601-1: HiPot Test Method for Internally Powered Devices IEC 60601 - Medical Electrical Equipment Safety Standards Series 5
P Comparing Two Test Variables Using Attribute Data Inspection, Prints (Drawings), Testing, Sampling and Related Topics 0
M Disinfection: Test recommended ISO 13485:2016 - Medical Device Quality Management Systems 0
H Microbiology count test failure Other Medical Device Related Standards 1
S AMS 2769 - weekly frequency test AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 2
S How to determine sample size to test when the acceptance criteria is x >= Standard value? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 7
Kevin Walters AS9100 and AS9120 AATT Course and Test AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 1
W Conducting an MSA Test on scales Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
T Lot Release Test and Certificate of Analysis 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 6
John Broomfield Construction Inspection and Test Plan Misc. Quality Assurance and Business Systems Related Topics 5
Z COVID-19 Antigen Test Kit (Self-test) Registration in Peru Other Medical Device Regulations World-Wide 0
R GearBox Test Bench Calibration General Measurement Device and Calibration Topics 2
N 60601-2-34 Electrosurgery interference Test IEC 60601 - Medical Electrical Equipment Safety Standards Series 0

Similar threads

Top Bottom