SBS - The best value in QMS software

Gage R&R MSA - Variation, Tolerance, Variance by different methods

N

ncwalker

#11
Re: GRR MSA: Variation, Tolerance, Variance by different methods

A few clarifying statements.

% Study variation is used to demonstrate a gage can be used to discriminate a population of parts. % Tolerance is used to determine if a gage is suitable to check a part against a specification. You don't get to pick which one you like.

Let's say you are drilling holes. And a process engineer says "I can slow down the feed rate and make more consistent holes, which will lower scrap." And the floor manager says "Yeah, but that will add cost because the process will take longer." At this point, you have the makings for the classic statistical DOE probably resulting in a t-test to see if indeed the slower feed rate matters. BUT this hinges on your ability to detect your improvement. Because if the improvement is too small to detect, it's not really an improvement. THIS is when you take parts, do your Gage R&R and look at % Study Variation. Because all you are concerned about is "can you tell the difference between the parts?"

Now, let's assume you are trying to PPAP a new process. You're drilling holes and you are checking them with a gage against some print tolerance. Here, you want to look at % Tolerance and % Tolerance only. IF you are very capable and your GR&R parts are very close together, you will do poorly on % Study Variation, but can still do well on % Tolerance.

Many times an SQ will want BOTH to be good. They don't know what they are asking for. When they want % SV to ALSO be good, what they are really concerned about is linearity. Which is a different thing entirely. If you do this PPAP gage R&R and your samples are only using, say, 10% of your print tolerance, your %SV will likely be low and let's assume your % of Tolerance is ok. Is that good enough? Yes, if you are only concerned with the one output. BUT ... you have only exercised your gage through 10% of your tolerance. Your really don't know how it performs outside of this zone. If you are familiar with the TYPE of gage (everyone uses calipers) your usually safe. But if this is a strange gage using unfamiliar concepts, you are at risk. Look at the fuel gage in your car. It hangs around full or near it forever, then quickly drops and hangs around empty forever. It's a non-linear gage.

You should not be puzzled by the inverse part needs for good Cpk vs good Gage R&R. They are not testing the same things at all. Cpk is an estimate of your process stability. So less variability = good. Gage R&R is an attempt to exercise your measurement system. You want to check it through the largest range you conveniently can. So here, you WANT spread. Notice I said "spread" and not "variability." You DO NOT want "variability". You want to result of each and every part you measure to be the same as the previous measurements. But you DO want spread - you want parts representing the largest portion of your tolerance you can get. You can (and should) have some out of spec parts included in your gage R&R.

The best thing to do is this: when you are starting up your process, you will be all over the place. Set some of these parts aside and hang on to them for your gage R&R. Then when you get the process dialed in, grab the rest of the parts for your gage R&R. Do the R&R, convince yourself your gage works, then do your capability study.

By the way - if the R&R fails, the capability study is meaningless. You could just flip a coin to decide which is good and which is bad, with the same accuracy and far less cost.
 
Elsmar Forum Sponsor

Miner

Forum Moderator
Staff member
Admin
#12
Re: GRR MSA: Variation, Tolerance, Variance by different methods

Gage R&R is an attempt to exercise your measurement system. You want to check it through the largest range you conveniently can. So here, you WANT spread. Notice I said "spread" and not "variability." You DO NOT want "variability". You want to result of each and every part you measure to be the same as the previous measurements. But you DO want spread - you want parts representing the largest portion of your tolerance you can get. You can (and should) have some out of spec parts included in your gage R&R.

The best thing to do is this: when you are starting up your process, you will be all over the place. Set some of these parts aside and hang on to them for your gage R&R. Then when you get the process dialed in, grab the rest of the parts for your gage R&R. Do the R&R, convince yourself your gage works, then do your capability study.
This is okay IF you are interested in % Tolerance. It is TOTALLY WRONG if you are interested in %Study Variation because you are artificially increasing your study variation.
 
N

ncwalker

#13
Re: GRR MSA: Variation, Tolerance, Variance by different methods

Absolutely agree with Miner. I apologize I missed that very important point. IN a percent study variation type study, you take the parts as they come, similar to a capability study.
 

Statistical Steven

Statistician
Staff member
Super Moderator
#14
Re: GRR MSA: Variation, Tolerance, Variance by different methods

Absolutely agree with Miner. I apologize I missed that very important point. IN a percent study variation type study, you take the parts as they come, similar to a capability study.
Still, in a highly capable, low variability process, your measurement system will look poor as a % of total study variation. If specifications are available, I believe it is a preferred study.
 
B

Blaest

#15
Thanks all, much appreciated,

If I take the statements below (1-3) it seems to me that there is a variable: the samples may not represent the (whole) process. It also seems to me it may be difficult to decide if the Parts are truly representative for the process.

If the above is somewhat correct it seems I have a risk that I do not know how to detect in advance - and that has a rather big impact on the %SV result.

1) If very capable and parts are very close together, you will do poorly on a %SV

2) In a percent study variation type study, you take the parts as they come

3) Still, in a highly capable, low variability process, your measurement system will look poor as a % of total study variation
 
N

ncwalker

#16
Your three statements are all correct.

Just remember the purpose of the two studies. % of Tolerance is what you use to approve a gage as a viable means to monitor a process to a tolerance. While % Study Variation is used to certify a measurement system used in a study.

Here are some silly examples that will hopefully clarify things.

Example 1: Child's height study and nutrition. Let's say you were going to study elementary school kids growth based on regional nutrition. Basically, you're going to go around schools and measure how tall the kids are. I'm your boss and I send you off with a car odometer that reads to the tenth of a mile. You CAN measure height with an odometer. And ... everyone will be the same height. There is no "tolerance" involved. This situation would fail a % Study Variation study. The odometer is not suitable for checking the height of children. You propose back to me a tape measure. This would then pass the % Study Variation Gage R&R and be approved as suitable for use in the study. Here's the point I missed that Miner caught... I could feed the odometer a wider range of data. Like say the driving distance to various cities. This is the equivalent to cherry picking parts in a much wider range.
My conclusion would be this: the odometer has been shown to be accurate enough to measure the distance between cities. Children's height is a distance. Therefore, I can use the odometer to measure children. What? That doesn't make sense at all. But your RESULTS would look good because you did not certify the gage on the intended subjects you are going to measure. You have to take a sampling of the subjects you are studying to certify the gage.

Silly Example 2: You are in purchasing for the local home improvement store. And you buy 2x4s in 6 foot through 16 foot lengths with increments of 2 feet. And you have to inspect these things coming in. Your boss says "prove to me you can do this." But he's not too bright on ordering and today, he only has 8 foot 2x4s in stock. You get out your trusty tape measure and do a Gage R&R. And you find that these 10 2x4s you are measuring vary +/- 1/16 of an inch. The variation is a little difficult to detect because an 8 foot 2x4 is a little long and awkward to move around and a tape measure is flexible. BUT ... you only need to be able to detect the length to within +/- 1 foot. Your goal is to be able to determine if it is 6 foot, or 8 foot, etc. In this study, you are certifying the tape measure to a large tolerance. And you may fail % Study variation because you had all samples at the 8 foot lenght (think stable process). But you will still PASS the % Tolerance study because your tolerance is huge. Now comes in the point I made about ensuring the samples represent the WHOLE range in this study ... You can see you would pass this Gage R&R. And you could assume that because of this, you can check any 2x4. That's reasonable safe, but still an assumption. You have done your study on 8 ft 2x4s. But what happens if the guy who made the tape measure misprinted the marks? And sometime after 10 foot the printer wheel changes speed and your marks are spaced further. Say 1/16th is really 1/8th. You won't detect this because you only exercised the tape in the 8 foot range. So you may at a later date erroneously reject 16 footers thinking they are too short. THAT's the linearity portion.

Note: you would STILL have a passing % of Tolerance because the tape would be consistent - it would be consistently wrong.

To us people who understand the concepts, this is ENORMOUSLY frustrating because the bosses want one simple hurdle. Is it good or not? The problem is ... you can't answer it with just one result. There's a reason it's called Measurement Systems ANALYSIS and not Measurement Systems ANSWER. :) Welcome to the world of quality.
 
B

Blaest

#18
I need to ask another question:

If I evaluate %PV it seems to be directly related to ndc where %PV=30 is close to ndc=5

If I evaluate tolerance variation then ndc is calculated as 1,41(PV/GRR)

Would it matter if % tolerance variation<10 and ndc<4 if I only want to be able to decide if the parts are inside or outside specifications?
 

bobdoering

Stop X-bar/R Madness!!
Trusted Information Resource
#19
There are two key factors to gage R&R:

1) The skill level of the participants - does it represent the skill level of the people that will use the gage over the life of the process?

2)The variation presented to the gage R&R in the samples - does it represent the variation of the process over the life of the part?

No. 2 is most difficult, especially when doing a gage R&R to determine of a gage is adequate for a process that you have very little history on (as in the inception of the process)

If these two items are not correct, however, the decisions made on the gage will not be correct, either.
 
N

ncwalker

#20
NDC "follows" %SV and is unrelated to %Tol (as you have surmised with the math). NDC is not used in the evaluation of a gage and it's ability to check parts to a tolerance.

A group of us were joking around if we could make a %Tol version of NDC. We opted not to.

The value you really want is uncertainty. This establishes your guard bands you can run to on your tolerance. In my opinion, this is the most important number. Say you have a tolerance of +/- 0.1 mm. And the uncertainty of your gage is +/- 0.01. Then you have to decrease your tolerance (guard bands) and run to +/-0.09.

But what if your uncertainty was +/-0.06 say? Very large. Your guard bands would be +/-0.04, which is .1 reduced by your uncertainty of 0.06 (per side).

At this point, it almost becomes a financial decision. If you can afford the scrap and choose to run to those tight guard bands, more power to you. You are just signing up for more rejects and more frequent SPC checks.
 
Thread starter Similar threads Forum Replies Date
D Do I need part variation while doing Destructive Variable Gage R&R MSA study Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 19
G Tolerance vs Total Variation in Gage R&R report - MSA 3rd edition pg. 116 Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 14
J AIAG MSA and Gage R&R - What does the Process Variation % R&R truly mean? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 11
S MSA for attribute relation gage Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
B How to perform a MSA - GRR (Gage R&R) A&R/ANOVA Vs GUM/VDA Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
P MSA on an in-line automatic X-ray thickness measuring gage Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
B Gage R&R Criteria on page 78 MSA Reference Manual Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 10
C Gage R&R/MSA for PPAP - Our product has no variance Statistical Analysis Tools, Techniques and SPC 9
G MSA Gage R&R and Attribute Forms Attached Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
G Ford - Type 1 Gage Study MSA (Measurement Systems Analysis) acceptable? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
D How to do MSA on a Laser Mike, Rules, and Pressure Gage? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
M Attribute Gage MSA - What is the width of the gray area of ​​doubt? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
optomist1 MSA Gage R&R - Destructive Test with One Sided Specification and One Operator Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
R MSA - GRR (Gage R&R) Requirement for CMM Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 21
2 MSA when neither Nested nor Crossed Gage R&R is Applicable Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 6
M Runout Gage R&R - MSA on Roundness Tester - Minitab Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 9
B Gage R&R/MSA for In Process Measurement System in a Turning Machine Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
bobdoering Dr. Wheeler is back with his thoughts on MSA and Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
T When is GRR (Gage R&R) required? AIAG MSA Manual Version 4 Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 19
R MSA gage R&R (GR&R) for Destructive Test (Non-Replicable Data) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
E Gage Run Chart Analysis - Page 105 MSA manual 3th edition Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
Marc MSA (Measurement Systems Analysis) and Gage R&R Spreadsheets Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 0
A Acceptable Criteria for Variable Gage R&R according to the MSA Manual 3rd Edition Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
Miner Intro to MSA of Continuous Data – Part 7: R&R using Wheeler’s Honest Gage Study Imported Legacy Blogs 17
Z How to handle MSA's (Gage R&R) for different parts? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
B MSA (Gage R&R) vs. Capability Cpk Study - Helium Leak Check Station Statistical Analysis Tools, Techniques and SPC 2
P MSA (Measurement Systems Analysis) Gage R&R with 10 Operators Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 6
A MSA and Gage R&R for Measuring Microscope Capability, Accuracy and Stability - Processes, Machines, etc. 5
T Are MSA?s (Measurement System Analysis) Process or Gage Based? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 20
M Output of Nested MSA Gage R&R - Is this possible? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
P AIAG SPC Manual (ver.1) Interpretations related to Gage R&R (GR&R) and MSA IATF 16949 - Automotive Quality Systems Standard 8
Y Destructive Gage R&R Spreadsheet - Old MSA formula (5.15s) vs New formula (6s) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
Q Internal Testing and Calibration Laboratories - MSA, Gage R&R and Control Plans IATF 16949 - Automotive Quality Systems Standard 2
R MSA Attribute gage repeatability and reproducibility IATF 16949 - Automotive Quality Systems Standard 1
R "Gauge (Gage) R&R Studies per MSA Manual" - Customer Audit Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 13
A Significance of X chart in AIAG MSA sheet for Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 9
Z Determining how many measurement devices need gage R&R? MSA Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 13
Ron Rompen Need help with MSA/Gage R&R - Seeking Minitab template file/sample GR&R study Using Minitab Software 7
H MSA Excel .xls worksheet that includes GR&R (Gage R&R), Bias, Linearity, etc. Excel .xls Spreadsheet Templates and Tools 15
J How to do attribute data GR&R (Gage R&R)? Do a Kappa study or follow the MSA book? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
D MSA and Number of operators - BSI auditor: 3 operators must be used for Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 10
D When is MSA (Measurement System Analysis) appropriate on a custom built gage? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
Z MSA - Gage R&R Study Analysis - SAMPLE - Case Study Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 20
R MSA and Gage Tracking Software that complies with MSA 3rd Edition Quality Assurance and Compliance Software Tools and Solutions 6
G Gage R&R for every gauge? Or is it only every type of gauge? MSA 3rd Edition Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 13
A GR&R (Gage R&R) - MSA - Section 6 Attribute Gage Study - Short Method Requirements Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
K MSA 3rd Attribute GR&R (Gage R&R), no operators - Air decay test systems Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
S MSA (Attribute Gage R&R) on our process monitoring points Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
T TS 16949 - AIAG's MSA Manual - Thread Inspection Gage - Attribute Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
J Attribute Gage R&R MSA (Measurement Systems Analysis) on Pin Gages Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7

Similar threads

Top Bottom