Do I need part variation while doing Destructive Variable Gage R&R MSA study

#1
Hello guys,
Can anybody give some insights regarding part to part variation during variable destructive MSA study
Do I really need to take parts covering my entire specification range or I can just randomly select parts from a single lot
 
Elsmar Forum Sponsor

Jim Wynne

Leader
Admin
#2
The idea is to select parts that represent the process range, which might not be the same as the tolerance range. When you have to destroy parts to do the measurement, It should be enough to select parts at intervals during a typical production run. If you're selecting parts post-production, remember that "random" means that every part in the lot has an equal chance of being chosen.
 
#3
Thank you for the reply, Jim.
So it's better to consider taking the parts during production run instead of varying the parameters of the machine to get that tolerance range.
 
N

ncwalker

#4
"Better" isn't a word I would choose. To me, the right phrasing is it will reduce your chance of getting a meaningless result.

First, remember that a Gage R&R is not a description of a process (such as a capability study or an SPC chart). It is a designed experiment to validate the performance of the gage. And as such, you absolutely can set the parameters of this experiment to better test the gage. You just have to be careful that you understand the effects of these choices on the results.

Here is a simple example to illustrate what I mean:

You wish to test a plug gage that's checking 16 mm +/- 0.5 mm. And your normal process is good, you can easily hit the tolerance. So you run a bunch of parts at 16 mm exactly. Or even 16 +/- 0.01. You get a bunch of operators and you test the gage. Unsurprisingly, everyone passes every part, everyone is in total agreement with no variability. What does this tell you about the effectiveness of the gage? It is clearly wrong to just use parts from your "good" process.

So you redesign the experiment. Now you introduce a few from your process, a few that are 8 mm in diameter, and a few that are 24 mm in diameter (well out of spec). And you test again. Unsurprisingly, everyone passes, measures undersized, measures oversized the same. This is "better" but if you had given a little more thought to the testing of the gage, you maybe wouldn't have picked parts so far out of tolerance. You still have no idea how effective it is at checking your parts against the tolerance.

Try 3, you pick (or make) all your samples near the limits, some just in, some just out. THAT tests your gage - and whether or not everyone uses it the same and gets the same results.

Your goal is to feed it parts that will either prove or disprove the veracity of the gage in a fair way. In other words, TEST the darn thing. You're not trying to get an SQ or a customer off your back, you're trying to convince yourself that this gage works. If we switch back to an analog gage instead of the simplified example, then yes, you want parts throughout the range.

A big part of this is linearity. Should you design your gage R&R experiment and you feed it parts in the lowest 25% of your tolerance and get a good R&R, you don't really "know" it works the SAME in the upper 25%. You can somewhat infer this. You are definitely in a better position to comment than if you had not tested the gage. But you COULD be wrong. The likelihood of this is driven by the particulars of the gage system itself. A micrometer - you'd be pretty safe inferring it worked towards the large end, if the small end passed because there's a linear, direct relationship to thread pitch. But consider the fuel gage on your car.... they definitely seem non-linear. Mine seems to hover near F and E for a while, but quickly moves from F to E. Which means my pickup float is probably on a rocker and not a linear flow. Determining performance near F only, I would improperly infer it's behavior near 1/2.

Sorry this is long. These questions are hard to give you the absolute best answer on because we don't know the particulars. I'd rather give you guidance on how to approach the problem, then you figure it out.
 

Jim Wynne

Leader
Admin
#5
"Better" isn't a word I would choose. To me, the right phrasing is it will reduce your chance of getting a meaningless result.

First, remember that a Gage R&R is not a description of a process (such as a capability study or an SPC chart). It is a designed experiment to validate the performance of the gage. And as such, you absolutely can set the parameters of this experiment to better test the gage. You just have to be careful that you understand the effects of these choices on the results.

Here is a simple example to illustrate what I mean:

You wish to test a plug gage that's checking 16 mm +/- 0.5 mm. And your normal process is good, you can easily hit the tolerance. So you run a bunch of parts at 16 mm exactly. Or even 16 +/- 0.01. You get a bunch of operators and you test the gage. Unsurprisingly, everyone passes every part, everyone is in total agreement with no variability. What does this tell you about the effectiveness of the gage? It is clearly wrong to just use parts from your "good" process.

So you redesign the experiment. Now you introduce a few from your process, a few that are 8 mm in diameter, and a few that are 24 mm in diameter (well out of spec). And you test again. Unsurprisingly, everyone passes, measures undersized, measures oversized the same. This is "better" but if you had given a little more thought to the testing of the gage, you maybe wouldn't have picked parts so far out of tolerance. You still have no idea how effective it is at checking your parts against the tolerance.

Try 3, you pick (or make) all your samples near the limits, some just in, some just out. THAT tests your gage - and whether or not everyone uses it the same and gets the same results.

Your goal is to feed it parts that will either prove or disprove the veracity of the gage in a fair way. In other words, TEST the darn thing. You're not trying to get an SQ or a customer off your back, you're trying to convince yourself that this gage works. If we switch back to an analog gage instead of the simplified example, then yes, you want parts throughout the range.

A big part of this is linearity. Should you design your gage R&R experiment and you feed it parts in the lowest 25% of your tolerance and get a good R&R, you don't really "know" it works the SAME in the upper 25%. You can somewhat infer this. You are definitely in a better position to comment than if you had not tested the gage. But you COULD be wrong. The likelihood of this is driven by the particulars of the gage system itself. A micrometer - you'd be pretty safe inferring it worked towards the large end, if the small end passed because there's a linear, direct relationship to thread pitch. But consider the fuel gage on your car.... they definitely seem non-linear. Mine seems to hover near F and E for a while, but quickly moves from F to E. Which means my pickup float is probably on a rocker and not a linear flow. Determining performance near F only, I would improperly infer it's behavior near 1/2.

Sorry this is long. These questions are hard to give you the absolute best answer on because we don't know the particulars. I'd rather give you guidance on how to approach the problem, then you figure it out.
The OP asked a question about a variables gage study, not attributes, which is a different kettle of fish in which good and bad parts must be used. A standard variables GR&R should include parts that represent the range of the process, not the tolerance. There is no need to adjust and readjust the process to get parts that include the whole tolerance range. In this sense, it's not an experiment. It's a test to determine whether the measurement system (part, measurement device, operators) is appropriate to the task and to gain some understanding of risk.
 

Jim Wynne

Leader
Admin
#6
Thank you for the reply, Jim.
So it's better to consider taking the parts during production run instead of varying the parameters of the machine to get that tolerance range.
See my reply to ncwalker. If you're doing a variables gage study, adjusting the machine/process can be counterproductive.
 
N

ncwalker

#8
I agree with Jim and Miner to an extent. There absolutely IS a difference between what the results of a % Study Variation test and a % Tolerance test tell you.

I don't agree that it should use the range of the process only. My reasoning is the goal is testing the gage, not the process. (I could be wrong). My real world experience where NOT using the entire range causing a problem is with mass flow leak testers, which do not have linearity - their accuracy changes based on the leak rate measured. If I am leak testing parts and my current process is a subset of the tolerance, and I use only these parts, at a future date my process may be in a different location in my tolerance. I need to know my gage works there, too. I have seen where it doesn't.

I do concede that once we got understanding of how they performed, we were in a better place to predict how a leak tester worked without having to test the full range. And range-subset test (which reduces the monkeying around with the samples, and therefore the cost) is OK. Looking forward to the discussion on the difference between "test" and "experiment ..." :)

Editted to add: Where I do agree with testing the output "as is" is if you're in some sort of DMAIC study where you are looking for a Red X. You need to know that your gage can effectively spot the Green Y. To do this, you test the process as is and look at % Study Variation.
 

Miner

Forum Moderator
Leader
Admin
#9
I don't agree that it should use the range of the process only. My reasoning is the goal is testing the gage, not the process. (I could be wrong). My real world experience where NOT using the entire range causing a problem is with mass flow leak testers, which do not have linearity - their accuracy changes based on the leak rate measured. If I am leak testing parts and my current process is a subset of the tolerance, and I use only these parts, at a future date my process may be in a different location in my tolerance. I need to know my gage works there, too. I have seen where it doesn't.

I do concede that once we got understanding of how they performed, we were in a better place to predict how a leak tester worked without having to test the full range. And range-subset test (which reduces the monkeying around with the samples, and therefore the cost) is OK. Looking forward to the discussion on the difference between "test" and "experiment ..." :)
This aspect of the measurement system should be evaluated through a linearity study.

Editted to add: Where I do agree with testing the output "as is" is if you're in some sort of DMAIC study where you are looking for a Red X. You need to know that your gage can effectively spot the Green Y. To do this, you test the process as is and look at % Study Variation.
This is correct, but also includes where the gage is used for SPC and capability studies.
 
#10
Let's also remember that the OP is asking about a gage study that requires destruction of the parts. We can't tell from this distance what the parts are worth, but in any event the destruction should be kept to a minimum, which means that fiddling with the process to get parts that reflect the tolerance range might be irresponsible.

I don't agree that it should use the range of the process only. My reasoning is the goal is testing the gage, not the process.
The goal is to test the measurement system, not just the gage. Gage "testing" is done by calibration. Testing the measurement system necessarily involves factors involving the process that might come into play, such as availability of machine time, and the nature of the manufacturing method. Stamping, casting, extruding and molding all might make it difficult or impossible (at least in practical sense) to create the variation necessary to include the entire tolerance range.
 
Thread starter Similar threads Forum Replies Date
D Need Help on the method of calculating tube wall Within Part Variation Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
M Informational Some things the EU MDR 2017/745 does not tell you, but you may need to know to comply with it effectively – Part 1 Medical Device and FDA Regulations and Standards News 0
R Warehouse and shipping/receiving activities need to be part of our scope? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 28
P Part Submission Form - Need to submit PSW only once? APQP and PPAP 5
C I need to verify the surface profile of a part - Sine plates General Measurement Device and Calibration Topics 4
R Does applied part of battery powered TENS unit need to be designed as type BF? IEC 60601 - Medical Electrical Equipment Safety Standards Series 9
L Do I need to use an EASA Part 21 approval, to upload software on a Transport Category EASA and JAA Aviation Standards and Requirements 2
A Does the PSW (Part Submission Warrant) need to be a controlled document? APQP and PPAP 7
N All ODs on the part need to be concentric within 0.07 TIR - What does this imply Inspection, Prints (Drawings), Testing, Sampling and Related Topics 26
A Question on UL 746D - Is there a need to label each specific part as UL? Various Other Specifications, Standards, and related Requirements 2
Z How many charts we need? Different sizes of part produced in the same line Statistical Analysis Tools, Techniques and SPC 2
C Poka Yoke - Formed Wire - I need help with this part Quality Tools, Improvement and Analysis 2
B PPAP and the need to re-submit - Engineering change to a single component part QS-9000 - American Automotive Manufacturers Standard 1
B Hi , everyone i need a procedure for validation of design prototype api 6d (valve manufacturing) Oil and Gas Industry Standards and Regulations 0
J Do we need to raise concessions for every noted deviation under AS9100 Manufacturing and Related Processes 3
M Need to set up a "crisis management and business continuity plan" AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 1
D MDR technical file: does it need to contain duplicates of controlled documents EU Medical Device Regulations 2
R Customer Returns / RMA's & the need for NCR's AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 16
T Need advice on what inspection equipment to buy. General Measurement Device and Calibration Topics 2
Sam.F Do heat treatment ovens need calibration? General Measurement Device and Calibration Topics 22
T Need 5 why’s help AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 15
H Need guidance on importation of Custom-made devices into Japan Japan Medical Device Regulations 1
T Need help understanding AS6174 clause 3.1.5. AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 4
B Spare parts of medical device need CE mark? EU Medical Device Regulations 0
F Change in address for critical supplier - does NB need to be informed? CE Marking (Conformité Européene) / CB Scheme 20
leftoverture REACH Folks - We Need Common Sense! RoHS, REACH, ELV, IMDS and Restricted Substances 23
B Whose waste carrier licence do I need? ISO 14001:2015 Specific Discussions 8
I I need some fun examples of teaching the 5 Whys Lean in Manufacturing and Service Industries 43
R First Time Managing Calibration and Measurement System. Need Help. General Measurement Device and Calibration Topics 19
M CE marked medical device - do they need UKAS certified calibration provider ISO 17025 related Discussions 4
C I need some clearing on requirements of Asuring the validity of results ISO 17025 related Discussions 2
C Need help in determining applicable clause for an audit finding (based on AS9120B) ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
K Subcontractors Providing Services Under MDD or MDR need ISO 13485 from EU Notified Body? CE Marking (Conformité Européene) / CB Scheme 8
E Need some peer advice Quality Manager and Management Related Issues 18
S Need clarification on UKCA and "Approved Body" UK Medical Device Regulations 7
S What types of changes need to be notified to NBs? Registrars and Notified Bodies 1
B Do I need a Cleanroom to manufacture Medical Devices? ISO 13485:2016 - Medical Device Quality Management Systems 2
J CMO in Canada do they need MDSAP/13485 certification? ISO 13485:2016 - Medical Device Quality Management Systems 1
M Attempting to Poke Yoke a wire crimping process...need help Design and Development of Products and Processes 3
C I need your help to find the action plan for these quality objectives Misc. Quality Assurance and Business Systems Related Topics 23
ChrisM Class 1 non-sterile device, need certified QMS or not? EU Medical Device Regulations 2
Steve Prevette I need a template to solve world hunger, a world class Quality Program, and make lots of money Coffee Break and Water Cooler Discussions 5
C Need to understand difference between an actual Calibration vs. a Calibration check General Measurement Device and Calibration Topics 3
S How many tester quantity we need on the line based on the cycle time and peak volume Manufacturing and Related Processes 3
R Need help on calibration result analysis Measurement Uncertainty (MU) 17
M Do i need to have equipment validation if 100% testing is completed? Qualification and Validation (including 21 CFR Part 11) 6
G Need Help with Run @ Rate for Medical Devices ISO 13485:2016 - Medical Device Quality Management Systems 0
F Need help in IMS management review Management Review Meetings and related Processes 3
S I need help in corrective action plan Nonconformance and Corrective Action 15
A Do clinical performance studies for IVDs need to be conducted in a member state? EU Medical Device Regulations 2

Similar threads

Top Bottom