Gauging method comparison - Air Gage vs. CMM Measurement

A

achorste

#1
Afternoon all (or morning to those of you far away from Britain!)

Looking for some advice:

We machine tapers on hip joints (amongst many other things). These are currently CMM inspected for spigot angle. However we have had some issues with rejections from the customer which measure fine on the CMM when we get them back. It turns out they are using air gauging to measure the angle & diameter.

Anyways along with our process improvements to reduce variation, we are equipping ourselves with identical equipment as the customers goods inwards inspection.

My plan was to perform a GR&R on each method using the same parts - however this would not give me a direct comparison.

The question is - how do I directly compare each piece of equipment? Some mention has been made of a "Two tailed T Test" that will give me the answer. However I neither know what one of these is or what to do to perform one effectively. (We do have Minitab by the way).

Any advice is greatly appreciated.
 
Elsmar Forum Sponsor

Bev D

Heretical Statistician
Staff member
Super Moderator
#2
The statistical techniques you need are: Youden plots to visualize the difference including any biases, paired t test (NOT a two tailed t test) to determine if a real difference exists after removing the systematic bias and the Bland-Altman analysis of the importance of the difference between the two methods.

I would add that this type of analysis is not well served by the traditional gage R&R (the one that calculate %EV, etc. using the tolerances with rther small numbers of parts =10) You are performing a true "method comparison" and the techniques listed above are for this type of analysis.

One thing to understand is how each guage sytem actually perfroms the measurement. Air gages are notorious for being misapplied - they may not be accurately measuring the real characteristic of interest.

My recommendation would be to then measure approximately 30 or so parts twice with the CMM and twice with the air gage. Plot the two sets of results for each guage on a Youden Plot. This is a scatter plot with a 45 degree 1:1 line drawn on it. No measurement error will be exhibited by the points falling on the 45 degree line. (DO NOT PERFROM REGRESSION OR DRAW A BEST FIT LINE. MEASUREMENT ERROR DOESN'T FIT STANDARD REGRESSION TECHNIQUES.) At this point you could calculate the number of distinct categories or the Discrimination ratio. But really, looking at the data will tell you whether or not each method is repeatable given the range of total variation. If one or more of the techniques is nto repeatable you need to start there. any other analysis after this step is meaningless unless both methods are repeatable.

If both methods are repeatable, you can proceed to plot the first measurement result for each guage on a Youden Plot. Then you can follow the procedures as listed in the referenced articles. OR post your data at this point and we can step you thru it from there.

References:
"STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT" by Martin Bland and Douglas Altman, published in The Lancet, February 8, 1986.

You may also search for Bland Altman, Youden and Paired t tests...
 
A

achorste

#3
Absolutely fantastic - just the kind of guidance I was looking for.

Muchos gracias, Danke Schon, etc etc :D
 

bobdoering

Stop X-bar/R Madness!!
Trusted Information Resource
#4
Note - be sure to mark and measure the same location on each part. You want to identify measurement variation - not physical variation. :cool:
 
M

mboucher

#6
Your CMM software is no doubt defaulting to LSQ (Least Squares Algorithm) this is typical with every CMM software.

Try switching the calculation method to match air gaging. You may need to increase the amount of points taken and switch from LSQ to a maximum inscribed circle. This will change the calculation to the maximum size pin that will fit in the diameter. Since the air gaging is a two-point measuring device you may have to do a point to point measuring check.

Are they sweeping the entire circle and giving you an average? Just remember a CMM is not a air gage and it will average the points taken to 'fit' a circle.

Mark Boucher
 

Bev D

Heretical Statistician
Staff member
Super Moderator
#7
Bingo!

the measurement method must match the intent of the thing it's measuring.

generically speaking the choice between an air gage and a CMM (or hwo the CMM works anyway) is whether you are essentially passing a flexible (liquid or gas) object thru a path or an inflexible object. The air gage will give total volume while the CMM typically provides an effective circle as you described.

as in most cases the physics of function must be understood first. then comes physics of failure and statistical analysis...
 

Bev D

Heretical Statistician
Staff member
Super Moderator
#8
If you don't find Youden Plot, it is also known as an Iso-plot.
There should be much more out there regarding the Youden plot.
but basically it is as I've described. a scatter diagram with a 1:1 (45degree) line. The standard deviation of measurement error (the SD of the difference between the two repeated readings) is used adn not hte standard error in the Y direction about some best fit line as in regression. the SD of measurement error has a vector perpindicular to the 1:1 line....
 
M

mboucher

#9
Bingo!

the measurement method must match the intent of the thing it's measuring.

This is one problem with understanding a CMM. Most times it is not the CMM or the software it is understanding your results. This is what I attempt to uncover in the magazine I publish about CMMs

Mark Boucher
 
A

achorste

#10
Your CMM software is no doubt defaulting to LSQ (Least Squares Algorithm) this is typical with every CMM software.

Try switching the calculation method to match air gaging. You may need to increase the amount of points taken and switch from LSQ to a maximum inscribed circle. This will change the calculation to the maximum size pin that will fit in the diameter. Since the air gaging is a two-point measuring device you may have to do a point to point measuring check.

Are they sweeping the entire circle and giving you an average? Just remember a CMM is not a air gage and it will average the points taken to 'fit' a circle.

Mark Boucher
The parts (machined with a male taper) are designed to fit into a matching female taper on a femoral head.

Each part is rotated 360 degrees round the air gauge. The air gauge results are recorded as a maximum & a minimum then the average is taken (as long as both max & min fall within the tolerance band).

Not sure about which method is used for the CMM - I will have to check.

Thank you again for all your help.
 
Thread starter Similar threads Forum Replies Date
B Narrow limit gauging Inspection, Prints (Drawings), Testing, Sampling and Related Topics 0
M NPT thread gauging and the "rapping" process Manufacturing and Related Processes 1
M Proper Gauging - GD&T - Attribute gage to check true positioning on the shop floor Inspection, Prints (Drawings), Testing, Sampling and Related Topics 6
I 3 legged 5 Why - Hole diameter Oversize caused by Gauging Problem Solving, Root Cause Fault and Failure Analysis 9
I Proper gauging of tight tolerance (reamed) holes General Measurement Device and Calibration Topics 4
A Setting air gauging outside of a part tolerance Capability, Accuracy and Stability - Processes, Machines, etc. 2
J Press Brake Tooling / Back Gauging - Holes for the back stop instead of the Part Edge Manufacturing and Related Processes 8
S Can we comingle Gauging Vision System and 3 Point Micrometers? Manufacturing and Related Processes 2
P Should I purchase b89.1 1.10M? Acceptable low/high limits for gauging equipment? General Measurement Device and Calibration Topics 4
M Gauging equipment supplier to the auto industry - Is 17025 relevant to me? ISO 17025 related Discussions 2
D Air Gauging: Are the results affected by surface finish of the bore? General Measurement Device and Calibration Topics 1
M V&V phase: Justification of acceptance criteria (statistical method ) - (Medical Device) Design and Development of Products and Processes 2
B AS9100D 7.1.5.2 Calibration or Verification Method using outside cal lab AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 1
Q Sampling method for Distributor verification activities EU Medical Device Regulations 1
D Difference between Test Method Validation and Gage R&R Qualification and Validation (including 21 CFR Part 11) 18
C Correct Calibration Method for Dial Depth Gage General Measurement Device and Calibration Topics 6
E Mentor for Test Method Validation (TMV) Design and Development of Products and Processes 2
earl62 IATF 16949 Clause 9.1.1.1 - What is the batch conformance to specification method? IATF 16949 - Automotive Quality Systems Standard 3
A Beginners help with ISO3951-2 Combined control s-method n>5 what is Phi ?? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 0
S What is the best method to bond urethane foam to urethane foam? Manufacturing and Related Processes 4
R BS EN 12060:1998 - Zinc and zinc alloys Method of sampling Specifications Manufacturing and Related Processes 4
M Test method validation - Is MSA (MSA1, MSA2, MSA3 and linearity) a good solution? Medical Device and FDA Regulations and Standards News 1
Pau Calvo How to motivate colleagues to use 8D method or similar Quality Manager and Management Related Issues 37
M Proper method to test flow of a regulator Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
V Minitab GRR crossed Xbar and r method macro needed Using Minitab Software 9
R Please share your method used for PEMS Validation IEC 62304 - Medical Device Software Life Cycle Processes 5
S AS9100D PEAR - Examples for organization's method for determining process results? AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
Y Post Market Surveillance Indicators and Analysis method EU Medical Device Regulations 1
silentmonkey Seeking efficient method to manage install base data Manufacturing and Related Processes 0
D 4M (Man, machine, method, materials) Management Manufacturing and Related Processes 3
Ron Rompen Measurement Method Challenge - Measure feature #91 Inspection, Prints (Drawings), Testing, Sampling and Related Topics 9
C FDA on changing acceptance criteria re: analytical method validation US Food and Drug Administration (FDA) 1
M Issuing NCR for improper method statement submissions Internal Auditing 10
F Irradiation Sterilization Validation Maximum Dose - VDmax 25 method (ISO 11137) EU Medical Device Regulations 2
I "Method" vs "Process" - Differences Document Control Systems, Procedures, Forms and Templates 33
P Test Method Validation for Tensile Strength Tester Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 0
C ICP versus AA: How to determine appropriate specification for assay method verification Qualification and Validation (including 21 CFR Part 11) 1
I Flatness - Rectangular part using the three jack method Inspection, Prints (Drawings), Testing, Sampling and Related Topics 10
B AS9102 Supplier Flow Down Method AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 7
M Control Method correspondence between PFMEA and CP FMEA and Control Plans 8
qualprod Qualitative or Quantitative? Risk method evaluation ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 7
Ron Rompen Dual level holes - Measurement method suggestions wanted General Measurement Device and Calibration Topics 9
D Sampling method that is representative of the devices supplied by that distributor EU Medical Device Regulations 5
P Production Line Pump Cleaning Validation Method Question Qualification and Validation (including 21 CFR Part 11) 0
A Risks related to Method Validation and Stability Studies Pharmaceuticals (21 CFR Part 210, 21 CFR Part 211 and related Regulations) 2
qualprod ISO 9001 Risk control method - What could be the better way to control risks? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 3
Ron Rompen Ford Method - Position Capability with MMC Modifier Capability, Accuracy and Stability - Processes, Machines, etc. 14
J Inspection method for T10 Hex driver General Measurement Device and Calibration Topics 13
qualprod ISO 9001:2015 - Right method to address clause 6.1? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 12
S Stakeholder analysis Method Six Sigma 1

Similar threads

Top Bottom