Comparing Two Measurement Systems in terms of Accuracy and Capability

tahirawan11

Involved In Discussions
#1
Hi all,

I am interested in compairing two measurement systems and decide which is better in terms of accuracy and capability. The characteristics in question is the 'Mix ratio' of a compound. The mix ratio is expressed in terms of 'percentage value'. The compound is made up of two 'Ingredients'. The first 'measurement system A' cannot measure the mix ratio directly; instead four different 'mechanical properties' are calculated which are then compared with a standard table which is used to predict the 'mix ratio'.

The second 'measurement system B' is capable of making direct measurement and gives direct 'mix ratio' figures. In order to evaluate which measurement system is better, i have performed a Gauge R&R study. And on the basis of the results; 'measurement system B' has less Gague R&R value (0.9 %) compare to 'measurement system A' (10%).

My question is that' is it enough to prove that 'measurement system B' is better than 'measurement system A'. Do i need to perform a 'Producer risk' and 'Consumer risks' analysis as well and if so how can i do that. Are there any other methods / techniques beside Gauge R&R which can be used to compare two different measurement systems.

thanks
 
Elsmar Forum Sponsor

bobdoering

Stop X-bar/R Madness!!
Trusted Information Resource
#2
I think you have a situation that hold several different complications. Before doing a gage R&R, you need to determine if the gaging system is "calibrated", that is how well does each system correlate to known accurate measures. In order to do that, you would need to have a methodology that can verify the mixture more accurately than the systems you are evaluating. You may not have to go any further than that evaluation (as to a Gage R&R study) if the gaging "system" can not accurately determine the mix content. It may be the "deal breaker". Even this may be complicated as it sounds as though the tests are destructive - in that you can not very the same sample several time. You may need to clarify that point.

If you get past this, then you can look to your gage R&R studies. Better gage R&R usually means better gage for the job BUT you still have to evaluate gage costs, stability (Does the technique have any time-function variation? Gage R&R does NOT have a time function!) Better yet, what gage R&R shows is that "every gage is bad, but the one you are evaluating is 'good enough'."

If it meets the conceptual criteria of calibration and gage R&R, if is probably overkill to go to consumer and producer risk.
 

Bev D

Heretical Statistician
Staff member
Super Moderator
#3
Bob is correct that simply knowing that one system is mroe repeatable than the other is typically not sufficient. You may be more precisely wrong with system B.

Method Comparison is one way to determine if there is any bias between the two methods and how large that bias may be. This approach only tells you how well the two systems agree. You amy also need to know how accurately they reflect truth as well.

I have posted a word document ( “MEASUREMENT SYSTEMS VERIFICATION AND VALIDATION”) describing the statistical approaches for your situation.


http://elsmar.com/Forums/attachment.php?attachmentid=12094&d=1266255721


If you search for "MEASUREMENT SYSTEMS VERIFICATION AND VALIDATION" you will aslo find many similar posts that might help you
 

tahirawan11

Involved In Discussions
#4
Thanks for the informative replies, yes calibration of both the measurement systems have been performed before doing the Gauge R&R study and the results showed that both the systems are performing within the limits. But I am still interested in compariring the two measuerment systems by Gauge R&R study. The reason is that the 'Mix ratio' is a very critical parameter of the process and it must be kept within specs, so a high measurement accuracy needs to be proved.

Since its a destructive test and I dont have any other superior test which can determine the 'true mix ratio'. Therefore the samples for the gauge R&R study have been 'hand mixed' on the basis of 'weight measurement' and comprisise of full range expected within production instead of taking samples from production. The 'bias' will be calculated on the basis of difference from the observed value and 'hand mixed' ratios.

I have one question what do i need to do to say that my measurement system is capable of Six Sigma performance. Do i need to prove that my gauge R&R is less that certain percentage of my specifications?
 

Bev D

Heretical Statistician
Staff member
Super Moderator
#5
I have one question what do i need to do to say that my measurement system is capable of Six Sigma performance. Do i need to prove that my gauge R&R is less that certain percentage of my specifications?
Why do you want to say your system is capabel of six sigma performance? what is the value in that? what does six sigma perfomance mean to you?
 

tahirawan11

Involved In Discussions
#6
when i say my measurement system is capable of six sigma performance, i mean to say that the variation from my measurement system is small enough that i can use my current measurement system for process improvement / monitoring purposes such as use it DOE / SPC.

Six sigma performance means that my end product has a consistant quality and it always meets its customer requirements.
 
Thread starter Similar threads Forum Replies Date
P Acceptable Adjusted R Squared Value Comparing 2 Measurement Devices in Minitab Using Minitab Software 3
O Software for comparing text of PDF files Contract Review Process 2
M Comparing data from destructive testing Inspection, Prints (Drawings), Testing, Sampling and Related Topics 7
A Demonstration of Equivalence - Need for comparing biological characteristics for an SamD EU Medical Device Regulations 1
G Comparing Gauge Blocks - Translating the calibration between the master set and the QA set General Measurement Device and Calibration Topics 2
V Statistical basis and justification while comparing / changing sampling plans Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 11
N Does FDA allow comparing with the competitors Medical Device 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 3
L Procedure for Comparing the Monitor Reading with Laboratory Result Statistical Analysis Tools, Techniques and SPC 4
S Looking for a checklist comparing ISO 13485:2016 and 21 CFR Part 820 ISO 13485:2016 - Medical Device Quality Management Systems 14
M Comparing the MMOG (v3 or v4) with ISO / TS16949 Customer and Company Specific Requirements 3
A Comparing US/FDA Drug Regulations against US/FDA Device Regulations US Food and Drug Administration (FDA) 3
E Correct Statistical Test comparing 2 Groups Statistical Analysis Tools, Techniques and SPC 14
R Comparing Laboratory Scope of Accreditation against internal equipment General Measurement Device and Calibration Topics 3
C Comparing Two Independent Group Observations - 95% Confidence Intervals Overlap Statistical Analysis Tools, Techniques and SPC 3
D Comparing the ISO 9001:2008 standard to ISO 17025 ISO 17025 related Discussions 2
S Comparing Quality System Software Features Quality Assurance and Compliance Software Tools and Solutions 18
C Comparing Two Test Methods - Acceptable Difference(s)? Statistical Analysis Tools, Techniques and SPC 3
M pH Calibration - Comparing Electrical and CRM Methods General Measurement Device and Calibration Topics 1
I Six Sigma comparing to other National and International Models Six Sigma 6
A Comparing Effect of Process Parameters on Equipment Performance during Start Ups Statistical Analysis Tools, Techniques and SPC 3
C Comparing PPM Year over Year - Determining the PPM decrease from 2009 to 2010 Benchmarking 10
M z Test vs. F Test - The most appropriate for comparing the Variances Statistical Analysis Tools, Techniques and SPC 3
R Comparing the Accuracy of Analog vs. Digital Multimeter General Measurement Device and Calibration Topics 6
T Comparing two different Ultrasonic Tester Calibration Techniques General Measurement Device and Calibration Topics 2
Q Internal Audit:Comparing Efficiency of Similar Processes ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 7
D Comparing Variation - A CMM and an On-Line Inspection Station Statistical Analysis Tools, Techniques and SPC 6
N Statistically Comparing Technician Techniques Reliability Analysis - Predictions, Testing and Standards 16
C Comparing Histograms - Bimodal Distribution? Statistical Analysis Tools, Techniques and SPC 4
K Comparing CQE vs. MSc. Professional Certifications and Degrees 1
J To PPAP or Not? Comparing two machines (one old and one new) APQP and PPAP 6
C Comparing OHSAS 18001 to the new ANSI Z10 - Where I can get information? Occupational Health & Safety Management Standards 1
J Has anyone created a matrix comparing ISO 9001 VS BS 7799 and or ISO 27001? Document Control Systems, Procedures, Forms and Templates 1
A Comparing six sigma & EFQM (European Foundation for Quality Management) Six Sigma 2
C Comparing what I do against Canada request - Immigration Immigration and Expatriate Topics 4
J KAPPA Statistic - Comparing appraisers ratings to a known standard IATF 16949 - Automotive Quality Systems Standard 8
R Comparing MicroVu?s Vertex machine to OPG?s Smart Scope Flash General Measurement Device and Calibration Topics 2
D Comparing ISO 10012 and 17025 ISO 17025 related Discussions 2
S Comparing ISO with PMBOK (Project Management Body of Knowledge) Misc. Quality Assurance and Business Systems Related Topics 2
D Comparing Apples and Apples vs. Apples and Oranges QS-9000 - American Automotive Manufacturers Standard 8
C Gap Analysis comparing QS-9000 and TS 16949 IATF 16949 - Automotive Quality Systems Standard 33
Q Measurement Equipment Revocation - Looking for a Disposal Form with Risk Assessment IATF 16949 - Automotive Quality Systems Standard 10
C IVD Metrological traceability without a reference measurement procedure General Measurement Device and Calibration Topics 11
E Any template/ form of Monitoring and Measurement of Processes and product to ISO 13485? ISO 13485:2016 - Medical Device Quality Management Systems 1
A Flexible "Ring" Roundness Measurement General Measurement Device and Calibration Topics 2
M IATF 16949 SI # 10: Integrated self-calibration of measurement equipment- Needs for explanation IATF 16949 - Automotive Quality Systems Standard 2
I QMS monitoring, measurement, analysis and evaluation requirement - Template ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 9
F Physical Part Measurement General Measurement Device and Calibration Topics 6
M Measurement Uncertainty in Optical Microscopy Measurement Uncertainty (MU) 1
B ISO 6508 and portable hardness measurement instruments General Measurement Device and Calibration Topics 0
C How to Establish the Calibration & Measurement Capability (CMC)? ISO 17025 related Discussions 1

Similar threads

Top Bottom