The Cove Business Standards Discussion Forums More Free Files Forum Discussion Thread Post Attachments Listing Cove Discussion Forums Main Page
UL - Underwriters Laboratories - Health Sciences
Go Back   The Elsmar Cove Business Systems and Standards Discussion Forums > Common Quality Assurance Processes and Tools > Quality Tools, Improvement and Analysis
Forum Username

Elsmar Cove Forum Visitor Notice(s)

Wooden Line

Automated and Manual Measurement System Comparison (Correlation)


Elsmar XML RSS Feed
Elsmar Cove Forum RSS Feed

Monitor the Elsmar Forum
Sponsor Links




Courtesy Quick Links


Links Elsmar Cove visitors will find useful in the quest for knowledge and support:

Jennifer Kirley's
Conway Business Services


Howard's
International Quality Services


Marcelo Antunes'
SQR Consulting, and
Medical Devices Expert Forum


Bob Doering
Bob Doering's Blogs and,
Correct SPC - Precision Machining


Ajit Basrur
Claritas Consulting, LLC



International Standards Bodies - World Wide Standards Bodies

ASQ - American Society for Quality

International Standards Organization - ISO Standards and Information

NIST's Engineering Statistics Handbook

IRCA - International Register of Certified Auditors

SAE - Society of Automotive Engineers

Quality Digest

IEST - Institute of Environmental Sciences and Technology


Some Related Topic Tags (Not all threads are Tagged)
automated measurement gages, correlation study, measurement systems
Reply
 
Thread Tools Search this Thread Rate Thread Content Display Modes
  Post Number #1  
Old 31st October 2016, 11:10 AM
tahirawan11

 
 
Total Posts: 103
Please Help! Automated and Manual Measurement System Comparison (Correlation)

Hi,

I have a production process where 100% of machines are tested for ‘airflow’ using an automated measurement system. And a small number of machines 5% are also re-checked manually to see if the 'automatic testing' and 'manual testing' yield the same results. In order to check the consistency of both the results, I plan to do a ‘simple correlation’ analysis. And if the ‘Coefficient of correlation’ is higher than 0.5 then I would conclude that both the ‘automatic’ and the ‘manual’ measurement systems are consistent. I do not want to compare one machine against the other but just want to compare the results of the two measurements systems.

The raw data is attached below and the coefficient of correlation is – 0.241.

Can I conclude that there is no correlation between the results of the two measurement systems? Are there any suggestions to use other tools than simple correlation analysis or other ways to conduct the same study?



automated_testing manual_testing

18,4 18,9
18,1 19,4
18,3 17,8
18,1 18,7
18,2 17,2
18 17,1
18,2 16,3
18,1 17,8
18,1 18,1
18,2 18,2
18,2 17,6
18,2 18,5
18,4 16,1
18,3 18,4
18,2 14,8
18,2 18,8
18,1 17,6
18,1 18,4
18 18,8
18,4 18,5
18,2 19
18,2 18,8
18,3 19,3
18,3 19
18,1 18,2
18,2 17,2
18,1 18,9
18,1 19,8
18,3 20

thanks

Sponsored Links
  Post Number #2  
Old 31st October 2016, 12:52 PM
Bev D's Avatar
Bev D

 
 
Total Posts: 3,507
Re: Automated and Manual Measurement System Comparison (Correlation)

I understand that you don't want to compare instruments to each just the measurement methods. This is a standard Measurement System Analysis.
I caution you that 'simple regression' and correlation coefficients are not appropriate for MSA's because this approach is used for two data series, one of which is dependent on the other. When comparing two measurements - or two measurement systems as in this case - the two measurements are independent of each other. Therefore the graphical display and the 'correlation coefficient are different. The graphical display is a chart with a 1:1 (45 degree) line intersecting the origin and not the best fit line. The coefficient of correlation is the "Intraclass correlation coefficient".

In your case, the agreement between the two methods is so bad that the coefficient is - regardless of the formula - is irrelevant. but the GRAPH is.

I have plotted the values you provided on a Youden plot. (see attached file) I'm not sure which method is represented in your two columns. A is the first column and B is the second column. The two methods are not equivalent.
Attached Files: 1. Scan for viruses before using, 2. Please report any 'bad' files by Reporting this post, 3. Use at your Own Risk.
File Type: pptx Youden for Airflow Elsmar.pptx (687.8 KB, 36 views)
Thanks to Bev D for your informative Post and/or Attachment!
Sponsored Links

  Post Number #3  
Old 1st November 2016, 06:41 AM
tahirawan11

 
 
Total Posts: 103
Re: Automated and Manual Measurement System Comparison (Correlation)

Thanks Bev D. I have one question how should i interpret the graphical display. How does the chart look like if there is a PERFECT match between the two measurement systems? Does it mean that all points will lie on the 45 degrees line and any deviation from this diagonal line indicates a mismatch between the two measurement system?
  Post Number #4  
Old 1st November 2016, 08:42 AM
Bev D's Avatar
Bev D

 
 
Total Posts: 3,507
Re: Automated and Manual Measurement System Comparison (Correlation)

A perfect match would have all of the dots on the 1:1 line. variation centered around the 1:1 line is simple measurement error. if the cloud of values is not centered on the 1:1 line there is a bias between the two instruments or measurements.

I have two papers posted at www.qualityforumonline.com in the Resources tab under "Practical Quality Engineering Resources"

MSA Tools is a spreadsheet with various MSA graphs and calculations.
MSA Verification & Validation is a paper describing how the various tools work and when to use them
These two are at the bottom of the list...

Near the top of the list is "The Statistical Cracks in the Foundation of the Popular Gauge R&R Method".
Thanks to Bev D for your informative Post and/or Attachment!
Reply

Lower Navigation Bar
Go Back   The Elsmar Cove Business Systems and Standards Discussion Forums > Common Quality Assurance Processes and Tools > Quality Tools, Improvement and Analysis

Bookmarks



Visitors Currently Viewing this Thread: 1 (0 Registered Visitors (Members) and 1 Unregistered Guest Visitors)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Forum Search
Display Modes Rate Thread Content
Rate Thread Content:

Forum Posting Settings
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Emoticons are On
[IMG] code is On
HTML code is Off


Similar Discussion Threads
Discussion Thread Title Thread Starter Forum Replies Last Post or Poll Vote
MSA (Measurement System Analysis) Study on an Automated Process Edward_Nell Quality Tools, Improvement and Analysis 4 19th August 2011 08:08 AM
MSA (Measurement System Analysis) on automated machine Caster Capability, Accuracy and Stability - Processes, Machines, etc. 1 12th December 2008 01:40 PM
Automated In-Line Inspection MSA (Measurement System Analysis) jorge2175 Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5 2nd January 2008 05:04 PM
Automated Vision Inspection System MSA (Measurement Systems Analysis) bkarthikeyan Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2 28th December 2007 05:38 AM
MSA (measurement system analysis) on CCA Automated Test Equipment (ATE) briggs_joe Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2 2nd February 2006 12:06 PM



The time now is 02:33 PM. All times are GMT -4.
Your time zone can be changed in your UserCP --> Options.


 
 


NOTE: This forum uses "Cookies"