Attribute R&R assessment results vs. Kappa = different conclusions

J

jmichaelp

#1
Hi, I completed an attribute R&R (yes/no) in which the assessment agreement & the kappa statistics don't seem to agree. Specifically, the lack of seeming disagreement occurs when comparing each appraiser vs standard & all appraisers vs standard. So, should I use the assessment agreement or the Kappa to evaluate the measurement system? Thanks.
 
Elsmar Forum Sponsor

Manix

Get Involved!!!
Trusted Information Resource
#2
Hi,

Can anyone offer an answer to this? As I am currently evaluating whether to use a Kappa study or GR&R for my attribute gauges. It would be useful to know why there has been a difference and which one people would reccomend using.

Thanks,
 

Miner

Forum Moderator
Leader
Admin
#3
Can you provide the raw data and the results of your study?

How different are the results (i.e., is one borderline good and the other borderline bad)? If that is the case, it would not be surprising. Different methods will give slightly different results such as the ANOVA vs. Range methods in variable studies.

However, the differences should not be large. Yes, they will differ in a borderline decision. In this case, you may want to base your decision on both studies. That is, both must be acceptable to pass.
 
C

chalapathi

#4
Interpreting Attribute MSA results.

jmichaelp said:
Hi, I completed an attribute R&R (yes/no) in which the assessment agreement & the kappa statistics don't seem to agree. Specifically, the lack of seeming disagreement occurs when comparing each appraiser vs standard & all appraisers vs standard. So, should I use the assessment agreement or the Kappa to evaluate the measurement system? Thanks.
As per the manual page 129, The Kappa analysis is necessary to determine if there are any differences among the appraisers, but it does not tell us how well the measurement system is (effectiveness). If the Kappa values are not good, it indicates there are significant difference among appraisers.

The important thing to look at is the effectiness score (page 131) and more important is Miss Rate on page 132. This should be with in the limits (less than 2%). If I need to see one value, I will see this. What ever bad parts are missed by the appraiser, they will directly go to customer. This is most serious.

You can send me your data and I can comment on that.
 
Thread starter Similar threads Forum Replies Date
P Comparing Two Test Variables Using Attribute Data Inspection, Prints (Drawings), Testing, Sampling and Related Topics 0
F Attribute sampling plan ISO 13485:2016 - Medical Device Quality Management Systems 7
D Question: How to analyze numerical and attribute data Reliability Analysis - Predictions, Testing and Standards 11
A Attribute , for example C chart Statistical Analysis Tools, Techniques and SPC 16
S MSA for attribute relation gage Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
I Overwhelmed with attribute MSA requirement for visual inspection IATF 16949 - Automotive Quality Systems Standard 11
H Need MSA 4th ed. compliant attribute MSA template General Measurement Device and Calibration Topics 4
A Attribute Analysis for colour matching scale Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
K Transform variable data into attribute data Reliability Analysis - Predictions, Testing and Standards 24
K IATF & Attribute Study requirements IATF 16949 - Automotive Quality Systems Standard 9
T Correct MSA study for an automated camera system which makes attribute inspection Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
O Examples of Critical process parameter (CPP) and Critical quality attribute (CQA) Manufacturing and Related Processes 2
C Applying Weibayes to Attribute sampling Reliability Analysis - Predictions, Testing and Standards 0
M Template for Attribute Gage R & R wanted Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
B Easy Software Needed for Recording Mainly Attribute Data Quality Assurance and Compliance Software Tools and Solutions 2
A Does an attribute study (Go/NoGo pin gage) need two studies (1 for each pin) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
B Attribute Gage R&R study according to "Charbonneau" Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
R Can a Attribute Study be considered a Visual Inspection? Reliability Analysis - Predictions, Testing and Standards 6
J MSA on Part Specific Attribute Fixtures Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
B IATF 16949 Cl. 8.6.6 - Acceptance Criteria - Zero Defects Attribute Data Sampling IATF 16949 - Automotive Quality Systems Standard 2
L Gage Blocks: Attribute or Variable Gage? General Measurement Device and Calibration Topics 3
T Attribute vs Variable Inspection Data ISO 13485 Requirement ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
D Calibration of a Width Gage Slot with an Attribute Gage - Maximum Width Condition General Measurement Device and Calibration Topics 16
R Visual Attribute Inspector Capability and KAPPA Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
D attribute gage RR in a unique way Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
M Proper Gauging - GD&T - Attribute gage to check true positioning on the shop floor Inspection, Prints (Drawings), Testing, Sampling and Related Topics 6
P RQL/AQL from Attribute Data Six Sigma 1
M Population failure rate based on attribute data Statistical Analysis Tools, Techniques and SPC 4
V Minitab - Attribute Gage Study Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
S Attribute G&R for all Visual Controls in Control Plan Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
J Attribute Test Method Validation 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 1
A Attribute Sampling Plans with Switching Rules - Software Recommendations Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
F MSA - Measurement System Analysis Attribute Data Crosstab sheet APQP and PPAP 1
B Bayes Success-Run on Attribute Data - Determining Sample Size Statistical Analysis Tools, Techniques and SPC 2
A Attribute Inspection P Chart Statistical Analysis Tools, Techniques and SPC 9
Chennaiite Do Attribute Control Charts really help? Statistical Analysis Tools, Techniques and SPC 9
S Visual Inspection Galvanized Attribute Study Quality Tools, Improvement and Analysis 2
N Example of how to perform a Visual Attribute Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
K MINITAB 16 - Attribute gage study (Analytic method) and Gage R&R Study (Expanded) Using Minitab Software 2
J Minimum number of parts to do an attribute gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 8
D Reliability of an Attribute Inspection based on Historical Data Capability, Accuracy and Stability - Processes, Machines, etc. 8
S Cross Tab Attribute Gauge Study form Excel .xls Spreadsheet Templates and Tools 3
V MSA Attribute Data Analysis Study IATF 16949 - Automotive Quality Systems Standard 1
S Destructive Attribute MSA for Simple Water Leak Check in Trailers Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
A Minimum Number of Parts for Attribute (Go / NoGo) Data Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
J Attribute MSA - Number of samples Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
Manix MSA - How to Approach a Gauge R&R Go/NoGo Attribute Study Statistical Analysis Tools, Techniques and SPC 2
B Best Attribute Data Sampling Plan - Early Production Containment Inspection, Prints (Drawings), Testing, Sampling and Related Topics 2
E MSA of Attribute Gauges Signal Detection Method Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
C MSA-4 Attribute Kappa Template - Verification Check Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 11

Similar threads

Top Bottom