# Acceptance Criteria for Attribute MSA Study Effectiveness Summary

#### Rameshwar25

##### Quite Involved in Discussions
There is an effectiveness summary table on Page No. 139 of MSA manual (4th Ed). In this table, values under both headings viz. '% appraiser' and '% score attribute' are same i.e. 42/50, 45/50 and 40/50 respectively for A, B and C appraiser. In the attached file too (which I downloaded from elsmar as an example), the values have been just copied and no separate calculations have been made.
My question is are these to be calculated separately. If yes, what will be the formulae for calculations?

Further, i want to know how do we take decision about measurement system's acceptance or rejection based on these calculated values. I mean what is the acceptance criteria for these values.

Rameshwar

#### Attachments

• 55.5 KB Views: 636
• 108 KB Views: 1,086

#### Stijloor

Staff member
Super Moderator
Re: Acceptance Criteria for Study Effectiveness Summary

Can someone help?

Thanks.

Stijloor.

#### Marc

##### Fully vaccinated are you?
Staff member
Another quick "Bump". Can anyone help with this? My thanks in advance!

#### Rameshwar25

##### Quite Involved in Discussions
Can someone forward this query to AIAG please?

Rameshwar

#### Ajit Basrur

Staff member
Can someone forward this query to AIAG please?

Rameshwar
We have lot of experts here ... so pl wait. Weekends are bit slow and your response may be delayed.

#### Rameshwar25

##### Quite Involved in Discussions
after discussing with some people I have come to following conclusion:
42 times, App-A has agreed with himself in all three trials (29 times all 1-1-1 and 13 times all 0-0-0).

45 times, App-B has agreed with himself in all three trials (32 times all 1-1-1 and 13 times all 0-0-0). .

40 times, App-C has agreed with himself in all three trials (28 times all 1-1-1 and 12 times all 0-0-0).

Under '% Score vs. Attribute" heading:
42 times, App-A has agreed in all three trials with himself and also with reference (29 times for passed reference and and 13 times for reject reference). Remaining 8 times, his decision is mixed.

45 times, App-B has agreed in all three trials with himself and also with reference (32 times for passed reference and and 12 times for reject reference. Remaining 5 times, his decision is mixed.

40 times, App-C has agreed in all three trials with himself and also with reference (28 times for passed reference and and 12 times for reject reference. Remaining 10 times, his decision is mixed.

under 'System % effective score"
39 times, all three appraisers' decision is same (in all 9 trials). 28 times- all agreed for 1-1-1-1-1-1-1-1-1 and 11 times all agreed for 0-0-0-0-0-0-0-0-0-0.)
Under "system % effective score vs. reference"
39 times, all three appraisers' decision is same and their decision match with reference.

Regards
Rameshwar

#### Bev D

##### Heretical Statistician
Staff member
Super Moderator
as always with these types of tests there is no single 'right' answer. It really depends on what the product and defect is and what the consequences are of a false acceptance and a false rejection. Only YOU and your customer know waht is acceptable...AIAG is a guideline; a starting point.

B IATF 16949 Cl. 8.6.6 - Acceptance Criteria - Zero Defects Attribute Data Sampling IATF 16949 - Automotive Quality Systems Standard 2
Attribute Gage R&R: Acceptance criteria for CrossTab Method? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
J Acceptance Criteria for Attribute Data Sampling Plans shall be Zero Defects Inspection, Prints (Drawings), Testing, Sampling and Related Topics 14
Medical Device Label Acceptance Criteria Manufacturing and Related Processes 4
What are the acceptance criteria/requirements for Stability Study? General Measurement Device and Calibration Topics 7
Gage R&R TMV Acceptance Criteria Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
V&V phase: Justification of acceptance criteria (statistical method ) - (Medical Device) Design and Development of Products and Processes 2
GR&R Acceptance Criteria Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
Shore A hardness Tester Acceptance Criteria Standard Elsmar Cove Forum Suggestions, Complaints, Problems and Bug Reports 2
Purchase Acceptance Criteria - Tensile testing Oil and Gas Industry Standards and Regulations 2
Procedure, Frequency and Acceptance Criteria for Replicate, Recalibration, Before-After and Intermediate Checks ISO 17025 related Discussions 8
Acceptance criteria for gauges General Measurement Device and Calibration Topics 8
M Characterization Testing - NO acceptance criteria, no minimum performance requirement Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
AIAG PPAP: 2.2.11.3 Acceptance Criteria for Initial Study (page 9, 4th edition) APQP and PPAP 1
FDA on changing acceptance criteria re: analytical method validation US Food and Drug Administration (FDA) 1
P Medical Device Validation Protocols and Reports - Acceptance Criteria Other Medical Device and Orthopedic Related Topics 3
Software Unit Acceptance Criteria (5.5.4) IEC 62304 - Medical Device Software Life Cycle Processes 3
Acceptance Criteria in 8.1.1 e) of IATF 16949 IATF 16949 - Automotive Quality Systems Standard 2
Acceptance criteria bacterial endotoxins immunosera for human use Manufacturing and Related Processes 3
As a part of validation, should i include the acceptance criteria of CPk index >1.33? Qualification and Validation (including 21 CFR Part 11) 4
Acceptance Criteria Gage R&R - Simple vs Complex Techniques Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 8
A 5.5.3 - Software Unit Acceptance Criteria (Risk Control Measures) IEC 62304 - Medical Device Software Life Cycle Processes 3
M Establishment of Acceptance Criteria for a Weigh Balance General Measurement Device and Calibration Topics 3
X How to define Calibration Acceptance Criteria General Measurement Device and Calibration Topics 3
P Gage R (no reproducibility) - Acceptance Criteria Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
V Validation Test and Acceptance Criteria for Compressed Air Qualification and Validation (including 21 CFR Part 11) 3
I Dual Acceptance Criteria: Cpk and Individual Values Statistical Analysis Tools, Techniques and SPC 3
L Acceptance Criteria for External Calibrated Standards IATF 16949 - Automotive Quality Systems Standard 1
A Risk Acceptance Criteria in ISO 14971 ISO 14971 - Medical Device Risk Management 19
G Acceptance Criteria when Verifying a Gauge General Measurement Device and Calibration Topics 2
Renault Painting Defect Acceptance Criteria Manufacturing and Related Processes 4
B Surface Roughness Tester Acceptance Criteria Calibration Frequency (Interval) 4
H Package Integrity Testing Acceptance Criteria ISO 13485:2016 - Medical Device Quality Management Systems 3
D 21 CFR 820.80 In-Process Acceptance Criteria requirements for IVDs 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 3
S Acceptance Criteria for Scratches on Medical Devices ISO 13485:2016 - Medical Device Quality Management Systems 3
Nadcap AC7120 (Audit Criteria for Circuit Card Assemblies) - Acceptance Criteria AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 3
A Acceptance Criteria - ISO 9001:2008 Clause 8.2.4 - Questionable Audit Finding? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 40
How to meet Clause 7.1.2 Acceptance Criteria in ISO TS 16949 IATF 16949 - Automotive Quality Systems Standard 7
J IPC-A-610 E Thermal Plane Acceptance Criteria for D-Pak Component Other ISO and International Standards and European Regulations 2
S Acceptance Criteria at Design Verification Inspection, Prints (Drawings), Testing, Sampling and Related Topics 2
P Labels - ASTM D3330/D3330M Acceptance Criteria for Adhesion 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 1
Tensile Test Crimped Electrical Terminal Acceptance Criteria Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
The approach/criteria of setting Acceptance Limits Method Validation Parameters Statistical Analysis Tools, Techniques and SPC 1
Acceptance Criteria For pH Meters and other Laboratory Equipment Measurement Uncertainty (MU) 16
How to define Risk Acceptance Criteria? ISO 13485:2016 - Medical Device Quality Management Systems 3
D What are API Equipment Cleaning Requirements and Acceptance Criteria? US Food and Drug Administration (FDA) 3
How are the Acceptance Criteria for Content Uniformity & Dissolution Superior? Pharmaceuticals (21 CFR Part 210, 21 CFR Part 211 and related Regulations) 2
Sampling Plan Acceptance Criteria - ISO TS 16949 Clause 7.1.2 IATF 16949 - Automotive Quality Systems Standard 8
1 Acceptance criteria and related standard for 1 micron Lever Type dial Indicator General Measurement Device and Calibration Topics 5
Acceptance Criteria for Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5