MSA for Counting Measurement Systems

P

Piotr Stoklosa

#1
Hi guys,

I have probably very basic question but I can?t find an answer on it. I want to ask how to evaluate counting measurement systems?

Here is an example of such a system. Let?s assume we have plates with black dots. An operator has to count the number of dots on every plate so the result of the measurement is a number of dots. When we analyse this measurement system we want to evaluate how is the error in operator?s counting (for example there is 20 dots on the plate but one operator found 19, the second 21, the third 20 etc.) They also can make mistakes in consecutive trials.

I can imagine an experiment where we prepare 10 different plates with different number of dots and then 3 operator for 3 times count number of dots on each plate. But what to do next with this results?

In my opinion this not a continuous system because we have discrete data so we cannot use a usual GRR. This is also not an attributive decision so we cannot use kappa or other attributive method. Do you have any suggestions?

Thank you
Piotr
 
Elsmar Forum Sponsor

Miner

Forum Moderator
Leader
Admin
#2
You have at least two options. One would be to perform an attribute agreement analysis for ordered (ordinal) data. However, count data is much more precise than ordinal data because the relative magnitude is known.

I recommend that you take advantage of the fact that at counts > 10, the Poisson distribution can be approximated by the Normal distribution. You have what is known as pseudo-continuous data, so a standard crossed R&R study is feasible. One possible area where you could have problems is if the variation in the number of dots is small, you may run into a pseudo-resolution problem.
 
P

Piotr Stoklosa

#3
To Miner:

Thank you for showing me the direction. I also agree that the best idea would be to assume pseudo-continuous data. You are also right that I can have pseudo-resolution problem - if the number of dots will be similar on each plate.

The other interesting issue is that I can easily establish reference value (true value) but if I use GRR I will ignore this information. Maybe I can use it in separate bias study with the same data?

I was also thinking about using Intraclass Correlation Coefficient (ICC). Do you have any opinion about it?

Piotr
 
J

Jan Rew

#4
Hi,

for the sake of simplicity why not try a Kappa method (e.g. acc. to MSA 4th Edition) ? Assuming that you are not necesserily interested in measure of spread of number of holes reported by operators (I mean EV, AV) but only in their effectiveness of finding out a correct number, you could easily get data for Kappa calculations (ready-to-use):

I would imagine a set of, say, 40 plates with different number of holes. Operator would know required number of holes for each plate. Some plates (say 21) would have required number (conforming parts), some (remaining 19) would have a bit too much or too few holes (those plates would act as non-conforming parts). The rest of procedure could be identical as in widely-known Kappa method.

If Kappa and other indices (false alarm rate, missed alarms rate) would come out to be acceptable, the task is done. Measurement (in fact - inspection system) capability is proved.
If Kappa or other indices would be unaaceptable, you could try to identify causes looking at capability indices for individual operators.

Just an idea, not requiring extra statistical methods.
What do you think ?

Greetings from Poland!
Jan
 

Miner

Forum Moderator
Leader
Admin
#5
Yes, you can use the true value in a bias study. If you choose to go with the Ordinal Attribute agreement analysis, you can include the true value also.

The ICC is a good measure provided that you include both Repeatability and Reproducibility into the calculation. It is not commonly used because more people are familiar with %SV or ndc, etc.
 

Bev D

Heretical Statistician
Leader
Super Moderator
#6
I do use the ICC and the Youden plot as well as bland-altman for quantifying bias from truth or method comparison. (I do NOT use %tolerance or NDC)
I also perform continuous data studies on count data all of the time. my organization has many systems that count particles, blood cells, proteins, microbes etc. with counts >10 to the 10,000 range I find that treating the data as continuous is effective and useful.
 
Thread starter Similar threads Forum Replies Date
S MSA clause 7.1.5.1.1 - Statistical studies on counting weight scale Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 12
G MSA on a Counting System Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
S MSA annual plan Capability, Accuracy and Stability - Processes, Machines, etc. 4
S If 4 operate to measure, what is the value of k2?(MSA gage R&R) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
8 MSA--Should I Use Parts or Gage Pins? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
W Conducting an MSA Test on scales Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
A MSA samples Preparation. Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
N MSA Frequency related literature Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
A %AV=0 in the MSA GRR Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 6
M MSA - Dealing with inherent within-part variation in assemblies Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
T Ford Q1 MSA - Virtual Site Visit Hardware Manufacturing and Related Processes 14
R MSA on set of parts with low variation Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 20
E MSA Reference Manual 2nd Edition Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 6
W Medical Device - fixture qualification and MSA Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 0
V MSA - Using a R&R study for a Tape Measure Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 19
M Options when MSA acc. to VDA 5 is NOK (Qms > 30%) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 0
F MSA for non-contact CMM - ISO10360 Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 0
T Thermometers and Thermocouple or Transducer's require MSA? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
R MSA Studies for chemical analytical instruments in QC Lab Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
A IATF MSA study Type 1 General Measurement Device and Calibration Topics 7
Nihls MSA after the device move Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
M MSA angle issue - Nylon parts using Aberlink 3D Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 0
Ashland78 MSA clause or wording needed. Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
Nihls MSA Study Type 2 (special conditions ) IEC 60601 - Medical Electrical Equipment Safety Standards Series 0
Nihls When the MSA results show no operator influence Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
S MSA for attribute relation gage Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
Nihls MSA Study Type 1 (CMM) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
M MSA Study Type 1 not capable. We are at the limit. And manufacturing wants to continue producing. Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
I Overwhelmed with attribute MSA requirement for visual inspection IATF 16949 - Automotive Quality Systems Standard 11
H Need MSA 4th ed. compliant attribute MSA template General Measurement Device and Calibration Topics 4
P MSA for titration Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 6
P MSA - what exactly mean "system" and master sample Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
P MSA study for visual system with artifical inteligence Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
D MSA strategy Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
K Updated MSA with the Annual PPAP validations APQP and PPAP 8
E MSA for Push and Pull test Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 9
6 MSA for Calculated Clearance Dimension Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
Ron Rompen MSA on automated measurement system - Multiple Step Vision System Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
G MSA check list to audit IATF 16949 - Automotive Quality Systems Standard 10
R MSA for ATE (Automatic Test Equipment Embedded Software) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 9
Bev D MSA Tools Misc. Quality Assurance and Business Systems Related Topics 3
R MSA studies for Heat Treatment Equipment Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
C Industrial scales and MSA (IATF 16949 requirement 7.1.5.1.1) IATF 16949 - Automotive Quality Systems Standard 30
M Difference between MSA and MSE? General Measurement Device and Calibration Topics 1
M Test method validation - Is MSA (MSA1, MSA2, MSA3 and linearity) a good solution? Medical Device and FDA Regulations and Standards News 2
A MSA results differences - Supplier results vs. My results Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
R Preliminary MSA and Sockets' correlation Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 0
I MSA requirement for 5 Micrometers + CP changes need customer approval? IATF 16949 - Automotive Quality Systems Standard 2
T Correct MSA study for an automated camera system which makes attribute inspection Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
Bev D MSA Misc. Quality Assurance and Business Systems Related Topics 46

Similar threads

Top Bottom