A
AdamP
Hi folks,
I'm hoping some of you can point me in the right direction on a particular type of measurement assessment. I've searched the forum with no luck and honestly have not had luck with Google and other web searches to find a paper I know exists which explains what I need.
And that is an extension of Fleiss' Kappa - a measure of agreement between raters often used in attribute MSAs. I put this post here in Six Sigma land since this really is not a Gage R&R sort of thing.
My scenario is: An array of radiologists and clinicians are reviewing x-ray images and each of these may have no errors, or can have 1 or more of 13 categories of errors (nominal data). Each rater sees the same set of sample images and can assign multiple results to each sample. The raters do not have to assign an equal number of errors to the samples.
Cohen's Kappa (Overall agreement between 2 raters) and Fleiss' Kappa (Kappa by category)won't get me there so the attribute agreement option in recent versions of Minitab is not helpful.
Any help is really appreciated!
Cheers,
Adam
I'm hoping some of you can point me in the right direction on a particular type of measurement assessment. I've searched the forum with no luck and honestly have not had luck with Google and other web searches to find a paper I know exists which explains what I need.
And that is an extension of Fleiss' Kappa - a measure of agreement between raters often used in attribute MSAs. I put this post here in Six Sigma land since this really is not a Gage R&R sort of thing.
My scenario is: An array of radiologists and clinicians are reviewing x-ray images and each of these may have no errors, or can have 1 or more of 13 categories of errors (nominal data). Each rater sees the same set of sample images and can assign multiple results to each sample. The raters do not have to assign an equal number of errors to the samples.
Cohen's Kappa (Overall agreement between 2 raters) and Fleiss' Kappa (Kappa by category)won't get me there so the attribute agreement option in recent versions of Minitab is not helpful.
Any help is really appreciated!
Cheers,
Adam