JAN2 said:
Could you tell me what is KAPPA
How to rede and how to calculate
This was culled from various sources:
'The ratio of the proportion of times that the appraisers agree (corrected for chance agreement) to the maximum proportion of times that the appraisers could agree (corrected for chance agreement).
Kappa Statistics: If you have a known standard for each rating, you can assess the correctness of all appraisers' ratings compared to the known standard. If Kappa = 1, then there is perfect agreement. If Kappa = 0, then there is no agreement. The higher the value of Kappa, the stronger the agreement. Negative values occur when agreement is weaker than expected by chance, but this rarely happens. Depending on the application, Kappa less than 0.7 indicates that your measurement system needs improvement. Kappa values greater than 0.9 are considered excellent'
There was a article in Quality Progress "When Quality Is a Matter of Taste, Use Reliability Indexes", that gave a good overview of kappa and intraclass correlation.
Bob