Hello, I am working on a project, in which we asked 5 raters to evaluate a bone dyplasia. All raters evaluated the dysplasia between o and 3. 0: normal 1: mild dysplasia 2: moderate dysplasia 3: severe dysplasia All raters evaluated same specimens in 2 different time points. We want to report intra and interrater ICC. I finished the initial anaylsis using SPSS. What I wanted to ask was, whether I needed to report single measurement or average measurement?
it look like you are using "ordinal data " 0,1,2 (categorical) .The perfect test of reliability is interater reliability -Cohen kappa value. Calculate cohen kappa separately for two separate points and compute average agreement. (e.g Time 1 agreement= 0.85 time 2 agreement =0.95, the cohens kappa value is 0.90 ). If you use interval data, use intraclass correlation, select two way random and agreement.
![Fleiss Kappa [Simply Explained]](http://i.ytimg.com/vi/ga-bamq7Qcs/mqdefault.jpg)
Thank you! very useful tutorial! after I have watched many 'calculating ICC in SPSS' videos, this is the most useful one (at least for me)
This video has ICC=0.8 with what I was exactly looking for. Thank you for a great explanation!
Very clear and excellent demo!!!!
I got better understanding of ICC in SPSS. Thank you
Thank you for your video. It was, again, very informative and useful!
Thanks you sir
Hello,
I am working on a project, in which we asked 5 raters to evaluate a bone dyplasia. All raters evaluated the dysplasia between o and 3.
0: normal
1: mild dysplasia
2: moderate dysplasia
3: severe dysplasia
All raters evaluated same specimens in 2 different time points. We want to report intra and interrater ICC.
I finished the initial anaylsis using SPSS.
What I wanted to ask was, whether I needed to report single measurement or average measurement?
Thank you!
it look like you are using "ordinal data " 0,1,2 (categorical) .The perfect test of reliability is interater reliability -Cohen kappa value. Calculate cohen kappa separately for two separate points and compute average agreement. (e.g Time 1 agreement= 0.85 time 2 agreement =0.95, the cohens kappa value is 0.90 ).
If you use interval data, use intraclass correlation, select two way random and agreement.
Thank you this is helpful
Very useful video! Thank you!
You're welcome!
Is intraclass correlation coefficient is for continuous values range in quantitative data?
Thank you for your explanation
You're welcome!
Thanks. Which raters to select now?
i want to ask about the numbers that the raters put what does it refer to ?
Hello, what do i do if, like in this case, ICC(1) is lower than 0,7? Thank you