troubleshooting data structure to run krippendorff's alpha

Hi Hallie,
I tried both the "cccUst" and "cccvc" functions in the "cccrm"
package. While I can get what looks like sensible statistics with the
following example, I am not sure that it can be interpreted as you
wish. For one thing, it assumes that the concordance will be the same
on all variables. I was not able to get a statistic on each variable
separately. Perhaps someone who is more familiar with the package can
offer better advice. Also, check the "hkdf" data frame to ensure that
it looks like your data.

hkdf<-data.frame(rater=rep(1:3,each=24),occasion=rep(rep(1:4,each=6),3),
 var=rep(rep(1:6,4),3),obs=runif(72))
library(cccrm)
cccUst(hkdf,"obs","rater","occasion")
cccvc(hkdf,"obs","rater","occasion")

Jim

Hi Hallie,
If I understand your email correctly, you have four repeated
observations by the three raters of the same six variables. This is a
tougher problem and I can't solve it at the moment. I'll return to
this later and see if I can offer a solution.


Jim