Skip to content
Prev 7769 / 20628 Next

Unacceptibly high autocorrelation in MCMCglmm

On Sat, 2012-03-17 at 10:29 +0000, Jarrod Hadfield wrote:
Hi Jarrod, I think I've figured out why this is not working. I hope you
or someone can suggest a fix.

I am analyzing ratings data of observations of teacher performance.
Teachers are rated on more than one occasion on a 1-4 scale on 10
components. The object is to calculate the ICC as a measure of
interrater reliablility (the percent of total variance attributed to
differences in teacher performance = variance in emplid/total variance).
This analysis worked perfectly
fine using MCMCglmm with the 10 components as fixed effects.

What I'm doing now (which is NOT working) is calculating one single
summative rating per teacher based on combinations of all the component
ratings a teacher received in a year. That means only one datum per
teacher per year: no separate components and no multiple observations.
So, including the teacher ID (emplid) as a random effect will screw
things up because there is only one datum per teacher and no
within-teacher variance. 

Do you have any idea how to get around this problem?

Thank you very much for your help.