Confidence Intervals on Fitted Values from lmer
I thought I'd try to contribute a couple points: 1) Overlap of 95% CIs doesn't necessarily mean that two points can't be considered as draw from populations of different means. On the other hand, examining overlap of 84% CIs may let you make this inference. Ref: http://stats.stackexchange.com/questions/1169/ci-for-a-difference-based-on-independent-cis 2) The latest version (2.1) of the ez package, released earlier this week, has an ezPredict() function that obtains lmer model predictions for fixed effects plus expected variance (n.b. the variance considers fixed effects only). Mostly a wrapper around code found at the glmm wiki (glmm.wikidot.com/faq), but possibly convenient. 3) When in doubt, bootstrap! :Op Depending on the complexity of your design, you may find the ezBoot() function from the ez package interesting. By default it can only accept 1 random effect, and fixed effects aren't allowed to affect the intercept, but you could take a look at its source and easily adapt it to a more complex situation (though you'll need to give careful consideration to formulating a proper sampling procedure in the context of those complications). Then look to ezBootPlot() for visualization inspiration. Cheers, Mike -- Mike Lawrence Graduate Student Department of Psychology Dalhousie University Looking to arrange a meeting? Check my public calendar: http://tr.im/mikes_public_calendar ~ Certainty is folly... I think. ~ On Fri, Oct 1, 2010 at 5:17 PM, Corey Godfrey
<Corey.Godfrey at cadmusgroup.com> wrote:
Yes, that seems to be the tricky part. I am able to extract what I need for the fixed effects from the variance-covariance matrix. However, the resulting confidence intervals are much wider than I believe they should be. I think this might be because the random effects are helping to explain some of the variance in the data, resulting in "significant" t-values on my fixed effects of interest, but they (the random effects) are not included in the calculation of the confidence intervals. Therefore, a plot of the fitted values and ?confidence intervals appears to show a non-significant association between fitted values and my fixed effect of interest (i.e., you could draw a straight line between the CIs). I apologize for not including the code in my post, but it is quite lengthy. I am also not a statistician or an expert in R, so am doing my best to explain this problem without getting in too far over my head. -----Original Message----- From: dmbates at gmail.com [mailto:dmbates at gmail.com] On Behalf Of Douglas Bates Sent: Friday, October 01, 2010 3:55 PM To: Corey Godfrey Cc: r-sig-mixed-models at r-project.org Subject: Re: [R-sig-ME] Confidence Intervals on Fitted Values from lmer On Fri, Oct 1, 2010 at 2:33 PM, Corey Godfrey <Corey.Godfrey at cadmusgroup.com> wrote:
Hello,
I would like to plot confidence intervals around the fitted values of a mixed effects model. Is this advisable? If so, is there a method for doing so?
First you need to decide what kind of confidence interval you have in mind, involving the fixed-effects parameters only or both the fixed- and random-effects. ?You may be able to get what you want from the variance-covariance matrix for the estimates of the fixed-effects parameters, available as vcov(fittedModel), but I can't guarantee it. I would need to think more carefully about the interpretation of the various types of variability.
_______________________________________________ R-sig-mixed-models at r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-sig-mixed-models