number of levels of grouping factor == number of observations

For what families in a generalized linear mixed model should a
grouping factor be allowed to have as many levels as there are
observations?  Just the binomial and the poisson or everything except
the gaussian family or ...?