Skip to content
Prev 76766 / 398502 Next

(no subject)

This is a general issue with all (gradient-based) optimization methods when
the response to be optimized has many local optima and/or is poorly
conditioned. As Doug Bates and others have often remarked, finding good
starting values is an "art" that is often problem-specific. Ditto for "good"
parameterizations. There is no universal "magic" answer.

In many respects, this is the monster hiding in the closet of many of the
complex modeling methods being proposed in statistics and other disciplines:
when the response function to be optimized is a nonlinear function of "many"
parameters, convergence may be difficult to achieve. Presumably stochastic
optimization methods like simulated annealing and mcmc are less susceptible
to such problems, but they pay a large efficiency price to be so.

Cheers,

-- Bert Gunter
Genentech Non-Clinical Statistics
South San Francisco, CA