[R] Coxph and loglik converged before variable X
Terry Therneau
therneau at mayo.edu
Thu Sep 18 14:49:13 CEST 2008
> Loglik converged before variable 1,2 ; beta may be infinite.
> I have two (related) questions:
> 1. Can I in general ignore this kind of warning and just pay attention to
> predictors which produce significant p values?
> 2. In the specific case of stepAIC, can I ignore this warning and trust
> that stepAIC will remove predictors that aren't useful contributors
> to the model.
Usually you can ignore the message, it is mostly for your information. The
key things to note are
a. When one of the coefficients goes to infinity in a Cox model, the Wald
test of significance beta/se(beta) breaks down, and is no longer reliable.
The LR test however is still valid. Hence routines like stepAIC are ok.
So are predicted values, residuals, etc etc. In fact it is pretty much only the
Wald test that needs to be ignored: it is based on a Taylor series that simply
doesn't work that far from zero. Oops -- confidence intervals based on the se
are also useless.
b. The actual value of beta that is reported depends on the convergence
criteria for the routine. So this is one case where different Cox model
functions can give results that look different. I work in medical research, and
view these differences as unimportant: if I were to tell you that your relative
risk of death was exp(11) = 59,774 fold greater than your compatriots, would the
message be substantially changed for beta of 10 or 12?
There is a statistical literature under the heading of "monotone likelihood
ratio" that worries about these coefficients and tries to fix them. Much ado
about nothing, IMHO.
c. For a large beta and a very skewed covariate the message can sometimes be
wrong. Beta is finite, just unstable. I might still prefer the LR to the Wald
in this case. Spline fits based on the truncated power basis (which Frank
Harrell uses) are one way to generate such spurious messages.
Frank has argued with me that these messages may be shedding more confusion
than illumination. He has a point.
Terry Therneau
More information about the R-help
mailing list