[R-pkgs] glmpath: L1 regularization path for glms
Trevor Hastie
hastie at stanford.edu
Mon Nov 28 02:28:46 CET 2005
We have uploaded to CRAN the first version of glmpath,
which fits the L1 regularization path for generalized linear models.
The lars package fits the entire piecewise-linear L1 regularization
path for
the lasso. The coefficient paths for L1 regularized glms, however,
are not piecewise linear.
glmpath uses convex optimization - in particular predictor-corrector
methods-
to fit the coefficient path at important junctions. These junctions
are at the "knots" in |beta|
where variables enter/leave the active set; i.e. nonzero/zero values.
Users can request greater resolution at a cost of more computation,
and compute values
on a fine grid between the knots.
The code is fast, and can handle largish problems efficiently.
it took just over 4 sec system cpu time to fit the logistic
regression path for
the "spam" data from UCI with 3065 training obs and 57 predictors.
For a microarray example with 5000 variables and 100 observations, 11
seconds cpu time.
Currently glmpath implements binomial, poisson and gaussian families.
Mee Young Park and Trevor Hastie
-------------------------------------------------------------------
Trevor Hastie hastie at stanford.edu
Professor, Department of Statistics, Stanford University
Phone: (650) 725-2231 (Statistics) Fax: (650) 725-8977
(650) 498-5233 (Biostatistics) Fax: (650) 725-6951
URL: http://www-stat.stanford.edu/~hastie
address: room 104, Department of Statistics, Sequoia Hall
390 Serra Mall, Stanford University, CA 94305-4065
--------------------------------------------------------------------
More information about the R-packages
mailing list