[R] Forward Stepwise regression with stepAIC and step

Edgar Acuna edgar at cs.uprm.edu
Thu May 8 13:19:41 CEST 2003


Paul,
Try this
l1<-lm(waterusage~product,data=wateruse)
water.forw<-step(l1,scope=~.+avetemp+days+payroll+rubbish,direction="forward")

Good luck

Edgar
University of Puerto Rico

On Thu, 8 May 2003 pfm401 at lineone.net wrote:

> Dear all,
>
> I cannot seem to get the R functions step or stepAIC to perform forward
> or stepwise regression as I expect. I have enclosed the example data in
> a dataframe at the end of this mail. Note rubbish is and rnorm(17) variable
> which I have deliberately added to the data to test the stepwise procedure.
>
> I have used
>
> wateruse.lm<-lm(waterusage~.,data=wateruse)   # Fit full model
> wateruse.lm.back<-stepAIC(wateruse.lm,trace=FALSE)
>
> in which rubbish is removed (calling wateruse.lm.back$anova gives
>
> Step         Df Deviance Resid. Df Resid. Dev      AIC
> 1           NA       NA        11   743720.8 193.6655
> 2 - rubbish  1 76.67448        12   743797.5 191.6673
>
> However if I run
>
> wateruse.lm.forward<-stepAIC(wateruse.lm,trace=FALSE,direction="forward")
>
> wateruse.lm.forward$anova gives
>
> Stepwise Model Path
> Analysis of Deviance Table
>
> Initial Model:
> waterusage ~ avetemp + product + days + payroll + rubbish
>
> Final Model:
> waterusage ~ avetemp + product + days + payroll + rubbish
>
>
>   Step Df Deviance Resid. Df Resid. Dev      AIC
> 1      NA       NA        11   743720.8 193.6655
>
>
> In other words no forward procedure has been run (similar results apply
> if I use direction="step")!!
>
> What am I doing wrong?? Thanks in advance for any help.
>
> Thanks, Paul.
>
>
>
>
>
>
>
> > wateruse
>    waterusage avetemp product days payroll    rubbish
> 1        3067    58.8    7107   21     129 -0.8393514
> 2        2828    65.2    6373   22     141 -0.8781807
> 3        2891    70.9    6796   22     153  1.1939278
> 4        2994    77.4    9208   20     166  0.2230589
> 5        3082    79.3   14792   25     193  1.7165612
> 6        3898    81.0   14564   23     189 -0.3810258
> 7        3502    71.9   11964   20     175 -0.1891337
> 8        3060    63.9   13526   23     186  1.1204482
> 9        3211    54.5   12656   20     190  2.6239803
> 10       3286    39.5   14119   20     187  0.9282131
> 11       3542    44.5   16691   22     195 -1.7371026
> 12       3125    43.6   14571   19     206 -0.1368085
> 13       3022    56.0   13619   22     198  1.3408773
> 14       2922    64.7   14575   22     192 -0.1125558
> 15       3950    73.0   14556   21     191  0.4668919
> 16       4488    78.9   18573   21     200  0.6309489
> 17       3295    79.4   15618   22     200  1.0918370
>
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://www.stat.math.ethz.ch/mailman/listinfo/r-help
>




More information about the R-help mailing list