[R-sig-ME] lmer() fit
b.pelzer at maw.ru.nl
Wed May 18 09:59:40 CEST 2016
I used Julia to do a similar job some months ago with about 35 fixed
effects and one random slope. On my PC (older type i7 processor,
windows 7, 12 Gb memory) Julia was about 5 to 6 times as fast as lmer in
R. Since I had to estimate many models, one after the other, I could
also use the parallel processing option in Julia, which resulted in
about 20 times as fast per model as in R. To be honest: I did not use
the same facility in R, which exists, but just to give you an idea.
On 17-5-2016 21:43, Ben Bolker wrote:
> This doesn't seem like a big deal. The following fit takes about 4.5
> seconds on my Macbook Pro.
> nRE <- 20000
> nobs <- 250000
> dd <- data.frame(f=sample(1:nRE,size=nobs,replace=TRUE),
> dd$y <- simulate(~x+(1|f),
> system.time(fit <- lmer(y~x+(1|f),
> If you have lots of fixed effects or very complex random effects,
> things could get a bit slower. If you have a *much* bigger problem than
> this -- or if you're going to want to this sort of thing thousands of
> times in a row and 4.5 seconds is too slow -- you might want to talk to
> Doug Bates about the MixedModels package for Julia ...
> On 16-05-17 02:23 PM, Chaitanya Acharya wrote:
>> Hi, Apologies for a very non-specific question. Any idea how many
>> random effects could lmer() reasonably fit? I am thinking of a
>> situation where I want to fit ~20k random effects with ~250k
>> observations. What kind of issues should I foresee?
>> Thanks, Chuck _______________________________________________
>> R-sig-mixed-models at r-project.org mailing list
> R-sig-mixed-models at r-project.org mailing list
More information about the R-sig-mixed-models