[R] Slow CRAN Mirror Action

[Uwe Ligges]

On 08.03.2016 11:01, Justace Clutter wrote:
> I have been creating a local mirror of the CRAN for my works servers.
> After a review of the CRAN mirror literature, I settled on the following
> command to perform the mirror:
>
> rsync -rtlzv --delete --exclude-from u:\CRANRSYNCFilterRules
> cran.r-project.org::CRAN .
>
> Where the CRANRSYNCFilterRules file has the following contents:
>
> ///// BEGIN SNIP
> - bin/linux
> - bin/macos
> - bin/macosx
> - bin/windows/base/old
> #- bin/windows/contrib/*
> - bin/windows/contrib/1*
> - bin/windows/contrib/2*
> - bin/windows/contrib/3.0
> - bin/windows/contrib/3.1
> + bin/
> + bin/windows/
> + bin/windows/contrib/
> + bin/windows/contrib/3.2/
> + bin/windows/contrib/3.2/***
> ///// END SNIP
>
> What I find is that the command tends to redownload a lot of files and I
> can never seem to get past the windows/contrib/3.2 directory because I have
> to leave work and go home for the day after 7 hours.  Is there something
> incorrect with my rsync command which is forcing the redownload of a lot of
> packages?  Is there a way to speed this process up?  Thank you for any help.
>

No, we rebuild really many packages on a daily basis. Once a depdendency 
changes you may need to build a new binary. So this is expected.

Best,
Uwe Ligges


> Version Information: Just in case people feel they need to know
> OS: Windows 7
> rsync: version 3.0.9  protocol version 30
> Network: hardwired to company LAN which has some form of firewall/proxy to
> the real internet
>
> Justace
>
> 	[[alternative HTML version deleted]]
>
> ______________________________________________
> R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>