[Rd] benchmarking R installations

[Simon Urbanek]

On Jun 3, 2008, at 3:58 AM, Ludo Pagie wrote:

> recently there was a post on R-help/Rd ?? with this link on  
> benchmarking different 'number crunching packages'. They used a  
> series of tests, although I didn't check they used all the types you  
> mentioned. I couldn't find test code at first glance but myyebe it  
> is available on request???
>
> http://www.sciviews.org/benchmark/
>

It's quite outdated and doesn't work with the current R versions, but  
I have an updated version that works. I have put some benchmarks I'm  
aware of at
http://r.research.att.com/benchmarks/

Cheers,
Simon


>
>
> On Mon, 2 Jun 2008, Mark Kimpel wrote:
>
>> Recently I posted to this list with a question about using the  
>> Intel 10.1
>> compilers in building R and one response was basically, "why in the  
>> heck
>> would you want to do that?" The answer is that my sysadmin believes  
>> that
>> there will be a performance boost with the Intel vs. Gnu compilers  
>> on our
>> Linux cluster, of which I am one of many users. Wanting to be a  
>> good citizen
>> and use my machine time wisely, I'd of course like to use right  
>> tool to
>> build the most efficient installation of R and associated packages.  
>> BTW, we
>> got R to compile nicely using the settings at the end of this post.
>>
>> Looking back on previous posts, however, it seems that there is no  
>> consensus
>> as to how to benchmark R. I realize such a task is not trivial, nor
>> controversial, but does anyone have a set of time-consuming tasks  
>> that can
>> be used to compare R installations? It would seem logical that such a
>> benchmark would include sub-benchmarks on file access, interpreted  
>> intensive
>> tasks, C intensive tasks, BLAS intensive tasks, etc. You developers  
>> know
>> more about this than I do, but I know enough to realize that there  
>> won't be
>> one simple answer. Nevertheless, I'd like to make my usage  
>> decisions on
>> something rather than anedotal claims.
>>
>> So, does anyone know of a good benchmarking script or would be  
>> willing to
>> contribute one?
>>
>> And here are the settings we used to compile R with Intel 10.1  
>> compilers:
>>
>> ../configure --prefix=/N/u/mkimpel/R_HOME/R-patched/R-build \
>> --with-system-zlib=/usr/lib64 --with-system-bzlib=/usr/lib64 \
>> --with-mpi=/N/soft/linux-rhel4-x86_64/openmpi/1.2.5/intel-64 --with- 
>> tcltk \
>> --with-tcl-config=/N/soft/linux-rhel4-x86_64/tcl8.4.16/lib64/ 
>> tclConfig.sh \
>> --with-tk-config=/N/soft/linux-rhel4-x86_64/tk8.4.16/lib64/ 
>> tkConfig.sh \
>> --without-x --without-readline --without-iconv \
>> CC="/N/soft/linux-rhel4-x86_64/intel/cce/10.1.013/bin/icc" \
>> CFLAGS="-O3 -no-prec-div -unroll" \
>> F77="/N/soft/linux-rhel4-x86_64/intel/fce/10.1.013/bin/ifort" \
>> FFLAGS="-O3 -no-prec-div -unroll" \
>> CXX="/N/soft/linux-rhel4-x86_64/intel/cce/10.1.013/bin/icpc" \
>> CXXFLAGS="-O3 -no-prec-div -unroll" \
>> FC="/N/soft/linux-rhel4-x86_64/intel/fce/10.1.013/bin/ifort" \
>> FCFLAGS="-O3 -no-prec-div -unroll" \
>> OBJC="/N/soft/linux-rhel4-x86_64/intel/cce/10.1.013/bin/icc" \
>> OBJCFLAGS="-O3 -no-prec-div -unroll" \
>> --disable-R-profiling --disable-memory-profiling
>> ##
>> make all
>> make install
>>
>> Mark
>>
>> -- 
>> Mark W. Kimpel MD ** Neuroinformatics ** Dept. of Psychiatry
>> Indiana University School of Medicine
>>
>> 15032 Hunter Court, Westfield, IN 46074
>>
>> (317) 490-5129 Work, & Mobile & VoiceMail
>> (317) 663-0513 Home (no voice mail please)
>>
>> ******************************************************************
>>
>> 	[[alternative HTML version deleted]]
>>
>> ______________________________________________
>> R-devel at r-project.org mailing list
>> https://stat.ethz.ch/mailman/listinfo/r-devel
>>
>
> ______________________________________________
> R-devel at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-devel
>
>