[R] Distributed computing with R

[Roger D. Peng]

snow works well on an openMosix system, and is actually quite 
convenient since you don't have to worry about which process is going 
to which computer.  The kernel migrates the processes automatically 
(usually).

-roger

Paul Gilbert wrote:
> Tony
> 
> Thanks, this categorization has cleared up a few things I have found 
> confusing. But should I read this to mean that SNOW would not run  on  
> a  system or kernel level parallel setup?
> 
> Thanks,
> Paul Gilbert
> 
> A.J. Rossini wrote:
> 
>> Also see SNOW (which simplifies parallel programming, sits on top of
>> rpvm, Rmpi, or a socket-based system).
>>
>> Depends on whether you want parallelism on the:
>>
>> 1. User-level -- the libraries such as PVM, LAM-MPI, etc will help,
>>                 and there are various packages which provide an API
>>                 to those.
>>
>> 2. System-level -- then Condor, Sun Grid Engine / Maui scheduler, and
>>                   similar queueing/batching/allocation daemons will
>>                   help (computational grid software is usually a
>>                   generalization of this which adds authentication
>>                   and resource allocation).
>>
>> 3. Kernel-level -- then OpenMOSIX, BPROC, etc will help.
>>
>> They are mostly orthogonal.  Mostly... :-).
>>
>> best,
>> -tony
>>
>>
>>
>> Armin Roehrl <armin at xss.de> writes:
>>
>>  
>>
>>> If you do some programming, you might want to look at MPI.
>>> R-extensions for MPI exist  (RMPI).
>>>
>>> It all depends a lot on what kind of usage you envisage of your cluster.
>>> Open-PBS is also a good batch system. Maybe you also want to
>>> look at Mosix, which is a modified linux system.
>>>
>>> Depending on what your ultimate computing ressources are,
>>> maybe also look at IBM's Globus toolkit.
>>>
>>> Parallel programming is fun. The world is inherently parallel!
>>> Ciao,
>>>    -Armin.
>>>
>>> ----------------------------------------
>>> Armin Roehrl, http://www.approximity.com
>>> We manage risk
>>>
>>> ______________________________________________
>>> R-help at stat.math.ethz.ch mailing list
>>> https://www.stat.math.ethz.ch/mailman/listinfo/r-help
>>> PLEASE do read the posting guide! 
>>> http://www.R-project.org/posting-guide.html
>>>
>>>   
>>
>>
>>  
>>
> 
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://www.stat.math.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide! 
> http://www.R-project.org/posting-guide.html
>