[R] Executing a script "hand-made" and time

[jim holtman]

What type of computer do you have now: operating system, memory.

Here is how long it took for me to read in a file with 4M lines and 13
columns of numerics on each line:

> system.time(x <- scan('/temp/large.txt', what = 0))
Read 52614432 items
   user  system elapsed
  23.67    0.67   24.39
> str(x)
 num [1:52614432] 1 1 1 1 1 1 1 1 1 1 ...
>
> object.size(x)
420915496 bytes

So how are you reading it in?  Is your system paging?  It should not
take 2 hours.

On Wed, Jun 29, 2011 at 4:43 PM, Trying To learn again
<tryingtolearnagain at gmail.com> wrote:
> Hi all,
>
> I have a function written by me that read a  matrix (data frame) from a txt
> with 4 million of rows and 13 columns.
>
> The think is my function works with an input matrix of 100x13 and now I
> tried to execute my function with the big "input file" and it is running
> form the moment two hours...
>
> There is a way to know (how much time could it cost?)
>
> The second question is...
>
> I want to buy a new computer...to threat files like this (and make on the
> if....for....loops and so on)... I need a computer with high RAM or to
> "speed" this executing time I need other "technical hardware items"....
>
> I´m sure my programmation can be simplied but anyway I hope someone can give
> me his/her opinion.
>
> Many Thaks in advance.
>
>        [[alternative HTML version deleted]]
>
>
> ______________________________________________
> R-help at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>
>



-- 
Jim Holtman
Data Munger Guru

What is the problem that you are trying to solve?