[R] advice?
David Winsemius
dwinsemius at comcast.net
Tue May 4 06:31:04 CEST 2010
On May 3, 2010, at 9:48 PM, Daniel Malter wrote:
> Hi, on the one hand, you write "fairly large," on the other hand,
> you write
> "should be readable by anything." The warnings indicate that you are
> plain
> out of memory at some point. Not too surprising, given that your
> dataset has
> about 450000 rows and 720 columns. You may search the r-help files
> first for
> how to allocate memory/how to read large files, since these
> questions are
> asked frequently.
>
> The error, however, seems to refer to the fact that there are
> columns with
> identical column names, which is not allowed.
row.names
>
> Daniel
>
> -------------------------
> cuncta stricte discussurus
> -------------------------
>
> -----Original Message-----
> From: r-help-bounces at r-project.org [mailto:r-help-bounces at r-project.org
> ] On
> Behalf Of Carson Baughman
> Sent: Monday, May 03, 2010 6:17 PM
> To: R-help at r-project.org
> Subject: [R] advice?
>
> All-
> Thank you in advance for any help you might be able to lend.
> Here is
> my issue. I am trying to open a fairly large .dat file. The file
> originally was downloaded as a GZ file but I unzipped it (with 7-
> zip) into
> it's current 1.86 gig .dat format. I know that the data is "just a
> plain
> ASCII file with 720 columns and 360 rows per time step (month). It
> should be
> readable by anything!" There are 1272 steps. Here is what happens
> when I
> try to assign the file to an object:
>
>> clds<-read.table("C:\\CRU
> Data\\TS3.0\\Cloud\\cru_ts_3_00.1901.2006.cld.dat", header = TRUE,
> row.names
> = 1)
> Error in read.table("C:\\CRU
> Data\\TS3.0\\Cloud\\cru_ts_3_00.1901.2006.cld.dat", :
> duplicate 'row.names' are not allowed
> In addition: There were 45 warnings (use warnings() to see them)
>> warnings()
> 1: In scan(file, what, nmax, sep, dec, quote, skip,
> nlines, ... :
> Reached total allocation of 1535Mb: see help(memory.size)
> X 25
> 26: In type.convert(data[[i]], as.is = as.is[i], dec =
> dec, ... :
> Reached total allocation of 1535Mb: see help(memory.size)
>
>
> --
> Carson Baughman
> Cell: (406) 360-9254
> University of Alaska Fairbanks
> Scenarios Network for Alaska Planning
>
> [[alternative HTML version deleted]]
>
> ______________________________________________
> R-help at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>
> ______________________________________________
> R-help at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
David Winsemius, MD
West Hartford, CT
More information about the R-help
mailing list