[R] Quicker way of combining vectors into a data.frame
Prof Brian Ripley
ripley at stats.ox.ac.uk
Thu Nov 30 18:28:17 CET 2006
If you are prepared to give up most of the sanity checks, see this at the
bottom of read.table:
## this is extremely underhanded
## we should use the constructor function ...
## don't try this at home kids
class(data) <- "data.frame"
row.names(data) <- row.names
data
So create a (named?) list with your vectors in it, assign class
"data.frame" and then row.names(data) <- NULL
On Thu, 30 Nov 2006, Gavin Simpson wrote:
> Hi,
>
> In a function, I compute 10 (un-named) vectors of reasonable length
> (4471 in the particular example I have to hand) that I want to combine
> into a data frame object, that the function will return.
>
> This is very slow, so *I'm* doing something wrong if I want it to be
> quick and efficient, though I'm not sure what the best way to do this
> would be.
>
> I know it is the combining into data frame bit that is slow, because
> I've Rprof'ed it:
>
> $by.self
> self.time self.pct total.time total.pct
> "names<-.default" 16.58 52.8 16.58 52.8
> "unlist" 7.22 23.0 7.26 23.1
> "data.frame" 1.72 5.5 29.38 93.6
> "duplicated.default" 1.66 5.3 1.66 5.3
> "+" 1.20 3.8 1.20 3.8
> "list" 0.40 1.3 0.40 1.3
> "as.data.frame.numeric" 0.28 0.9 3.32 10.6
> "apply" 0.26 0.8 1.70 5.4
> "pmatch" 0.22 0.7 0.22 0.7
> "paste" 0.20 0.6 0.90 2.9
> "deparse" 0.14 0.4 0.70 2.2
> "eval" 0.12 0.4 31.28 99.7
> "names<-" 0.12 0.4 16.70 53.2
> "FUN" 0.12 0.4 1.32 4.2
> "names" 0.12 0.4 0.14 0.4
> "as.list.default" 0.12 0.4 0.12 0.4
> "duplicated" 0.10 0.3 1.76 5.6
> "gc" 0.10 0.3 0.10 0.3
>
> And I stepped through it under debug() and all the calculations before
> are quick, and then this bit takes a little over 20 seconds to complete
>
> fab <- data.frame(lc.ratio = lc.ratio, Q = Q,
> fNupt = fNupt,
> rho.n = rho.n, rho.s = rho.s,
> net.Nimm = net.Nimm,
> net.Nden = net.Nden,
> CLminN = CLminN,
> CLmaxN = CLmaxN,
> CLmaxS = CLmaxS)
>
> I can get it down to c. 5 seconds if I do (not Rprof'ed):
>
> fab <- data.frame(lc.ratio, Q,
> fNupt,
> rho.n, rho.s,
> net.Nimm,
> net.Nden,
> CLminN,
> CLmaxN,
> CLmaxS)
>
> But this still seems quite a long time, so I'm thinking that there must
> be a quicker of doing what I want (end up with a data.frame with the 10
> vectors in it).
>
> Can anyone enlighten me?
>
>> version
> _
> platform i686-pc-linux-gnu
> arch i686
> os linux-gnu
> system i686, linux-gnu
> status Patched
> major 2
> minor 4.0
> year 2006
> month 10
> day 03
> svn rev 39576
> language R
> version.string R version 2.4.0 Patched (2006-10-03 r39576)
>
>> sessionInfo()
> R version 2.4.0 Patched (2006-10-03 r39576)
> i686-pc-linux-gnu
>
> locale:
> LC_CTYPE=en_GB.UTF-8;LC_NUMERIC=C;LC_TIME=en_GB.UTF-8;LC_COLLATE=en_GB.UTF-8;LC_MONETARY=en_GB.UTF-8;LC_MESSAGES=en_GB.UTF-8;LC_PAPER=en_GB.UTF-8;LC_NAME=C;LC_ADDRESS=C;LC_TELEPHONE=C;LC_MEASUREMENT=en_GB.UTF-8;LC_IDENTIFICATION=C
>
> attached base packages:
> [1] "methods" "stats" "graphics" "grDevices" "utils"
> "datasets"
> [7] "base"
>
> Thanks in advance,
>
> G
>
--
Brian D. Ripley, ripley at stats.ox.ac.uk
Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/
University of Oxford, Tel: +44 1865 272861 (self)
1 South Parks Road, +44 1865 272866 (PA)
Oxford OX1 3TG, UK Fax: +44 1865 272595
More information about the R-help
mailing list