adeepak at apple.com
Fri Jun 23 02:00:59 CEST 2017
Sorry, I don’t think you understand my problem. dta = spark_read_csv(sc,”data_tbl”,”extension/file",delimiter = "|")
dta is just a pointer to spark where the data is stored. I am using sparklyr to run this on spark. I’m not running it locally so I can’t use the $. I know how to do this locally in R.
> On Jun 22, 2017, at 4:52 PM, Jeff Newmiller <jdnewmil at dcn.davis.ca.us> wrote:
> Rows are horizontal, columns are vertical.
> You really need to spend some time with an R tutorial.
> dta <- read.table( "yourfile", header=TRUE, as.is=TRUE )
> dta2 <- dta
> dta2$D <- c( "awe", "abcd", "asdf", "xyz" )
> dta2 <- dta2[ , c( "A", "D" ) ]
> Sent from my phone. Please excuse my brevity.
> On June 22, 2017 11:22:57 AM PDT, Amrith Deepak <adeepak at apple.com> wrote:
>> I am using Spark and the Sparklyr library in R.
>> I have a file with several lines. For example
>> A B C
>> awer.ttp.net Code 554
>> abcd.ttp.net Code 747
>> asdf.ttp.net Part 554
>> xyz.ttp.net Part 747
>> I want to split just column A of the table and I want a new row added
>> to the table D, with values awe, abcd, asdf, and xyz. I am trying to
>> use a command in the sparkly library to do that. If that’s not
>> possible, can you please show me another way to do it.
>> [[alternative HTML version deleted]]
>> R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see
>> PLEASE do read the posting guide
>> and provide commented, minimal, self-contained, reproducible code.
> R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
[[alternative HTML version deleted]]
More information about the R-help