[R] How to download this data

Bert Gunter bgunter.4567 at gmail.com
Tue Aug 25 21:11:15 CEST 2015


Actually, in looking again, I noticed a "download in csv" link on the
page, and this appears to provide a csv -formatted table that then can
trivially be read into R by, e.g. read.csv() .

So maybe all the html (or JSON) stuff can be ignored.


-- Bert
Bert Gunter

"Data is not information. Information is not knowledge. And knowledge
is certainly not wisdom."
   -- Clifford Stoll


On Tue, Aug 25, 2015 at 11:59 AM, Jeff Newmiller
<jdnewmil at dcn.davis.ca.us> wrote:
> I agree that this is a tricky task... even more so than using a"scraping" package because the page is built dynamically. This will take someone with skills in multiple web technologies to decipher the web page scripts to figure out how to manipulate the server to give you the data, because it isn't actually in the web page.
> ---------------------------------------------------------------------------
> Jeff Newmiller                        The     .....       .....  Go Live...
> DCN:<jdnewmil at dcn.davis.ca.us>        Basics: ##.#.       ##.#.  Live Go...
>                                       Live:   OO#.. Dead: OO#..  Playing
> Research Engineer (Solar/Batteries            O.O#.       #.O#.  with
> /Software/Embedded Controllers)               .OO#.       .OO#.  rocks...1k
> ---------------------------------------------------------------------------
> Sent from my phone. Please excuse my brevity.
>
> On August 25, 2015 11:23:26 AM PDT, Bert Gunter <bgunter.4567 at gmail.com> wrote:
>>This is not a simple question. The data are in an html-formatted web
>>page. You must "scrape" the html for the data and read it into an R
>>table (or other appropriate R data structure). Searching (the web) on
>>"scrape data from html into R"  listed several packages that claim to
>>enable you to do this "easily". Choose what seems best for you.
>>
>>You should also install and read the documentation for the XML
>>package, which is also used for this purpose, though those you find
>>above may be slicker.
>>
>>Disclaimer: I have no direct experience with this. I'm just pointing
>>out what I believe are relevant resources.
>>
>>Cheers,
>>Bert
>>Bert Gunter
>>
>>"Data is not information. Information is not knowledge. And knowledge
>>is certainly not wisdom."
>>   -- Clifford Stoll
>>
>>
>>On Tue, Aug 25, 2015 at 11:10 AM, Christofer Bogaso
>><bogaso.christofer at gmail.com> wrote:
>>> Hi,
>>>
>>> I would like to download data from below page directly onto R.
>>>
>>>
>>http://www.nseindia.com/live_market/dynaContent/live_watch/equities_stock_watch.htm
>>>
>>> Could you please assist me how can I do that programmatically.
>>>
>>> Thanks for your time.
>>>
>>> ______________________________________________
>>> R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see
>>> https://stat.ethz.ch/mailman/listinfo/r-help
>>> PLEASE do read the posting guide
>>http://www.R-project.org/posting-guide.html
>>> and provide commented, minimal, self-contained, reproducible code.
>>
>>______________________________________________
>>R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see
>>https://stat.ethz.ch/mailman/listinfo/r-help
>>PLEASE do read the posting guide
>>http://www.R-project.org/posting-guide.html
>>and provide commented, minimal, self-contained, reproducible code.
>



More information about the R-help mailing list