If you only need to grab text it can be conveniently done with lynx.  This
example is for Windows but its nearly the same on other platforms:

> out <- shell("lynx.bat --dump --nolist http://www.google.com", intern =
TRUE)
> head(out)
[1] ""
[2] "   Web Images Videos Maps News Books Gmail more ť"
[3] "   iGoogle | Search settings | Sign in"
[4] "   "
[5] "                                   Google"
[6] "                                      "

On Thu, Dec 3, 2009 at 5:29 PM, Michael Conklin <
michael.conklin@markettools.com> wrote:

> I would like to be able to submit a list of URLs of various webpages and
> extract the "content" i.e. not the mark-up of those pages. I can find plenty
> of examples in the XML library of extracting links from pages but I cannot
> seem to find a way to extract the text.  Any help would be greatly
> appreciated - I will not know the structure of the URLs I would submit in
> advance.  Any suggestions on where to look would be greatly appreciated.
>
> Mike
>
> W. Michael Conklin
> Chief Methodologist
>
> MarketTools, Inc. | www.markettools.com<http://www.markettools.com>
> 6465 Wayzata Blvd | Suite 170 |  St. Louis Park, MN 55426.  PHONE:
> 952.417.4719 | CELL: 612.201.8978
> This email and attachment(s) may contain confidential and/or proprietary
> information and is intended only for the intended addressee(s) or its
> authorized agent(s). Any disclosure, printing, copying or use of such
> information is strictly prohibited. If this email and/or attachment(s) were
> received in error, please immediately notify the sender and delete all
> copies
>
>
>        [[alternative HTML version deleted]]
>
> ______________________________________________
> R-help@r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>

	[[alternative HTML version deleted]]


