[R-wiki] Summary of the discussion before creation of R-sig-wiki

[Jonathan Baron]

On 01/19/06 11:14, Paul Johnson wrote:
> And worse, or admins started running a google data base
> for searches and when it gets to the TWiki pages , it goes berserk,
> clicking all links and repeatedly slamming the search and find links
> that are on every page. It took A LOT of effort to hammer their
> templates into a form that did not strain the system.

Why not set robots.txt to prevent searches?  I really think we
would want Google searching this thing, local or global.  Twiki
has its own search, right?

user-agent: *
disallow: /

within the wiki directory.  Jon
-- 
Jonathan Baron, Professor of Psychology, University of Pennsylvania
Home page: http://www.sas.upenn.edu/~baron