# $Id: $ # # this implements the robots.txt protocol. # it instructs all user agents to NOT crawl the site # # This file must be accessible via HTTP on the local URL "/robots.txt" # ie: each webapp folder # # ref: http://www.robotstxt.org/orig.html User-agent: * Disallow: /