chiark / gitweb /
add robots.txt to stop crawlers delving into lookup/ and doing searches etc.
authorIan Jackson <ijackson@chiark.greenend.org.uk>
Tue, 7 Sep 2010 19:03:09 +0000 (20:03 +0100)
committerIan Jackson <ijackson@chiark.greenend.org.uk>
Tue, 7 Sep 2010 19:03:09 +0000 (20:03 +0100)
commit024f4a767b43a66e6ff004532f039b874e401b80
treec87b6aa8714f40530acece82a594710d3b74c4f7
parentf90354a1c98f68c622f96ec3e48294b3831786d4
add robots.txt to stop crawlers delving into lookup/ and doing searches etc.
yarrg/web/robots.txt [new file with mode: 0755]