# robots.txt on HCRL Virtual Server # created 01/12/2000 by Paul Alexander # disallow access to all, which should help to reduce hits to hcrl.open.ac.uk User-agent: ia_archiver Disallow: User-agent: * Disallow: /