# Robots.txt file for domain: http://barnetjudo.co.uk/ # All robots will spider the domain User-agent: * Disallow: /archive/ Disallow: /cgi-bin/ Disallow: /css/ Disallow: /data/ Disallow: /images/ Disallow: /scripts/ Disallow: /Templates/ Disallow: /test/ Disallow: /php/ Disallow: /working/ Sitemap: http://barnetjudo.co.uk/sitemap.xml