# Robots.txt file from http://www.cathlink.co.nz # # All robots will spider the domain Sitemap: User-agent: * User-agent: * Disallow: /cgi-bin/ Disallow: /pics/ Disallow: /_private/ Disallow: /_vti_pvt/ Disallow: /_vti_cnf/ Disallow: /_vti_bin/ Disallow: /_vti_txt/ Disallow: /_vti_log/ Disallow: /chat1/