# robots.txt file from http://www.xrsk.com/ # All robots will spider the domain User-agent: * Sitemap: Sitemap: Sitemap: Disallow: /d/ Disallow: /e/admin/ Disallow: /e/class/ Disallow: /e/data/ Disallow: /e/enews/ Disallow: /e/tool/gfen/ Disallow: /e/update/