User-agent: * Crawl-delay: 600 Disallow: /admin/ User-agent: Slurp Crawl-delay: 5 Disallow: /admin/