User-agent: * Disallow: /nf Disallow: /in/nf Disallow: /resources/cdir1995 Disallow: /catch/ Disallow: /survey/ User-agent: msnbot Crawl-delay: 120 Disallow: /nf Disallow: /in/nf Disallow: /resources/cdir1995 Disallow: /catch/ User-agent: Slurp Crawl-delay: 100 Disallow: /nf Disallow: /in/nf Disallow: /resources/cdir1995 Disallow: /catch/ User-agent: dotbot Disallow: /