User-Agent: * Disallow: /admin/ Disallow: /cms/ Crawl-delay: 10 # Search engines User-Agent: Googlebot Disallow: /admin/ Disallow: /cms/ Crawl-delay: 10 User-Agent: Googlebot-Image Disallow: /admin/ Disallow: /cms/ Crawl-delay: 10 User-Agent: Bingbot Disallow: /admin/ Disallow: /cms/ Crawl-delay: 10 User-Agent: Slurp Disallow: /admin/ Disallow: /cms/ Crawl-delay: 10 User-Agent: DuckDuckBot Disallow: /admin/ Disallow: /cms/ Crawl-delay: 10 User-Agent: Baiduspider Disallow: /admin/ Disallow: /cms/ Crawl-delay: 10 User-Agent: YandexBot Disallow: /admin/ Disallow: /cms/ Crawl-delay: 10 User-Agent: Applebot Disallow: /admin/ Disallow: /cms/ Crawl-delay: 10 User-Agent: facebot Disallow: /admin/ Disallow: /cms/ Crawl-delay: 10 User-Agent: ia_archiver Disallow: /admin/ Disallow: /cms/ Crawl-delay: 10 # Sitemap files Sitemap: https://www.donner.nl/sitemap.xml