User-agent: * Allow: / Disallow: *?lightbox= Disallow: /cgi-bin/ Disallow: /Templates/ Disallow: /_notes/ Disallow: /tools/ Disallow: /seo/ Sitemap: https://www.deco-rock-cr.com/sitemap.xml # Optimization for Google Ads Bot User-agent: AdsBot-Google-Mobile User-agent: AdsBot-Google Allow: / # Block PetalBot User-agent: PetalBot Disallow: / # Crawl delay for overly enthusiastic bots User-agent: dotbot Crawl-delay: 10 User-agent: AhrefsBot Crawl-delay: 10