User-Agent: * Disallow: /admin/ Disallow: /suche/ Disallow: /produkt/ # Block aggressive non-search scrapers to preserve server CPU & bandwidth User-agent: Bytespider Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: PetalBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / Sitemap: https://recomendo.de/sitemap.xml Sitemap: https://recomendo.de/sitemap_images.xml