User-agent: * Allow: / Disallow: /api/ Disallow: /admin/ # AI crawl control — test with CF AI Crawl Control feature User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: ChatGPT-User Disallow: / Sitemap: https://blwltestet.tk/sitemap.xml