Files
sorsfonalak/services
fecoandClaude Opus 5.5 a6ddfc6924
CI / test (push) Successful in 1m44s
CI / build (push) Successful in 5m55s
CI / deploy (push) Skipped
robots.txt: block only AI training crawlers, let AI search in slowly
AI search engines and chat fetchers (OAI-SearchBot, ChatGPT-User,
Claude-SearchBot, PerplexityBot, ...) may now read the public pages,
with Crawl-delay: 10, so they can cite the site. Training crawlers stay
disallowed. Docs: the matching Cloudflare AI policy settings, and the
referral note no longer mentions localStorage.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_012vLHzh5qUhFtmJhzkcTbXL
2026-11-22 05:56:41 +00:00
..