# Crawlers may fetch pages so they can honor HTML robots meta (noindex when set). # Indexing policy is controlled by release.yaml:noindex → HTML . # Do not add Disallow: / here while relying on noindex meta — blocked fetches cannot read it. User-agent: * Allow: /