# robots.txt for https://downloads.perinet.io
#
# Everything published here is public and meant to be crawled: the
# release artifacts under the product directories, the browsable file
# tree at /files, manifest.json, and the product documentation under
# /docs/. Nothing is restricted, for search engines or for AI crawlers —
# "User-agent: *" covers both.
#
# This file must be served by the Pages deployment itself rather than
# redirected to gitlab.com like most paths here. robots.txt only ever
# applies to the host that serves it, so a 302 would put GitLab's rules
# in charge of our domain — and GitLab's robots.txt disallows /*/raw,
# which is exactly what blocked our documentation from being indexed.
# build-pages.py copies this file into public/ for that reason; see
# ROOT_SERVED there.

User-agent: *
Allow: /

# Generated by build-pages.py on every deploy, listing every URL this host
# answers with a 200. Not a git-tracked file — don't look for it in the repo.
Sitemap: https://downloads.perinet.io/sitemap.xml