site/templates/robots.txt

5 lines
119 B
Plaintext

User-agent: *
Sitemap: {{ get_url(path="sitemap.xml") }}
Disallow: /formats/*/index.html
Disallow: /formats/index.html