site/templates/robots.txt

5 lines
119 B
Plaintext
Raw Normal View History

2020-08-11 16:14:38 +02:00
User-agent: *
Sitemap: {{ get_url(path="sitemap.xml") }}
Disallow: /formats/*/index.html
Disallow: /formats/index.html