Use more refined robots.txt template

The previous one possibly also blocks RSS feeds.
This commit is contained in:
Simon Bruder 2021-12-11 17:44:14 +01:00
parent 281157346e
commit c28363e47a
Signed by: simon
GPG key ID: 8D3C82F9F309F8EC

View file

@ -1,3 +1,4 @@
User-agent: * User-agent: *
Sitemap: {{ get_url(path="sitemap.xml") }} Sitemap: {{ get_url(path="sitemap.xml") }}
Disallow: /formats/* Disallow: /formats/*/index.html
Disallow: /formats/index.html