schulischer-schabernack
/
site
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Use more refined robots.txt template 

The previous one possibly also blocks RSS feeds.
master
Simon Bruder 2021-12-11 17:44:14 +01:00
parent 281157346e
commit c28363e47a
Signed by: simon
GPG Key ID: 8D3C82F9F309F8EC
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
templates/robots.txt
View File

@ -1,3 +1,4 @@
User-agent: *
Sitemap: {{ get_url(path="sitemap.xml") }}
Disallow: /formats/*
Disallow: /formats/*/index.html
Disallow: /formats/index.html