hauleth.dev / blog
this repo has no description
fork atom

fix: update robots.txt to disable indexing of moot pages

hauleth.dev 9f65b336 db3692bd

verified
options
unified split
Changed files
+1 -1
templates
robots.txt
+1 -1
templates/robots.txt 
···

       
1

       
 

       
User-agent: *


     

       
2

       
-

       
Disallow: /cv/


     

       
3

       
 

       
Allow: /


     

       
4

       
 

       
Sitemap: {{ get_url(path="sitemap.xml") }}


     
···

       
1

       
 

       
User-agent: *


     

       
2

       
+

       
Disallow: /cv/ /404/ /common-test-example/


     

       
3

       
 

       
Allow: /


     

       
4

       
 

       
Sitemap: {{ get_url(path="sitemap.xml") }}