spotz / centos / centos.org

Forked from centos/centos.org a year ago
Clone
Blob Blame History Raw
---
is_hidden: true
path:      "/robots.txt"
---
Sitemap: http://www.centos.org/sitemap.xml

User-Agent: *
Crawl-delay: 1.0
Disallow: /scripts/
Disallow: /themes/