User-agent: * Allow: / Allow: /index.html Allow: /all.html Allow: /rss.xml Allow: /atom.xml Allow: /feed.json Disallow: /webcam.htm Disallow: /v6r/ Disallow: /fsociety00.dat Sitemap: https://blog.x-way.org/sitemap.xml Crawl-delay: 5 Request-rate: 1/5s