paste.chapril.org-privatebin/robots.txt

# Might as well keep robots away for performance and privacy reasons.
User-agent: *
Disallow: /
Allow: /index.php
For server-load and privacy reasons, disallow robots. 2012-08-02 17:23:04 +02:00			`# Might as well keep robots away for performance and privacy reasons.`
			`User-agent: *`
Incorrect structure The structure for robots.txt is incorrect for some/most search engines. 2013-11-01 01:22:16 +01:00			`Disallow: /`
Change order of allow rule in robots.txt I think this is the proper order. Don't know if it matters, but it is not bad to change it in any case. 2016-07-03 13:05:26 +02:00			`Allow: /index.php`