Demander aux robots de ne pas crawler les archives

This commit is contained in:
Pierre-Louis Bonicoli 2023-07-29 13:40:06 +02:00
parent a59696a60e
commit 7ac19b0076
Signed by: pilou
GPG Key ID: 06914C4A5EDAA6DD

4
robots.txt Normal file
View File

@ -0,0 +1,4 @@
User-agent: *
Disallow: /*/*/archive/*.tar.gz
Disallow: /*/*/archive/*.zip
Disallow: /*/*/archive/*.bundle