trantor/robots.txt

User-agent: *
Disallow: /flag/
Disallow: /delete/
Disallow: /edit/
Disallow: /save/
Disallow: /download/
Add robots.txt 2014-09-07 02:49:39 -05:00			`User-agent: *`
Add bad quality flag 2014-09-07 20:22:24 -05:00			`Disallow: /flag/`
Add robots.txt 2014-09-07 02:49:39 -05:00			`Disallow: /delete/`
			`Disallow: /edit/`
			`Disallow: /save/`
Update gpg key and robots to disallow /download/ 2019-01-16 18:02:13 +00:00			`Disallow: /download/`