mirror of
https://github.com/standardebooks/web.git
synced 2025-07-21 23:04:57 -04:00
Add configuration to stop rude bot crawlers using fail2ban
This commit is contained in:
parent
8f2df6ac12
commit
5b0d37824b
3 changed files with 9 additions and 1 deletions
|
@ -1 +1,4 @@
|
|||
Sitemap: https://standardebooks.org/sitemap
|
||||
|
||||
User-agent: *
|
||||
Disallow: /honeypot
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue