tonytins/tonybark.com
2
0
Fork 0
mirror of https://github.com/tonytins/tonybark.com.git synced 2025-03-15 07:21:21 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Block AI

Browse source
This commit is contained in:
Tony Bark 2024-12-07 15:49:29 -05:00
parent 4bc3dd5ca4
commit 93c011eed9
1 changed files with 24 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

24
static/robots.txt Normal file
View file

@ -0,0 +1,24 @@
User-Agent: GPTBot
User-Agent: ChatGPT-User
User-Agent: ClaudeBot
User-Agent: anthropic-ai
User-Agent: CCBot
User-Agent: FacebookBot
User-Agent: Twitterbot
User-Agent: PerplexityBot
User-Agent: OmigiliBot
User-Agent: AISearchBot
User-Agent: mlbot
User-Agent: PetalBot
User-Agent: Amazonbot
User-Agent: DuckAssistBot
User-Agent: OAI-SearchBot
User-Agent: OAI-SearchBot
User-Agent: omgili
User-Agent: omgilibot
User-Agent: PerplexityBot
User-Agent: Webzio-Extended
User-Agent: Meta-ExternalAgent
User-Agent: Meta-ExternalFetcher
User-Agent: cohere-ai
Disallow: /