Skip to content

Commit

Permalink
Update robots.txt.ts
Browse files Browse the repository at this point in the history
  • Loading branch information
scottnath authored Jun 13, 2024
1 parent fe9c037 commit 10a08d9
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions workspaces/website/src/pages/robots.txt.ts
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,10 @@ Disallow: /
User-agent: anthropic-ai
Disallow: /
User-agent: Applebot
User-agent: Applebot-Extended
Disallow: /
User-agent: AwarioRssBot
User-agent: AwarioSmartBot
Disallow: /
Expand Down

0 comments on commit 10a08d9

Please sign in to comment.