8000 Opt-in policies for OpenAI and MistralAI bots by tabletcorry · Pull Request #590 · TecharoHQ/anubis · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Opt-in policies for OpenAI and MistralAI bots #590

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
May 31, 2025

Conversation

tabletcorry
Copy link
Contributor
@tabletcorry tabletcorry commented May 30, 2025

Add opt-in policies for well-known AI crawlers/agents with known IP allowlists (OpenAI/MistralAI).

Skipped adding Anthropic/Claude as they don't have known IP ranges.

Haven't gotten to other companies yet.

Checklist:

  • Added a description of the changes to the [Unreleased] section of docs/docs/CHANGELOG.md
  • Added test cases to the relevant parts of the codebase
  • Ran integration tests npm run test:integration (unsupported on Windows, please use WSL)

@tabletcorry tabletcorry force-pushed the tabletcorry/ai_bot_definitions branch from dfa1319 to 799542c Compare May 31, 2025 16:20
Allows OpenAI bots to be allowlisted at the choice of the Anubis administrator. None are enabled by default.
@tabletcorry tabletcorry force-pushed the tabletcorry/ai_bot_definitions branch from 799542c to 8432f3e Compare May 31, 2025 16:22
@Xe Xe merged commit 0d9ebeb into TecharoHQ:main May 31, 2025
5 checks passed
@tabletcorry tabletcorry deleted the tabletcorry/ai_bot_definitions branch May 31, 2025 20:53
JasonLovesDoggo pushed a commit to JasonLovesDoggo/anubis that referenced this pull request Jun 17, 2025
* Define OpenAI bot ALLOW policies

Allows OpenAI bots to be allowlisted at the choice of the Anubis administrator. None are enabled by default.

* Define MistralAI bot ALLOW policy

* chore: spelling
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants
0