What this check measures
bots-training-rules — Bot Access.
AIDE check bots-training-rules — under the bot access category. Learn what it measures, why it matters and how to fix it.
Profiles using this check: ai_ready
Why it matters
Misconfiguring access for GPTBot, ClaudeBot, PerplexityBot and Google-Extended cuts both ways: block the bot and you never appear in answers; open it without controls and your content gets used against your licensing or workflow goals.
How AIDE tests it
AIDE's scanner inspects your HTML, response headers, and where applicable external signals to evaluate bots-training-rules, then returns PASS / WARNING / FAIL / SKIPPED against the threshold. Weight: 1.2 points, severity: high.
How to fix it
- Add explicit
User-agent: …rules for GPTBot, ClaudeBot, PerplexityBot, Google-Extended. - State your policy clearly: Allow or Disallow.
- Publish ai.txt to declare your AI-training data usage terms.
Related resources
- Profile landing: AI_READY
- aide.tr/learn