What this check measures
link-header-present — Discoverability.
AIDE check link-header-present — under the discoverability category. Learn what it measures, why it matters and how to fix it.
Profiles using this check: ai_ready
Why it matters
Before an AI agent can include your site in answers it has to discover it. If discovery files like robots.txt, sitemap, llms.txt are misconfigured, the bot skips your content entirely — you become invisible in rankings.
How AIDE tests it
AIDE's scanner inspects your HTML, response headers, and where applicable external signals to evaluate link-header-present, then returns PASS / WARNING / FAIL / SKIPPED against the threshold. Weight: 0.4 points, severity: low.
How to fix it
- Author robots.txt with explicit
User-agentrules; separate lines per AI bot. - Feed sitemap.xml from an auto-generating CMS or build pipeline.
- Publish llms.txt + llms-full.txt — a structured summary for AI agents.
Related resources
- Profile landing: AI_READY
- aide.tr/learn