llms.txt adoption statistics (Nov 2026)
9.9%of all 10,000 scanned top sites have llms.txt present (format check)
991sites with llms.txt present (format check)
20.0%return HTTP 200 on /llms.txt (incl. soft-404s)
- As of 2026-11-18, 9.9% of all 10,000 scanned top sites have an llms.txt present (format check: HTTP 200, text/plain or text/markdown, starts with a Markdown heading, not HTML; requested on the host that served robots.txt).
Cite this: Agent Web Census, “llms.txt adoption statistics”, https://agents.datacensus.org/llms-txt-adoption/, scan of the top 10,000 websites (Tranco list V38GN) on 2026-11-18.
| Bucket | Scanned | llms.txt present (format check) |
|---|---|---|
| top100 | 100 | 8.0% |
| top1k | 1,000 | 11.6% |
| top10k | 10,000 | 9.9% |