Agent Web Census

llms.txt adoption statistics (Nov 2026)

9.9%of all 10,000 scanned top sites have llms.txt present (format check)
991sites with llms.txt present (format check)
20.0%return HTTP 200 on /llms.txt (incl. soft-404s)
Cite this: Agent Web Census, “llms.txt adoption statistics”, https://agents.datacensus.org/llms-txt-adoption/, scan of the top 10,000 websites (Tranco list V38GN) on 2026-11-18.
BucketScannedllms.txt present (format check)
top1001008.0%
top1k1,00011.6%
top10k10,0009.9%

“llms.txt present (format check)” = /llms.txt, requested on the host that served robots.txt, returned HTTP 200 with content-type text/plain or text/markdown, a body that is not HTML and starts with a Markdown heading (#). Content quality is not assessed. Many sites answer 200 with an HTML page for any path; those are not counted. The denominator is all scanned sites, not only those with a readable robots.txt. Scan repeated weekly.

Last updated: (UTC). Numbers are recomputed automatically from primary sources; see methodology.