Agent Web Census: live statistics on the AI agent ecosystem
Open numbers measured from primary sources: MCP Registry data is updated daily, the AI-crawler scan weekly — no estimates, no made-up figures. Every number links to its method and raw data.
67,391MCP servers (official registry)
20,760new MCP servers, 30 days
45,916remote MCP servers
MCP servers
- As of 2026-11-19, the official MCP Registry lists 67,391 unique MCP servers (66,298 active, 1,088 deprecated; 272,155 published versions) from 41,656 namespaces.
- 20,760 new MCP servers were first published in the official MCP Registry in the last 30 days, and 4,523 were first published on or after 2026-11-13 (rolling 7 days, as of 2026-11-19).
- In 2026-10, 16,253 new servers were first published in the official MCP Registry, a +37.3% change vs. the previous month (full calendar months).
- 68.1% of the 67,391 MCP servers in the official MCP Registry offer a remote (hosted) endpoint; 38.1% ship an installable package.
AI crawlers & the web
- As of 2026-11-18, 23.1% of the 5,806 top-10,000 sites with a readable robots.txt (13.4% of all 10,000 scanned) block at least one AI crawler by name across the whole site.
- As of 2026-11-18, 15.3% of the 5,806 top-10,000 sites with a readable robots.txt (8.9% of all 10,000 scanned) block OpenAI’s GPTBot site-wide and 14.2% (8.2% of all 10,000 scanned) block Anthropic’s ClaudeBot, versus 0.2% for Googlebot (search, not an AI-training crawler; shown for comparison).
- As of 2026-11-18, 10.0% of the 5,806 top-10,000 sites with a readable robots.txt (5.8% of all 10,000 scanned) block all four of GPTBot, ClaudeBot, Google-Extended and CCBot site-wide.
- As of 2026-11-18, 9.9% of all 10,000 scanned top sites have an llms.txt present (format check: HTTP 200, text/plain or text/markdown, starts with a Markdown heading, not HTML; requested on the host that served robots.txt).
Do remote MCP servers work?
- As of 2026-11-19, 56.7% of 45,311 remote MCP servers in the official MCP Registry completed an MCP initialize handshake without authentication; 33.4% were alive but required authentication; 9.9% failed (single weekly check).
- As of 2026-11-19, the median working remote MCP server in the official registry exposes 7.0 tools (mean 16.1), with a median initialize latency of 293 ms.
MCP uptime check → · list of working servers
New report: State of remote MCP servers — November 2026
Look up a site: Does a top website block AI crawlers? (A–Z)
For AI agents
Machine-readable: /llms.txt, JSON & CSV endpoints. Data is CC BY 4.0 — please cite “Agent Web Census” with the URL.