Is books.toscrape.com agent ready?
books.toscrape.com is not yet agent ready: it scores 30/100 (grade F) on the w2agent rubric. Weakest areas: Agent Auth (0), Agent Discovery (0), Structured Data (10), Agent Protocols (42).
Changed since last check
+1 points since the previous check (2026-09-15)
Fixed: Response time
Category scores
Technical
63
Agent Auth
0
Agent Discovery
0
Agent Protocols
42
Content Quality
56
Structured Data
10
Bot Accessibility
53
Agent protocol panel
- A2A agent cardNot found
- OAuth discoveryNot measured
- MCP discoveryNot found
- llms.txt validityNot measured
Check results
Bot Accessibility
- ✓No error status codespass
- ✓Response timepass
- ✗XML sitemap existsfail
- ✓AI agent accesspass
- ✓Edge treatment of agent user-agentstracked, not scoredpass
- ✗robots.txt existsfail
- ✗Content negotiation (Markdown)fail
- —Declared AI usage preferencestracked, not scoredskip
Structured Data
- ✗OpenGraph meta tagsfail
- ~Semantic HTML elementspartial
- ✗Appropriate Schema.org typefail
- —JSON-LD validskip
- ~Heading hierarchypartial
- ✗Schema.org JSON-LD presentfail
- ✗Schema.org completenessfail
Content Quality
- ✗FAQ contentfail
- ✓Answer-first contentpass
- ✓Content lengthpass
- ✓Token efficiency (HTML-to-text ratio)pass
- ✗Freshness signalsfail
- ✗Author attributionfail
- ✓Citation readinesspass
- ✓Lists and tables for structured infopass
Agent Discovery
- —llms.txt follows specskip
- ✗llms.txt existsfail
- —MCP server cardtracked, not scoredskip
- ✗Markdown alternate linksfail
- ✗/.well-known/agent-card.jsonfail
- —llms.txt links resolveskip
Agent Protocols
- ✗Discoverable API endpointsfail
- ✗MCP endpointfail
- ✗Action schemasfail
- —/.well-known/ucpskip
- ✓Structured formspass
- —WebMCP imperative APItracked, not scoredskip
- —WebMCP declarative APItracked, not scoredskip
- ✓Reachable as Google-Agentpass
- ✓Reachable as ChatGPT-Userpass
- ✓Reachable as Perplexity-Userpass
Agent Auth
- —MCP authorization (401 challenge → protected resource metadata)skip
- —PKCE S256 supportskip
- ✗Public API surfacefail
- —Client ID Metadata Documents (bonus)skip
- —OpenAPI specificationskip
- —Agent/bot auth documentationskip
- —OAuth discovery chain (RFC 9728 → RFC 8414)skip
- —Developer portalskip
- —Scoped API permissionsskip
- —API catalog (RFC 9727)skip
- —Agent operator signing directorytracked, not scoredskip
Technical
- ✓HTTPSpass
- ✗UTF-8 charsetfail
- ✗Canonical URLsfail
- ✓Mobile viewportpass
- ✓Content accessible without JSpass
- ~Security headerspartial
Score history
- 30/100 · rubric v3.0
- 29/100 · rubric v3.0
- 29/100 · rubric v3.0
- 21/100 · rubric v2.0
- 21/100 · rubric v2.0
- 21/100 · rubric v2.0
- 22/100 · rubric v2.0
- 22/100 · rubric v2.0
- 22/100 · rubric v2.0
- 31/100 · rubric v2.0
- 31/100 · rubric v2.0