Claudeclaude.ai

ScoredJul 22, 2026, 05:15 PM

API Design and Agent Discovery are clear strengths — partners and agents can find and authenticate with these APIs without friction. The critical gaps are in Developer Experience and Agent Usability: there is no quickstart, code samples are absent, and descriptions are incomplete, meaning partners cannot get hands-on quickly without significant hand-holding.

API DesignA clean, typed, well-governed API contract agents can reason about2 pass1 warn0 fail87A
SignalPointsFindingsRationale
passSchema coverage & depthvia sdk25/254/4 (100%) public params are fully typed (no any/**kwargs). Analyzer confirms all methods have a derivable input schema. Investigated: sdk 100%.Typed, complete request/response schemas are what make agent function-calling possible.
passExample coveragevia sdk10/10README is present and includes a runnable quickstart. Investigated: sdk 100%, docs 0%.Examples carry shape semantics schemas under-specify — for humans and agents alike.
warnSecurity & governance hygienevia wellknown7.5/15security.txt present but missing Contact; missing or expired Expires. Investigated: wellknown 50%.No leaked secrets, no critical lint violations, no OWASP API Top-10 spec smells, and a published vulnerability-disclosure channel.
naMachine-readable, versioned contract—/25No surface produced evidence for this capability in this run.A current OpenAPI version with a declared versioning scheme lets agents reason about the contract.
naAuth declared & discoverable—/25No surface produced evidence for this capability in this run.Agents can only authenticate when auth is declared, scoped, and discoverable.
Developer ExperienceThe context both developers and agents need to integrate fast — onboarding, code samples, complete descriptions and worked examples2 pass0 warn3 fail56D
SignalPointsFindingsRationale
passSelf-service developer portalvia docs29/29Signup page at https://claude.ai/sign-up; no free-tier language detected in docs/pricing. Investigated: docs 100%.Self-serve key/account creation is the fast first call for partners, with no sales gate.
passChangelog publishedvia sdk13/13Newest official SDK activity 0 day(s) ago. Investigated: sdk 100%.A published changelog lets partners track changes without surprise.
failQuickstart presentvia docs0/25No quickstart/getting-started page found at the conventional paths. Investigated: docs 0%.A quickstart is the fastest path from landing page to first successful call.
failCode samples in docsvia docs0/18No detectable code samples across 1 sampled docs pages. Investigated: docs 0%.Multi-language samples shorten time-to-first-call.
failDescription completenessvia sdk0/158/8 operations lack a description. Investigated: sdk 0%.Complete descriptions are the context humans and agents need to use endpoints.
Agent DiscoveryPartners and their agents can find your APIs — llms.txt, registries, crawlable and reachable docs1 pass3 warn0 fail81A
SignalPointsFindingsRationale
passRegistry & SDK presencevia docs28/28Indexed on Context7 (websites/platform_claude_en, 18472 snippets). Investigated: docs 100%, sdk 100%, cli 0%.Listing in MCP registries and publishing SDKs puts the API where agents and their tooling look.
warnllms.txt present, valid & comprehensivevia docs21.4/30llms.txt found but only reachable via cross-host redirect (agents may not follow it); 1 failed to fetch. Investigated: docs 71%, sdk 0%.A valid, comprehensive llms.txt is the machine-readable entry point for agents.
warnDocs reachable, not hard auth-gatedvia docs18.8/301 of 50 sampled pages return 200 for non-existent URLs (soft 404). Investigated: docs 63%.Agents can only index and fetch docs they can reach — past auth gates and over correct HTTP semantics.
warnCrawlable / AEOvia wellknown9/12Sitemap present (2699 entries) but carries no lastmod values. Investigated: wellknown 75%.Bots allowed plus a fresh sitemap make docs findable by agent crawlers.
Agent UnderstandingAgents can correctly interpret your APIs — machine-readable errors, consistent descriptions, structured data, parseable docs1 pass1 warn2 fail72B
SignalPointsFindingsRationale
passMachine-readable errors (RFC 9457)via sdk28/28Single base error "ClaudeSDKError" with 5 subclasses. Investigated: sdk 100%.RFC 9457 problem details and a documented error-code inventory let agents parse failures without burning tokens.
warnAgent-navigable, token-efficient docsvia docs16.5/2231 of 50 sampled pages have content starting past 50% (worst 104%). Investigated: docs 75%.Server-rendered, clean, small-footprint docs are what an agent can cheaply fetch and parse correctly.
failAgent instructions file (AGENTS.md)via wellknown0/10No AGENTS.md at the site root or /.well-known/. Investigated: wellknown 0%.An AGENTS.md gives coding agents explicit setup, auth, and usage instructions to interpret and operate the API — beyond llms.txt's link index.
failDocs structured datavia docs0/8Neither JSON-LD nor OpenGraph/meta tags detected across 1 sampled pages — likely a CSR-only docs site. Investigated: docs 0%.Structured data (JSON-LD/schema.org) on docs pages gives agents an unambiguous parse target and is what answer engines cite. Detected on the JS-rendered head (Firecrawl) for a bounded page budget, so JS-injected JSON-LD is now caught; pages we can't render are excluded rather than failed.
naOperation purpose clarity—/25No surface produced evidence for this capability in this run.Agents select the right endpoint from its summary + operationId; clear, named operations make tool-selection reliable — the strongest driver of correct tool choice.
naDescription consistency across surfaces—/7Only 0 surface description(s) with ≥6 tokens available; need at least 2 to compare.Every surface tells the same story about what the product is.
Agent UsabilityAgents have the context to use your APIs reliably, not just find them1 pass0 warn2 fail53D
SignalPointsFindingsRationale
passSandbox separationvia sdk20/20Sandbox environments are exposed (sandbox). Investigated: sdk 100%.An isolated environment lets agents exercise destructive operations safely.
failIdempotency documentedvia sdk0/27No built-in retry machinery was found; transient failures are not retried. Investigated: sdk 0%.Documented idempotency lets agents retry safely.
failRunnable collection with test scriptsvia platform0/9No public Postman workspace discovered for the org. Investigated: platform 0%.A public, maintained collection with assertions is runnable truth agents validate against.
naRate-limit signaling—/22No surface produced evidence for this capability in this run.Machine-readable rate-limit headers let agents throttle adaptively.
naPagination documented & consistent—/22No surface produced evidence for this capability in this run.Consistent, documented pagination lets agents traverse collections.
Resources Discovered

The public resources we found for Claude — the evidence behind the score. All discovered from public sources; nothing here requires access to your systems.

Agent hintsContext7 (18,472)
Want to improve your results?