Mercurymercury.com

ScoredJul 21, 2026, 06:18 PM

Mercury's API design and documentation quality are clear strengths, giving partners a solid foundation to build against. The most critical gaps are in agent readiness and partner activation: there is no structured context file to guide AI agents operating on your API, and no runnable collection to let partners — or their agents — make a verified first call without guesswork.

API DesignA clean, typed, well-governed API contract agents can reason about4 pass1 warn0 fail98A+
SignalPointsFindingsRationale
passMachine-readable, versioned contractvia spec25/25Versioning declared (info.version="1.0.0") and url-versioning detected. Investigated: spec 100%, docs 100%.A current OpenAPI version with a declared versioning scheme lets agents reason about the contract.
passAuth declared & discoverablevia spec25/25Authentication required (global or on every operation). Investigated: spec 100%, docs 100%.Agents can only authenticate when auth is declared, scoped, and discoverable.
warnSchema coverage & depthvia sdk22.8/2541 of 633 public signatures use loose types (anyTypeRatio=0.065). Investigated: sdk 91%, spec 67%.Typed, complete request/response schemas are what make agent function-calling possible.
passSecurity & governance hygienevia spec15/15No credential-shaped strings detected in spec. Investigated: spec 100%, wellknown 0%.No leaked secrets, no critical lint violations, no OWASP API Top-10 spec smells, and a published vulnerability-disclosure channel.
passExample coveragevia sdk10/10README is present and includes a runnable quickstart. Investigated: sdk 100%, spec 0%.Examples carry shape semantics schemas under-specify — for humans and agents alike.
Developer ExperienceThe context both developers and agents need to integrate fast — onboarding, code samples, complete descriptions and worked examples2 pass1 warn1 fail68C
SignalPointsFindingsRationale
passSelf-service developer portalvia docs29/29Signup page at https://app.mercury.com/dashboard/signup; no free-tier language detected in docs/pricing. Investigated: docs 100%.Self-serve key/account creation is the fast first call for partners, with no sales gate.
passChangelog publishedvia sdk13/13Newest official SDK activity 0 day(s) ago. Investigated: sdk 100%, spec 0%, docs 0%.A published changelog lets partners track changes without surprise.
warnDescription completenessvia sdk6.9/1521/39 operations lack a description. Investigated: sdk 46%, spec 0%.Complete descriptions are the context humans and agents need to use endpoints.
failQuickstart presentvia docs0/25No quickstart/getting-started page found at the conventional paths. Investigated: docs 0%.A quickstart is the fastest path from landing page to first successful call.
naCode samples in docs—/18No surface produced evidence for this capability in this run.Multi-language samples shorten time-to-first-call.
Agent DiscoveryPartners and their agents can find your APIs — llms.txt, registries, crawlable and reachable docs1 pass3 warn0 fail79B
SignalPointsFindingsRationale
passRegistry & SDK presencevia docs28/28Indexed on Context7 (websites/mercury, 606 snippets). Investigated: docs 100%, sdk 100%, cli 0%, mcp 0%, wellknown 0%.Listing in MCP registries and publishing SDKs puts the API where agents and their tooling look.
warnllms.txt present, valid & comprehensivevia docs25.7/30No /llms-full.txt found at the candidate origins. Investigated: docs 86%, sdk 0%.A valid, comprehensive llms.txt is the machine-readable entry point for agents.
warnDocs reachable, not hard auth-gatedvia docs15/3050 JavaScript redirect(s) detected across 50 sampled pages. Investigated: docs 50%.Agents can only index and fetch docs they can reach — past auth gates and over correct HTTP semantics.
warnCrawlable / AEOvia wellknown6/12No sitemap discoverable via robots.txt or /sitemap.xml on the docs host. Investigated: wellknown 50%.Bots allowed plus a fresh sitemap make docs findable by agent crawlers.
Agent UnderstandingAgents can correctly interpret your APIs — machine-readable errors, consistent descriptions, structured data, parseable docs2 pass2 warn1 fail84A
SignalPointsFindingsRationale
passMachine-readable errors (RFC 9457)via spec28/284 distinct 4xx/5xx response codes documented. Investigated: spec 100%, docs 100%, sdk 100%.RFC 9457 problem details and a documented error-code inventory let agents parse failures without burning tokens.
passOperation purpose clarityvia spec25/25100% of operations have a clear summary + operationId an agent can select on. Investigated: spec 100%.Agents select the right endpoint from its summary + operationId; clear, named operations make tool-selection reliable — the strongest driver of correct tool choice.
warnAgent-navigable, token-efficient docsvia docs19.8/2250 of 51 endpoints have aggressive caching or missing cache headers. Investigated: docs 90%.Server-rendered, clean, small-footprint docs are what an agent can cheaply fetch and parse correctly.
warnDescription consistency across surfaces1.8/7Mean pairwise description similarity across 2 surfaces (spec, sdk) is 9% (threshold 35% for full credit).Every surface tells the same story about what the product is.
failAgent instructions file (AGENTS.md)via wellknown0/10No AGENTS.md at the site root or /.well-known/. Investigated: wellknown 0%.An AGENTS.md gives coding agents explicit setup, auth, and usage instructions to interpret and operate the API — beyond llms.txt's link index.
naDocs structured data—/8No surface produced evidence for this capability in this run.Structured data (JSON-LD/schema.org) on docs pages gives agents an unambiguous parse target and is what answer engines cite. Detected on the JS-rendered head (Firecrawl) for a bounded page budget, so JS-injected JSON-LD is now caught; pages we can't render are excluded rather than failed.
Agent UsabilityAgents have the context to use your APIs reliably, not just find them3 pass0 warn2 fail74B
SignalPointsFindingsRationale
passIdempotency documentedvia sdk27/27Built-in retry machinery is present (grep-derived). Investigated: sdk 100%, spec 0%, docs 0%.Documented idempotency lets agents retry safely.
passPagination documented & consistentvia docs22/22Pagination params detected on 2 list endpoint(s). Investigated: docs 100%, sdk 95%, spec 75%.Consistent, documented pagination lets agents traverse collections.
passSandbox separationvia sdk20/20Sandbox environments are exposed (sandbox). Investigated: sdk 100%, spec 0%, docs 0%.An isolated environment lets agents exercise destructive operations safely.
failRate-limit signalingvia spec0/22No rate-limit response headers documented. Investigated: spec 0%, docs 0%.Machine-readable rate-limit headers let agents throttle adaptively.
failRunnable collection with test scriptsvia platform0/9No public Postman workspace discovered for the org. Investigated: platform 0%.A public, maintained collection with assertions is runnable truth agents validate against.
Resources Discovered

The public resources we found for Mercury — the evidence behind the score. All discovered from public sources; nothing here requires access to your systems.

Agent hintsContext7 (606)
APIs analyzed1Mercury API
Want to improve your results?