Medusajsmedusajs.com

ScoredJul 24, 2026, 11:18 AM

Medusajs has a strong, machine-readable API contract and good overall discoverability — a solid foundation for a partner program. However, the two areas that most directly determine whether partners and their AI agents can successfully self-serve are significantly underdeveloped: docs lack the structured, agent-parseable formats and instruction files that modern coding agents require, and there are no runnable, test-backed collections to give agents or partners a verified path to a working integration.

API DesignA clean, typed, well-governed API contract agents can reason about4 pass1 warn0 fail94A+
SignalPointsFindingsRationale
passSchema coverage & depthvia sdk25/25package.json "types" → dist/index.d.ts. Investigated: sdk 100%, spec 42%.Typed, complete request/response schemas are what make agent function-calling possible.
passAuth declared & discoverablevia spec25/25authentication documented in the docs site at https://medusajs.com/api-keys-module/. Investigated: spec 100%, docs 100%.Agents can only authenticate when auth is declared, scoped, and discoverable.
warnMachine-readable, versioned contractvia spec18.8/25info.version="2.0.0" set but no versioning scheme (URL / header / media type) detected. Investigated: spec 75%, docs 50%.A current OpenAPI version with a declared versioning scheme lets agents reason about the contract.
passSecurity & governance hygienevia spec15/15No credential-shaped strings detected in spec. Investigated: spec 100%, wellknown 0%.No leaked secrets, no critical lint violations, no OWASP API Top-10 spec smells, and a published vulnerability-disclosure channel.
passExample coveragevia spec10/1056% example coverage (target 80%+). Investigated: spec 100%, docs 100%, sdk 50%.Examples carry shape semantics schemas under-specify — for humans and agents alike.
Developer ExperienceThe context both developers and agents need to integrate fast — onboarding, code samples, complete descriptions and worked examples4 pass0 warn1 fail79B
SignalPointsFindingsRationale
passSelf-service developer portalvia docs29/29Self-service signup at https://medusajs.com/contact/; no free tier or sandbox language detected. Investigated: docs 100%.Self-serve key/account creation is the fast first call for partners, with no sales gate.
passCode samples in docsvia docs18/18Code samples present on 1/1 pages across 1 language(s); broader multi-language coverage missing. Investigated: docs 100%.Multi-language samples shorten time-to-first-call.
passDescription completenessvia spec15/1583% description completeness (target 90%+). Investigated: spec 100%.Complete descriptions are the context humans and agents need to use endpoints.
passChangelog publishedvia spec13/13changelog documented in the docs site at https://medusajs.com/changelog/. Investigated: spec 100%, docs 100%, sdk 100%.A published changelog lets partners track changes without surprise.
failQuickstart presentvia docs0/25No quickstart/getting-started page found at the conventional paths. Investigated: docs 0%.A quickstart is the fastest path from landing page to first successful call.
Agent DiscoveryPartners and their agents can find your APIs — llms.txt, registries, crawlable and reachable docs2 pass1 warn0 fail89A
SignalPointsFindingsRationale
passllms.txt present, valid & comprehensivevia docs30/30llms-full.txt reachable at https://docs.medusajs.com/llms-full.txt. Investigated: docs 100%, sdk 0%.A valid, comprehensive llms.txt is the machine-readable entry point for agents.
passRegistry & SDK presencevia docs28/28Indexed on Context7 (rpuls/medusajs-2.0-for-railway-boilerplate, 104 snippets). Investigated: docs 100%, cli 100%, mcp 100%, sdk 17%, wellknown 0%.Listing in MCP registries and publishing SDKs puts the API where agents and their tooling look.
warnCrawlable / AEOvia wellknown3/12No sitemap discoverable via robots.txt or /sitemap.xml on the docs host. Investigated: wellknown 25%.Bots allowed plus a fresh sitemap make docs findable by agent crawlers.
naDocs reachable, not hard auth-gated—/30No surface produced evidence for this capability in this run.Agents can only index and fetch docs they can reach — past auth gates and over correct HTTP semantics.
Agent UnderstandingAgents can correctly interpret your APIs — machine-readable errors, consistent descriptions, structured data, parseable docs2 pass1 warn2 fail76B
SignalPointsFindingsRationale
passMachine-readable errors (RFC 9457)via docs28/286 distinct 4xx/5xx response codes documented. Investigated: docs 100%, spec 50%.RFC 9457 problem details and a documented error-code inventory let agents parse failures without burning tokens.
passOperation purpose clarityvia spec25/25100% of operations have a clear summary + operationId an agent can select on. Investigated: spec 100%.Agents select the right endpoint from its summary + operationId; clear, named operations make tool-selection reliable — the strongest driver of correct tool choice.
warnDescription consistency across surfaces2.1/7Mean pairwise description similarity across 2 surfaces (docs, sdk) is 11% (threshold 35% for full credit).Every surface tells the same story about what the product is.
failAgent instructions file (AGENTS.md)via wellknown0/10No AGENTS.md at the site root or /.well-known/. Investigated: wellknown 0%.An AGENTS.md gives coding agents explicit setup, auth, and usage instructions to interpret and operate the API — beyond llms.txt's link index.
failDocs structured datavia docs0/8Neither JSON-LD nor OpenGraph/meta tags detected across 1 assessed pages (1 JS-rendered). Investigated: docs 0%.Structured data (JSON-LD/schema.org) on docs pages gives agents an unambiguous parse target and is what answer engines cite. Detected on the JS-rendered head (Firecrawl) for a bounded page budget, so JS-injected JSON-LD is now caught; pages we can't render are excluded rather than failed.
naAgent-navigable, token-efficient docs—/22No surface produced evidence for this capability in this run.Server-rendered, clean, small-footprint docs are what an agent can cheaply fetch and parse correctly.
Agent UsabilityAgents have the context to use your APIs reliably, not just find them2 pass1 warn2 fail67C
SignalPointsFindingsRationale
passIdempotency documentedvia spec27/27idempotency documented in the docs site at https://medusajs.com/blog/idempotency-nodejs-express-open-source/. Investigated: spec 100%, docs 100%, sdk 0%.Documented idempotency lets agents retry safely.
passPagination documented & consistentvia spec22/22Pagination params detected on 1 list endpoint(s). Investigated: spec 100%, docs 100%.Consistent, documented pagination lets agents traverse collections.
warnSandbox separationvia sdk10/20No test-mode flag or sandbox environment is exposed. Investigated: sdk 50%, spec 0%, docs 0%.An isolated environment lets agents exercise destructive operations safely.
failRate-limit signalingvia spec0/22No rate-limit response headers documented. Investigated: spec 0%, docs 0%.Machine-readable rate-limit headers let agents throttle adaptively.
failRunnable collection with test scriptsvia platform0/9No public Postman workspace discovered for the org. Investigated: platform 0%.A public, maintained collection with assertions is runnable truth agents validate against.
Resources Discovered

The public resources we found for Medusajs — the evidence behind the score. All discovered from public sources; nothing here requires access to your systems.

Agent hintsContext7 (104)
APIs analyzed2Medusa Admin API, Medusa Storefront API
Want to improve your results?