BoxProbe
Public lab Open-source e-commerce Independent analysis

Medusa Admin scout regression lab

A public scout-powered regression evidence hub for Medusa's admin dashboard. 15 admin scenarios captured as scout-runnable Python; replayed against pinned Medusa releases; diff reports published here. Operated by BoxProbe — independent analysis, not affiliated with the upstream project.

Medusa is an open-source headless commerce platform. Its admin dashboard is a single-page app that drives a JSON API under the hood — exactly the kind of surface where API behavior can drift across releases while the UI stays visually identical. We maintain a scout-runnable suite covering the admin's core workflows (auth, customers, inventory, orders, products, campaigns, ...) and re-run it on each release pair we publish.

Release-to-release diff reports

2.13.6 → 2.14.0

Two domain models (ProductCategory, Collection) gained an external_id field. Additive only — UI unchanged — but visible to integrations doing strict response-schema validation.

2 findings 15/15 pass Pending upstream

Next comparison in progress

We re-run the suite as Medusa publishes new releases. Latest comparison gets the most attention; earlier ones stay archived here for cross-version analysis.

In progress
15 admin user flows

Test code lives in github.com/boxprobe/scout-medusa. Same scenarios are exercised across every version comparison.

auth/login-and-logout
6 steps
critical
auth/login-with-invalid-credentials
4 steps
critical
auth/protected-routes-redirect-unauthenticated-users
3 steps
critical
api-keys/publishable-api-keys-crud
21 steps
api-keys/secret-api-keys-create
18 steps
campaigns/campaigns-crud
23 steps
categories/categories-crud
23 steps
collections/collections-crud
19 steps
customers/customer-groups-crud
18 steps
customers/customers-crud
23 steps
critical
draft-orders/draft-orders-crud
26 steps
critical
inventory/inventory-crud
23 steps
inventory/inventory-search-and-filter
12 steps
locations/location-edit
21 steps
orders/orders-export
24 steps
Run any comparison on your machine

Every report on this hub is reproducible. The scout-medusa demo repo includes Docker compose for both Medusa versions plus all 15 scenarios — clone, compose up, run scout twice, diff.

github.com/boxprobe/scout-medusa About Scout (the runner)

Operated by BoxProbe. Independent analysis — not affiliated with the upstream Medusa project unless noted. Reports here are not "verified" or "certified" by Medusa maintainers. If you maintain Medusa and would like a correction or removal, email [email protected] — we honor takedown requests within 7 days.

Want this for your application?

Send a URL and a user scenario. We'll run scout against your baseline and target and share the diff report.

Get a Free Sample Report