Fleet-scale test orchestration · 20-round methodology

Certify every project in your fleet,
one graded round at a time.

M8500 is a production-readiness orchestrator. It auto-discovers your projects, runs a graded multi-round test methodology against each one, and rolls the results into live dashboards, coverage matrices, and exportable reports — so "is it ready to ship?" has a data-backed answer.

Self-hosted · FastAPI backend · runtime-computed pass rates · MIT licensed

m8500 — batch certification
$ curl -s localhost:8500/api/v1/batch/discover
> discovered 37 projects on disk · registering new…
$ m8500 run --project m448 --rounds 1-10
R1 Smoke Test .............. PASS
R2 Functional Test ......... PASS
R5 Security Test ........... 2 findings
R7 Reliability ............. SKIPPED
R10 Deep Security Scan ...... PASS
> pass rate computed at runtime · results written to DB
$
Capabilities

A test lab that scales to your whole ecosystem

Every capability below ships in the FastAPI backend — not a roadmap.

πŸ”Ž

Filesystem auto-discovery

Points at your projects root and enumerates every project on disk. No manual registry — new projects are discovered and registered automatically at batch time.

🎯

Graded 20-round methodology

From Smoke and Functional to Security, E2E, Reliability, and Production Certification — each round carries a P0/P1/P2 blocking level and pass criteria.

πŸ§ͺ

15 pluggable test suites

Dependency health, port conflicts, env/secret scanning, code quality, coverage, integration, performance, deep security, load, CI/CD, docs, DB optimization, and more.

πŸ“Š

Live analytics dashboards

Pass-rate trends, bug-severity trends, per-project health, and a round-performance view — all served from the running orchestrator, computed at runtime.

πŸ—ΊοΈ

Coverage matrix & gaps

See which projects have run which rounds, where the blind spots are, and how coverage progresses across the fleet over time.

⏱️

Scheduled batch runs

Cron-style scheduler with presets. Queue batch tests, retry only the failures, and keep certification fresh without babysitting.

πŸ€–

AI code review (optional)

Plug in a DeepSeek API key to get AI-assisted failure analysis and remediation suggestions. Fully optional — the framework runs without it.

πŸ”Œ

Real-time + exports

WebSocket push for live run status, plus JSON/CSV exports for projects, bugs, and stats — and built-in database backups.

πŸ”

Honest pass logic

A round that passes zero real tests is not "green." Skipped-only placeholders count as failed — no false positives inflating your readiness score.

The methodology

20 rounds, from first breath to production cert

Run any subset. Each round is defined in config with its own tests and blocking level.

01Smoke Test 02Functional 03Integration 04Performance 05Security 06E2E 07Reliability 08UAT 09Perf Baseline 10Deep Security 11AI Code Review 12Load Testing 13DB Optimization 14Documentation 15CI/CD Readiness 16Monitoring 17Horizontal Scaling 18Multi-Region 19Observability 20Production Cert
How it works

From a directory of projects to a certification report

1

Discover

The orchestrator scans your projects root and registers everything it finds. GET /api/v1/batch/discover

2

Run rounds

Trigger single rounds or full batches. Each suite runs its checks and reports real pass/fail/skip. POST /api/v1/batch/test

3

Track & analyze

Watch results stream in over WebSocket and land in dashboards, trends, and the coverage matrix.

4

Export & certify

Pull JSON/CSV reports, retry only failures, and gate releases on Round 20 production certification.

Use cases

Built for teams running more projects than they can hand-test

πŸ—οΈ

Fleet readiness certification

Give every service in a large monorepo or multi-project org a graded, comparable readiness score before it ships.

🚦

Release gating

Block deploys on P0 rounds. Wire the API into CI so "certified" is a machine-checkable state, not a vibe.

🩺

Ecosystem health monitoring

Schedule recurring batch runs and track pass-rate and bug-severity trends across the whole portfolio over time.

🧰

Dependency & secret hygiene

Sweep for dependency conflicts, port collisions, and hardcoded secrets across many projects in one pass.

Pricing

Self-host it free, or let us run it for you

The orchestrator is MIT-licensed and self-hostable today. The tiers below are illustrative packaging — not published price points.

Self-Hosted
Free / open source
Run the full FastAPI orchestrator on your own infrastructure.
  • All 20 rounds & 15 test suites
  • Dashboards, analytics & exports
  • Scheduler & batch runner
  • MIT license · no usage limits
Deploy it
Team
Contact / for pricing
Managed hosting, SSO, and support for orgs certifying many projects.
  • Everything in Self-Hosted
  • Managed, hosted deployment
  • AI code review (DeepSeek) included
  • Onboarding & support
Talk to us
Enterprise
Contact / for pricing
Custom rounds, integrations, and rollout across a large ecosystem.
  • Everything in Team
  • Custom test suites & rounds
  • CI/CD & internal-tool integrations
  • Dedicated support
Talk to us

Honesty note: This project ships no billing system and defines no prices in code. Dollar figures are deliberately omitted — the "Team" and "Enterprise" tiers are sample packaging shown as "Contact for pricing." The self-hosted tier is genuinely free and open source under MIT.

// what this really is

M8500 is a real, filesystem-driven test-orchestration harness with a FastAPI backend that computes pass rates at runtime from actual test-suite runs — it is not hardwired to a fixed project count. The methodology was field-exercised across a 240-project batch (Feb–Mar 2026 run reports in the repo); those historical figures are batch reports, not a live guarantee or an SLA, and are not re-computed by the running service. No customer names, logos, uptime guarantees, or prices are claimed on this page. This is a self-hosted developer tool.

Point it at your projects and run round one.

Clone the repo, start the FastAPI backend, hit /api/v1/batch/discover, and watch your fleet get graded.

Runs on Python 3.12 · FastAPI + SQLite · MIT License