Vendor: Cyan Eclipse Technologies · Platforms: CLI (local), hosted run service (planned)
What it does
- The working harness that produced every scorecard in the Eclipse fleet: per-product suites run over the wire against bench-owned fixtures — the builder's own fixtures are never used as bench evidence
- Adversarial by design: homoglyph typosquats minted by the bench itself, lying backends, duplicate-event batches, schema fuzzing generated from declared tool schemas, no-oracle error comparisons
- Verdicts are scoped and append-only: FAILED and PARTIAL cards are retained, never overwritten; bench-suite self-defects are disclosed on the card they affected
- Runs in-house today against the whole Cyan Eclipse catalog; productization as a downloadable CLI + hosted run service is slate item T1 — the paid tier (a Verity-run certification carrying the Cyan Eclipse Certified seal) is an owner decision, not yet offered
Problems it addresses
- Directories list my server on my own say-so — I want a behavioral verdict with a public scorecard
- My server passes my own tests; I need an adversary who profits from finding what I missed
Not tested
- Standalone product certification — this is a real in-house artifact being productized (connectors/tools slate T-series); no Test Bench card exists for it as a standalone product yet, and none is claimed
Evaluation-intake listing
This listing records the tool's place in the Bazaar's evaluation
and monitoring pipeline, with the evidence gathered so far printed above — verdict, scope,
and not-tested items included. It is not sold on this site, and its presence in the catalog
is not a claim beyond that evidence. The service behind every verdict is the bench:
what a bench run buys →