03 /Run run-2026-07-08
Latest benchmark run
main@a1b2c3d · 6 cases · 9.6 s · chromium, 1 worker
Fixture data, not production. These pages render a committed, reproducible snapshot distilled from a real Playwright run of a seeded sample app. Nothing here is executed live, and no event on this page is a real user event. The runnable harness lives in
benchmarks/testora.01 /At a glance
Run summary
Passed
3
of {6}
Failed
2
seeded regressions
Flaky
1
fail-then-pass
Detection
100%
of seeded regressions
02 /Sequence
Run timeline
- 2026-07-08 09:14Run started
- 2026-07-08 09:14Sample app served
- 2026-07-08 09:142 seeded regression(s) detected
- 2026-07-08 09:141 flake identified
- 2026-07-08 09:14Run complete
03 /Results
Every case, every dimension
| Status | Case | Dimension | Duration | Artifacts |
|---|---|---|---|---|
| Suite · Authentication | ||||
| Passed | valid credentials create a session auth-valid-login | baseline | 720 ms | traceshotvideolog |
| Passed | wrong password is rejected auth-reject-bad-password | baseline | 610 ms | traceshotvideolog |
| Failed | email with trailing whitespace still logs in auth-trim-email Assertion failed: expected session-badge, got login-error. Input differed from the valid email only by trailing whitespace — the comparison is not trimmed. | detection | 2.2 s | traceshotvideolog |
| Suite · Checkout | ||||
| Passed | cart shows the correct item count checkout-item-count | baseline | 430 ms | traceshotvideolog |
| Failed | order total includes 10% tax checkout-total-includes-tax Assertion failed: expected total $55.00, got $50.00. Difference equals the 10% tax line — tax is dropped from the displayed total. | detection | 2.1 s | traceshotvideolog |
| Suite · Dashboard | ||||
| Flaky | dashboard widget loads on demand dashboard-widget-loads Failed on attempt 1 (widget never mounted), passed on retry. Fail-then-pass within a single run — a flake, not a stable regression. | flaky-detection | 2.6 s | traceshotvideolog |
04 /Diagnosis
Failure clusters
Input normalizationRegression
User input reaches a comparison or lookup without trimming/case-folding.
Assertion failed: expected session-badge, got login-error. Input differed from the valid email only by trailing whitespace — the comparison is not trimmed.
auth-trim-email
Money mathRegression
A monetary total is assembled from parts and a component is dropped.
Assertion failed: expected total $55.00, got $50.00. Difference equals the 10% tax line — tax is dropped from the displayed total.
checkout-total-includes-tax
Async raceFlaky
A UI element depends on an initialization signal that isn't awaited.
Failed on attempt 1 (widget never mounted), passed on retry. Fail-then-pass within a single run — a flake, not a stable regression.
dashboard-widget-loads
05 /Evidence
Artifact viewer
Reconstructed from the seeded state · duration {2.2 s}