MeshLive benchmark baseline

1554 executions of 393 distinct requests, 2026-10-05 to 2026-10-11 UTC, on pre-release debug builds. Only runs whose inputs are regenerable (video-stress-generator raw video, its generated reference audio, speech-v1) are included. Latest status per request: FAIL 315 · PENDING_ANALYSIS 64 · UNMEASURED 14.

No request has passed the full acceptance gates yet, and FAIL does not mean “the app does not work”. The gates are deliberately strict engineering targets (for example VMAF ≥ 90, zero freezes, first picture within 3 s, discovery ≤ 1.5 s), and a single missed gate fails the run. Of the 315 latest FAIL results, 229 (73%) reached every endpoint (picture delivered, or an active call) and then failed on a quality/timing threshold, the requested route or a control step; 59 (19%) show no connection or media recorded at any endpoint (a few of these are ambiguous), and the rest reached some but not all endpoints. The “Media reached” column shows which; the split of the latest FAILs is:

• 202 – media delivered; missed quality/timing thresholds
• 50 – never connected / no media (timeout or call never started)
• 27 – partial: some endpoints got no media
• 10 – media delivered, but not over the requested route
• 10 – connected; media not measured at some endpoint
• 9 – no media evidence recorded (ambiguous)
• 7 – media delivered; a control step was not confirmed

UNMEASURED means a required family has no adapter (camera, acoustic, physical latency, endurance are never measured here). These results depend on the phone models, their firmware and the radio environment. See README.

baseline.csv · history.csv · builds.csv · inputs/manifest.json · attempts without execution

Latest result per request