Skip to main content

Testing

Everything below runs without any streaming subscription, headless, unattended.

pnpm verify # lint → typecheck → unit → e2e (clean) → e2e sabotage matrix
pnpm test:unit # shared reducer/policy + server integration
pnpm test:e2e # Playwright: N Chromes with the test build, fake player, fake media
pnpm test:sabotage # each flag disables one mechanism; its guarding test must fail, the rest pass
GJ_SABOTAGE=drift pnpm test:e2e # one sabotage run by hand
GJ_REUSE_SERVERS=1 TEST_SERVER_PORT=8080 TEST_PLAYER_PORT=4173 pnpm test:e2e # against your own dev servers

The Playwright suite spins up the server on :18080 and the fake player on :14173 (high ports so a dev server on 8080 never collides), launches one Chromium per peer with --use-fake-device-for-media-stream fixtures — a distinct sine per peer (440/554/659/784 Hz) and a distinct solid colour — and asserts numbers: pairwise position spread from a headless observer's ground-truth frame log, hard-seek and re-attach counters, per-peer peak frequency bin, sampled pixel colour, framesDecoded, video.volume.

make -C tools/harness fixtures builds the full fixtures with ffmpeg (labels burned into the video, a 5.5-minute test-pattern source for the fake player). When they are absent the suite writes minimal in-process equivalents, so ffmpeg is optional.

The sabotage rows run concurrently, each on its own ports and Playwright output directory (GJ_SABOTAGE_PARALLEL, default 4; set 1 on a small machine): about 3.5 minutes for the matrix on a 14-core laptop, 7 in sequence. Each row's full Playwright output is in tools/harness/test-results/sabotage-logs/<flag>.log. Sabotage runs cap every test at 100 s (the slowest passing one takes ~40 s) and skip the failure dump for tests the matrix expects to fail: under echo-suppress the peers feed each other an unbounded seek storm that jams their pages, and the dump's calls would each wait out their own timeouts against it.

Sabotage flags​

flagdisablesmust fail
reattachMutationObserver re-wiring of a recreated <video>element re-attach, quality switch
driftthe dead zone / rate band (everything hard-seeks)small drift
offscreenthe offscreen document's persistence across navigationnavigation survival, leader authority (both assert the room survives an episode transition). Service-worker termination is skipped under this flag: it kills the worker right before that navigation, and whether the restarting worker closes the document before the new content script reaches it is a race
echo-suppresstagging of locally-applied remote commandsecho suppression, large drift, small drift, quality switch (the follower's own corrective seeks move the room)
episode-startthe skip a longer copy applies from the room's episode startepisode start