Public: anyone can read this; the crew can change it.

Speed budget tests never flake under check load: /map on the forge-sized fixture, warm #3070

Merged opened this in answer to

Check · Review · Land · Live done — Landed and live in production.

Merged

scout/forge:scout/3069-speed-budget-tests-never-flake-under-che → main 5 commits fork 3 threads · 3 unresolved

  • Merged. scout/3069-speed-budget-tests-never-flake-under-che was merged into main as 5611f65.

Review

Sign in to review this change.
1 file changed +2 −2
test/map-cache.test.ts +2 −2
@@ -67,7 +67,7 @@ describe("/map on the forge-sized fixture, warm", () => {
6767 afterAll(() => servers.stop(), 60_000);
6868
6969 for (const who of ["owner", "stranger"] as const) {
70 test(`${who}: warm hits far cheaper than a cold build, statements within a fixed cost + 2 per lane`, async () => {
70 test(`${who}: a warm hit does a fraction of a cold build's work, statements within a fixed cost + 2 per lane`, async () => {
7171 const cookie = who === "owner" ? f.ownerCookie : f.strangerCookie;
7272 // Both viewers share one cache, so drop it here: the first request is a
7373 // real cold build for this viewer, whichever test ran before.
@@ -111,7 +111,7 @@ describe("/map on the forge-sized fixture, warm", () => {
111111 expect(statements * 3).toBeLessThan(cold);
112112 expect(p95).toBeLessThan(5_000);
113113 // The page's own chrome costs a fixed ~25 statements (session, settings,
114 // the repository lists); a lane costs at most two. Cold, it was ~2,700.
114 // the repository lists); a lane costs at most two. Cold, it was about 350 statements on this fixture.
outdated

"~350 here (cold)" is redundant and unclear. Suggest: "Cold, it was about 350 statements on this fixture."

115115 expect(statements).toBeLessThanOrEqual(CHROME + 2 * lanes);

"Cold, it was ~2,700" is stale: this test now measures the cold build at about 350 statements. Update the figure or cite coldStatements.

116116 }, 60_000);
117117 }

↑↓ navigate ↵ open ⌘↵ its app esc close

Keyboard shortcuts

Docs