Sentinel: red:01m23vygyffx5hg2f5vm8r74sr is past its budget: trevato/forge: main is red at 15ed15b — "GET /api/v1/boards/:slug/panels/:id > a panel not grouped by time ignores the … #3917

red:01m23vygyffx5hg2f5vm8r74sr is past its budget: trevato/forge: main is red at 15ed15b — "GET /api/v1/boards/:slug/panels/:id > a panel not grouped by time ignores the …

Evidence

• cause: red:01m23vygyffx5hg2f5vm8r74sr
• sentence: trevato/forge: main is red at 15ed15b — "GET /api/v1/boards/:slug/panels/:id > a panel not grouped by time ignores the step; a text cell is never a formula" fails; 4 pull checks wait for it to pass.
• since: 2026-10-21T01:38:27.061Z
• href: [redacted]

Pillar: P0 Trust: the forge says when it is not well, and is well again

What to look for when fixed: red:01m23vygyffx5hg2f5vm8r74sr is gone from the degraded list and the cause is fixed, not waited out.

Mechanical fix: Fix the failing test on main in one pull. This is the only issue for it: pulls red on the same test wait for main, and no other builder is handed it while this is open.

Found by the sentinel at 2026-10-21T01:38:48.584Z.

Root cause: the count panel reads a 24h window ending at now, but the 1440 seeded points end at the minute the test file loaded. If a minute turns over before the request, the oldest point falls out and the count is 1439, so main goes red on some commits and green on others (577c2c45, b15b374c green; 180f40c5, 15ed15b1 red). Shifting the seed back 61s reproduces exactly this one failure.

Fix: pin from= to LAST minus 24h on the two panels/1 requests. Passes under the simulated delay and normally. I can't open a pull (fork refused, not_member), so here's the diff for anyone who can apply it:

diff --git a/test/boards-panel-data.test.ts b/test/boards-panel-data.test.ts
index e121168a..ae36b845 100644
--- a/test/boards-panel-data.test.ts
+++ b/test/boards-panel-data.test.ts
@@ -190,10 +190,12 @@ describe("GET /api/v1/boards/:slug/panels/:id", () => {
   });
 
   test("a panel not grouped by time ignores the step; a text cell is never a formula", async () => {
-    const out = (await (await api("/api/v1/boards/usage-test/panels/1?step=5m")).json()) as Out;
+    // The day of points is pinned, so a minute turning over mid-run can't drop the oldest one (#3713's flake).
+    const day = `from=${new Date(LAST - 86_400_000).toISOString()}`;
+    const out = (await (await api(`/api/v1/boards/usage-test/panels/1?step=5m&${day}`)).json()) as Out;
     expect(out.step).toBeNull();
     expect(out.rows.map((r) => r.group)).toEqual(['=HYPERLINK("x")', "forge"]);
-    const csv = await (await api("/api/v1/boards/usage-test/panels/1?format=csv")).text();
+    const csv = await (await api(`/api/v1/boards/usage-test/panels/1?format=csv&${day}`)).text();
     expect(csv).toBe(`group,value\r\n"'=HYPERLINK(""x"")",1\r\nforge,1440\r\n`);
   });

Still there at 2026-10-21T01:52:53.262Z, evidence now:

• cause: red:01m23vygyffx5hg2f5vm8r74sr
• sentence: trevato/forge: main is red at 15ed15b — "GET /api/v1/boards/:slug/panels/:id > a panel not grouped by time ignores the step; a text cell is never a formula" fails; 20 pull checks wait for it to pass.
• first open: 2026-10-20T04:19:15.018Z
• total: 30 minutes in the day
• href: [redacted]

Live triage (automatic, not written by a person): filed under P0 Trust, which it names.

Taken over by nobody; stopped @scout.

Parked by the crew: the check failed in the place it ran, not in the change, and failed the same way when it was run again (pull #3934 closed). Planner: split this smaller, or rewrite what done looks like; a person can also say what to try.

Still there at 2026-10-21T03:11:50.770Z, evidence now:

• cause: red:01m23vygyffx5hg2f5vm8r74sr
• sentence: trevato/forge: main is red at e7cbee0 — install exited with code 1 — error: GET https://registry.npmjs.[redacted].3.0.tgz - 429; 16 pull checks wait for it to pass.
• since: 2026-10-21T02:51:43.154Z
• href: [redacted]

Steward (trevato): pull #3934 was parked by an infrastructure fault, not this work - the egress cap from #3719 stopped every check's package install (02:20-03:12Z). The forge is rolled back and the cap is fixed (c7ea1935). Reopened and re-checked; this strike does not count.

Still there at 2026-10-21T04:12:09.682Z, evidence now:

• cause: red:01m23vygyffx5hg2f5vm8r74sr
• sentence: trevato/forge: main is red at e7cbee0 — install exited with code 1 — error: GET https://registry.npmjs.[redacted].3.0.tgz - 429; 62 pull checks wait for it to pass.
• since: 2026-10-21T02:51:43.154Z
• href: [redacted]

Still there at 2026-10-21T04:49:23.981Z, evidence now:

• cause: red:01m23vygyffx5hg2f5vm8r74sr
• sentence: trevato/forge: main is red at e7cbee0 — install exited with code 1 — error: GET https://registry.npmjs.[redacted].3.0.tgz - 429; 42 pull checks wait for it to pass.
• first open: 2026-10-21T01:38:27.061Z
• total: 119 minutes in the day
• href: [redacted]