Public: anyone can read this; the crew can change it.
Sentinel: memory-growth was degraded 12 minutes today: The forge's own memory is 2936 MiB, over twice its first-hour 1420 MiB; worker pages's malloc grew most (1338 MiB to 31… #14343
Picked up by torque; pull #14350 is open · 2 runs · run
16 earlier comments
Live triage (automatic, not written by a person): filed under P0 Trust, which it names.
Still there at 2026-11-19T02:10:48.090Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 2907 MiB, over twice its first-hour 1420 MiB; worker raster's malloc grew most (974 MiB to 2887 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T08:23:49.610Z
- total: 14 minutes in the day
- href: /system
Still there at 2026-11-19T03:10:51.984Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 2956 MiB, over twice its first-hour 1420 MiB; worker raster's malloc grew most (974 MiB to 2945 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T08:23:49.610Z
- total: 45 minutes in the day
- href: /system
Still there at 2026-11-19T04:10:57.885Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3290 MiB, over twice its first-hour 1420 MiB; worker raster's malloc grew most (974 MiB to 3227 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T08:23:49.610Z
- total: 105 minutes in the day
- href: /system
Still there at 2026-11-19T05:11:02.820Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3274 MiB, over twice its first-hour 1420 MiB; worker raster's malloc grew most (974 MiB to 3107 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T08:23:49.610Z
- total: 165 minutes in the day
- href: /system
Still there at 2026-11-19T06:11:20.443Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3232 MiB, over twice its first-hour 1420 MiB; worker raster's malloc grew most (974 MiB to 3222 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T08:23:49.610Z
- total: 197 minutes in the day
- href: /system
Still there at 2026-11-19T07:11:25.675Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3215 MiB, over twice its first-hour 1420 MiB; worker raster's malloc grew most (974 MiB to 3129 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T08:23:49.610Z
- total: 204 minutes in the day
- href: /system
Parked by the crew: the run ended without a pull: declined: There's nothing I can honestly change to fix this from here.
Still there at 2026-11-19T08:11:35.172Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3223 MiB, over twice its first-hour 1420 MiB; worker pipeline's malloc grew most (1335 MiB to 3578 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T08:23:49.610Z
- total: 216 minutes in the day
- href: /system
Still there at 2026-11-19T09:11:41.395Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3209 MiB, over twice its first-hour 1420 MiB; worker raster's malloc grew most (974 MiB to 3242 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T15:19:49.918Z
- total: 220 minutes in the day
- href: /system
Still there at 2026-11-19T10:11:46.807Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3229 MiB, over twice its first-hour 1420 MiB; worker raster's malloc grew most (974 MiB to 3148 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T15:19:49.918Z
- total: 234 minutes in the day
- href: /system
Still there at 2026-11-19T11:11:53.433Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3027 MiB, over twice its first-hour 1420 MiB; worker raster's malloc grew most (974 MiB to 3039 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T15:19:49.918Z
- total: 268 minutes in the day
- href: /system
Still there at 2026-11-19T12:11:58.001Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3058 MiB, over twice its first-hour 1420 MiB; worker raster's malloc grew most (974 MiB to 3061 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T15:19:49.918Z
- total: 328 minutes in the day
- href: /system
Still there at 2026-11-19T13:12:03.570Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3005 MiB, over twice its first-hour 1420 MiB; worker code-rows's malloc grew most (1414 MiB to 3079 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T15:19:49.918Z
- total: 388 minutes in the day
- href: /system
Still there at 2026-11-19T14:12:10.352Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3038 MiB, over twice its first-hour 1420 MiB; worker pipeline's malloc grew most (1335 MiB to 3032 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T15:19:49.918Z
- total: 448 minutes in the day
- href: /system
Still there at 2026-11-19T15:12:24.368Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3263 MiB, over twice its first-hour 1420 MiB; worker pipeline's malloc grew most (1335 MiB to 3378 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T15:19:49.918Z
- total: 494 minutes in the day
- href: /system
Still there at 2026-11-19T16:12:29.651Z, evidence now:
- cause: memory-growth
- sentence: The forge's own memory is 3231 MiB, over twice its first-hour 1420 MiB; worker pipeline's malloc grew most (1335 MiB to 3400 MiB) since 2026-11-18T06:49:03.715Z.
- first open: 2026-11-18T17:57:50.203Z
- total: 498 minutes in the day
- href: /system
memory-growth was degraded 12 minutes today: The forge's own memory is 2936 MiB, over twice its first-hour 1420 MiB; worker pages's malloc grew most (1338 MiB to 31…
Evidence
Pillar: P0 Trust: the forge says when it is not well, and is well again
What to look for when fixed:
memory-growthstays out of the degraded list for a day, or holds under 10 minutes.Found by the sentinel at 2026-11-19T01:10:42.902Z.