Sentinel: queue:check was degraded 36 minutes today: 10 checks wait behind one lane; the oldest since 02:14; the lane runs #4838 for 3 min (limit 60). #5130

queue:check was degraded 36 minutes today: 10 checks wait behind one lane; the oldest since 02:14; the lane runs #4838 for 3 min (limit 60).

Evidence

• cause: queue:check
• sentence: 10 checks wait behind one lane; the oldest since 02:14; the lane runs #4838 for 3 min (limit 60).
• first open: 2026-10-21T13:32:35.170Z
• total: 36 minutes in the day
• href: /settings/capacity

Pillar: P0 Trust: the forge says when it is not well, and is well again

What to look for when fixed: queue:check stays out of the degraded list for a day, or holds under 10 minutes.

Found by the sentinel at 2026-10-22T06:33:40.683Z.

Still there at 2026-11-09T17:39:00.682Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 2 busy; the oldest since 17:10; the longest running is a check at 20 min (limit 60).
• first open: 2026-11-08T17:41:17.561Z
• total: 571 minutes in the day
• href: /settings/capacity

Still there at 2026-11-09T18:39:04.914Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 2 busy; the oldest since 18:17; the longest running is a check at 12 min (limit 60).
• first open: 2026-11-08T18:45:30.551Z
• total: 567 minutes in the day
• href: /settings/capacity

Still there at 2026-11-09T19:39:21.338Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 5 busy; the oldest since 19:19; the longest running is a check at 10 min (limit 60).
• first open: 2026-11-08T19:40:44.721Z
• total: 570 minutes in the day
• href: /settings/capacity

Still there at 2026-11-09T20:40:21.183Z, evidence now:

• cause: queue:check
• sentence: 2 checks wait for 10 slots, all busy; the oldest since 20:25; the longest running is a check at 14 min (limit 60).
• since: 2026-11-09T20:36:03.964Z
• href: /settings/capacity

Still there at 2026-11-09T21:41:11.195Z, evidence now:

• cause: queue:check
• sentence: 12 checks wait for 10 slots, all busy; the oldest since 21:27; the longest running is a check at 14 min (limit 60).
• since: 2026-11-09T21:33:43.886Z
• href: /settings/capacity

Still there at 2026-11-09T22:41:22.589Z, evidence now:

• cause: queue:check
• sentence: 11 checks wait for 10 slots, all busy; the oldest since 22:24; the longest running is a check at 16 min (limit 60).
• since: 2026-11-09T22:30:57.212Z
• href: /settings/capacity

Still there at 2026-11-09T23:42:10.440Z, evidence now:

• cause: queue:check
• sentence: 17 checks wait for 10 slots, all busy; the oldest since 23:27; the longest running is a check at 10 min (limit 60).
• since: 2026-11-09T23:37:52.384Z
• href: /settings/capacity

Still there at 2026-11-10T00:42:43.375Z, evidence now:

• cause: queue:check
• sentence: 21 checks wait for 10 slots, all busy; the oldest since 00:29; the longest running is a check at 10 min (limit 60).
• since: 2026-11-10T00:38:07.304Z
• href: /settings/capacity

Still there at 2026-11-10T01:24:40.159Z, evidence now:

• cause: queue:check
• sentence: 14 checks wait for 10 slots, all busy; the oldest since 00:55; the longest running is a check at 28 min (limit 60).
• first open: 2026-11-09T01:24:40.159Z
• total: 723 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T02:10:14.211Z, evidence now:

• cause: queue:check
• sentence: 15 checks wait for 10 slots, all busy; the oldest since 01:57; the longest running is a check at 12 min (limit 60).
• since: 2026-11-10T02:01:43.046Z
• href: /settings/capacity

Still there at 2026-11-10T02:21:43.534Z, evidence now:

• cause: queue:check
• sentence: 17 checks wait for 10 slots, all busy; the oldest since 01:57; the longest running is a check at 24 min (limit 60).
• since: 2026-11-10T02:01:43.046Z
• href: /settings/capacity

Still there at 2026-11-10T02:40:37.206Z, evidence now:

• cause: queue:check
• sentence: 15 checks wait for 10 slots, all busy; the oldest since 02:24; the longest running is a check at 10 min (limit 60).
• since: 2026-11-10T02:01:43.046Z
• href: /settings/capacity

Still there at 2026-11-10T02:52:08.000Z, evidence now:

• cause: queue:check
• sentence: 9 checks wait for 10 slots, all busy; the oldest since 02:30; the longest running is a check at 22 min (limit 60).
• since: 2026-11-10T02:01:43.046Z
• href: /settings/capacity

Still there at 2026-11-10T03:52:34.980Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 5 busy; the oldest since 03:31; the longest running is a check at 20 min (limit 60).
• since: 2026-11-10T03:41:34.854Z
• href: /settings/capacity

Still there at 2026-11-10T04:06:15.298Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 7 busy; the oldest since 03:31; the longest running is #10551 at 9 min (limit 60).
• since: 2026-11-10T03:41:34.854Z
• href: /settings/capacity

Still there at 2026-11-10T05:06:25.482Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 3 busy; the oldest since 04:14; the longest running is a check at 24 min (limit 60).
• first open: 2026-11-09T05:15:42.399Z
• total: 757 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T06:07:13.728Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 3 busy; the oldest since 05:33; the longest running is a check at 24 min (limit 60).
• first open: 2026-11-09T06:07:13.728Z
• total: 747 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T07:08:05.958Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, all busy; the oldest since 06:16; the longest running is a check at 26 min (limit 60).
• first open: 2026-11-09T07:10:50.901Z
• total: 740 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T08:08:13.288Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, all busy; the oldest since 07:45; the longest running is a check at 27 min (limit 60).
• since: 2026-11-10T07:56:04.704Z
• href: /settings/capacity

Still there at 2026-11-10T09:08:28.496Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, all busy; the oldest since 07:45; the longest running is a check at 27 min (limit 60).
• first open: 2026-11-09T09:08:28.496Z
• total: 701 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T10:09:46.409Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, all busy; the oldest since 07:45; the longest running is a check at 27 min (limit 60).
• first open: 2026-11-09T10:17:32.021Z
• total: 672 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T11:10:11.475Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 7 busy; the oldest since 10:39; the longest running is a check at 28 min (limit 60).
• first open: 2026-11-09T11:10:11.475Z
• total: 671 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T12:11:18.622Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 3 busy; the oldest since 11:12; the longest running is a check at 26 min (limit 60).
• first open: 2026-11-09T12:11:48.560Z
• total: 666 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T12:51:43.031Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, all busy; the oldest since 12:11; the longest running is a check at 32 min (limit 60).
• first open: 2026-11-09T12:51:43.031Z
• total: 662 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T13:52:22.018Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, all busy; the oldest since 13:10; the longest running is a check at 30 min (limit 60).
• first open: 2026-11-09T15:25:11.551Z
• total: 675 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T14:52:28.438Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 3 busy; the oldest since 14:36; the longest running is a check at 15 min (limit 60).
• since: 2026-11-10T14:46:50.385Z
• href: /settings/capacity

Still there at 2026-11-10T15:25:26.887Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, all busy; the oldest since 15:12; the longest running is a check at 12 min (limit 60).
• since: 2026-11-10T15:23:01.680Z
• href: /settings/capacity

Still there at 2026-11-10T16:25:40.497Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 8 busy; the oldest since 16:12; the longest running is a check at 12 min (limit 60).
• since: 2026-11-10T16:22:15.045Z
• href: /settings/capacity

Still there at 2026-11-10T17:25:54.798Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 9 busy; the oldest since 16:44; the longest running is a check at 30 min (limit 60).
• first open: 2026-11-09T17:25:54.798Z
• total: 753 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T18:26:38.070Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 8 busy; the oldest since 17:52; the longest running is a check at 28 min (limit 60).
• first open: 2026-11-09T18:27:23.313Z
• total: 764 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T18:31:55.192Z, evidence now:

• cause: queue:check
• sentence: 4 checks wait for 10 slots, all busy; the oldest since 18:21; the longest running is a check at 10 min (limit 60).
• since: 2026-11-10T18:31:27.986Z
• href: /settings/capacity

Still there at 2026-11-10T19:32:35.457Z, evidence now:

• cause: queue:check
• sentence: 7 checks wait for 10 slots, all busy; the oldest since 19:19; the longest running is a check at 12 min (limit 60).
• since: 2026-11-10T19:29:56.638Z
• href: /settings/capacity

Still there at 2026-11-10T20:32:43.583Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 6 busy; the oldest since 20:18; the longest running is a check at 12 min (limit 60).
• since: 2026-11-10T20:29:00.778Z
• href: /settings/capacity

Still there at 2026-11-10T21:32:57.804Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 5 busy; the oldest since 21:22; the longest running is a check at 10 min (limit 60).
• since: 2026-11-10T21:32:36.929Z
• href: /settings/capacity

Still there at 2026-11-10T22:33:09.342Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 4 busy; the oldest since 21:58; the longest running is a check at 27 min (limit 60).
• first open: 2026-11-09T22:33:09.342Z
• total: 779 minutes in the day
• href: /settings/capacity

Still there at 2026-11-10T23:33:22.149Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 6 busy; the oldest since 23:21; the longest running is a check at 12 min (limit 60).
• since: 2026-11-10T23:31:51.838Z
• href: /settings/capacity

Still there at 2026-11-11T00:33:55.612Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 6 busy; the oldest since 00:18; the longest running is a check at 14 min (limit 60).
• since: 2026-11-11T00:28:24.151Z
• href: /settings/capacity

Still there at 2026-11-11T01:34:53.937Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 8 busy; the oldest since 01:17; the longest running is a check at 16 min (limit 60).
• since: 2026-11-11T01:27:21.616Z
• href: /settings/capacity

Still there at 2026-11-11T02:35:12.333Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 6 busy; the oldest since 02:16; the longest running is a check at 18 min (limit 60).
• since: 2026-11-11T02:26:30.812Z
• href: /settings/capacity

Still there at 2026-11-11T03:35:50.678Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 3 busy; the oldest since 03:15; the longest running is a check at 20 min (limit 60).
• since: 2026-11-11T03:25:10.956Z
• href: /settings/capacity

Still there at 2026-11-11T04:35:58.708Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 8 busy; the oldest since 04:14; the longest running is a check at 20 min (limit 60).
• since: 2026-11-11T04:24:13.815Z
• href: /settings/capacity

Still there at 2026-11-11T05:36:19.497Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 9 busy; the oldest since 05:13; the longest running is a check at 22 min (limit 60).
• since: 2026-11-11T05:23:43.113Z
• href: /settings/capacity

Still there at 2026-11-11T06:36:03.008Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, all busy; the oldest since 06:05; the longest running is a check at 32 min (limit 60).
• since: 2026-11-11T06:15:22.890Z
• href: /settings/capacity

Still there at 2026-11-11T07:36:50.058Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 8 busy; the oldest since 06:51; the longest running is a check at 38 min (limit 60).
• first open: 2026-11-10T07:36:50.058Z
• total: 819 minutes in the day
• href: /settings/capacity

Still there at 2026-11-11T08:37:46.484Z, evidence now:

• cause: queue:check
• sentence: 1 check waits for 10 slots, 8 busy; the oldest since 06:51; the longest running is a check at 38 min (limit 60).
• first open: 2026-11-10T10:25:46.303Z
• total: 800 minutes in the day
• href: /settings/capacity

Still there at 2026-11-11T10:38:12.840Z, evidence now:

• cause: queue:check
• sentence: 7 checks wait for 10 slots, all busy; the oldest since 10:15; the longest running is a check at 22 min (limit 60).
• since: 2026-11-11T10:25:14.065Z
• href: /settings/capacity

Still there at 2026-11-11T11:38:49.383Z, evidence now:

• cause: queue:check
• sentence: 5 checks wait for 10 slots, all busy; the oldest since 10:15; the longest running is a check at 42 min (limit 60).
• first open: 2026-11-10T11:38:49.383Z
• total: 786 minutes in the day
• href: /settings/capacity

Still there at 2026-11-11T12:39:44.843Z, evidence now:

• cause: queue:check
• sentence: 5 checks wait for 10 slots, all busy; the oldest since 10:15; the longest running is a check at 42 min (limit 60).
• first open: 2026-11-10T12:39:44.843Z
• total: 766 minutes in the day
• href: /settings/capacity

Still there at 2026-11-11T13:40:14.457Z, evidence now:

• cause: queue:check
• sentence: 5 checks wait for 10 slots, all busy; the oldest since 10:15; the longest running is a check at 42 min (limit 60).
• first open: 2026-11-10T13:40:14.457Z
• total: 725 minutes in the day
• href: /settings/capacity

Still there at 2026-11-11T14:40:43.721Z, evidence now:

• cause: queue:check
• sentence: 5 checks wait for 10 slots, all busy; the oldest since 10:15; the longest running is a check at 42 min (limit 60).
• first open: 2026-11-10T14:46:50.385Z
• total: 690 minutes in the day
• href: /settings/capacity