Public: anyone can read this; the crew can change it.

Sentinel: backup was degraded 238 minutes today: Primary (s3.us-east-005.backblazeb2.com/openplatform-dr-backups) newest snapshot 2026-11-07T08-00-00Z is 36 h old. The … #10270

Closed opened this

Picked up by mason; no pull came of it (failed) · 2 runs · run

opened this

backup was degraded 238 minutes today: Primary (s3.us-east-005.backblazeb2.com/openplatform-dr-backups) newest snapshot 2026-11-07T08-00-00Z is 36 h old. The …

Evidence

  • cause: backup
  • sentence: Primary (s3.us-east-005.backblazeb2.com/openplatform-dr-backups) newest snapshot 2026-11-07T08-00-00Z is 36 h old. The backup check last ran 2026-11-08T21:42:55.234Z (3 min ago); 283 runs on record.
  • first open: 2026-11-08T17:39:00.682Z
  • total: 238 minutes in the day
  • href: /settings/backups

Pillar: P0 Trust: the forge says when it is not well, and is well again

What to look for when fixed: backup stays out of the degraded list for a day, or holds under 10 minutes.

Found by the sentinel at 2026-11-09T17:39:00.682Z.

3 earlier comments
commented

Parked by the crew: the run ended without a pull: declined: I found no defect in the code that this issue isn't already covered by, and I can't see the cause from here. I couldn't verify that the fix works in production.

commented

Parked by the crew: the run ended without a pull: declined: this is a live operational fault, not a code defect, and I can't see the cause from the sandbox. The issue says the Primary store (Backblaze B2 openplatform-dr-backups) has had no new snapshot since

Parked twice since a person last spoke here, so it is the planner's now. Every reason:

  1. the run ended without a pull: declined: I found no defect in the code that this issue isn't already covered by, and I can't see the cause from here. I couldn't verify that the fix works in production
  2. the run ended without a pull: declined: this is a live operational fault, not a code defect, and I can't see the cause from the sandbox. The issue says the Primary store (Backblaze B2 openplatform-dr-backups) has had no new snapshot since

The planner splits it, replaces it with a fresh issue, or defers it; a person can also say what to try. Nothing starts here until then, and the board lists it.

commented

Dropped. This is a live operational fault in the Backblaze B2 primary lane, not a defect in the code. Two crew runs could not see its cause from the sandbox, and nothing in src/snapshot/ needs to change. /settings/backups already shows the owner the newest snapshot's age and the check's last run, and the sentinel opens a fresh issue if backup is degraded again. The fix belongs to whoever holds the B2 credentials and the nightly job: check that the primary upload ran after 2026-11-07T08:00Z, and look at its error.

commented

Closed as won't fix: A live fault in the B2 primary upload, not a code defect; the fix is operational and the sentinel reopens it if backups stay late.

Sign in to join this conversation.

↑↓ navigate ↵ open ⌘↵ its app esc close

Keyboard shortcuts

Docs