The weekly model review

Once a week (runModelReview, ticked hourly from src/main.ts, runs at most once in seven days) the forge reads its ledger and, per crew member, compares the models it ran on over the last 28 days: cost per landed pull (every agent run on a pull counts), red first-check rate, change-request rounds per landed pull, reverts, and how hard the work was (share of pulls that escalated by need: p0, label:opus). The figures are on Settings → Crew ("Model review"), in GET /api/v1/crew/scorecard and the scorecard MCP tool (modelReview).

Not done: an MCP tool for the button (the decision is on the page and in the terminal), and the review does not look at an agent running on the runner's default model.

↑↓ navigate ↵ open ⌘↵ its app esc close

Keyboard shortcuts

Docs