feat: a design-time coverage review, measured and left off

A reviewer role reads the requirements and recommendations against the Checks
when the Target architecture is first submitted. Three runs of case 03: it did
not stop the validator sending the design back, and the designs it reviewed
ended with 87 and 93 Checks against 52, so they cost more. It stays behind
DESIGN_COVERAGE_REVIEW, off (iteration 6 step 13).

Also: the schema review no longer reads `true` or `false` in backticks as a
setting name.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
2026-10-10 12:33:06 +01:00
parent 1cf1234143
commit ee1ba38867
13 changed files with 401 additions and 6 deletions

View File

@@ -22,6 +22,8 @@ models:
iac-author: gemini/gemini-3.1-pro-preview
validator: gemini/gemini-3.1-pro-preview
lesson-curator: gemini/gemini-3.1-pro-preview
# The same reading the validator makes of a design's coverage, made earlier.
coverage-reviewer: gemini/gemini-3.1-pro-preview
# A lighter model for a role's first attempt, used when MODEL_TIERS is on. Only a
# role whose work is checked by something else belongs here: the code is checked
# by terraform validate and by the validator. The validator is the check, and a
@@ -36,6 +38,7 @@ models:
iac-author: 300
validator: 300 # timed out five times at 180 s in a run of 2026-10-07
packager: 300
coverage-reviewer: 300
# Skills each role may load. Role files stay provider-neutral; the bundle names Skills.
role_skills: