Files
Jonathan Boniface 041e199248
Some checks failed
check agents / check (push) Failing after 12s
ALZ-F02 Assessment: critic code checks (ADR 0011), represents edges (ADR 0012)
- Critic 0.2.0 / 0.2.1: K-04 (risk), K-05 (confidence), K-06 (TCO), K-07 (routing) and K-11
  (schema and 7R enum) run in code in the critic's hooks (app/arithmetic.py,
  app/business_logic.py); post_process sets those checks, the rejected dispositions, the
  sign-off queue and the verdict. The model keeps the judgement checks; a different reading of
  a code check is kept in unverified_claims. K-07 checks the disposition agent's own queue.
  Tests on the records of run exec_4d88027a4d26, whose model sums were wrong.
- A represents edge is not a dependency (ADR 0012): risk scorer 0.1.1 and disposition 0.1.2
  leave it out of dependents and dependencies; the disposition and critic prompts carry the
  risk scorer's rule. Run exec_1f518b04d6e4: APP-001's risk 1.00 -> 0.00, out of the tail.
- The scaffold declares the critic's hooks, copies app/ in its Dockerfile, and keeps its
  app/ and tests/ when regenerating.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-06 13:20:40 +00:00

3.7 KiB

[0.2.1] - 2026-11-05

Fixed

  • A represents edge is not a dependency (ADR 0012): it joins a CMDB record to the inventory asset it stands for (F01 ADR 0019). Run exec_2cd7a953335b counted eight of them as dependents of APP-001: fan-in 1.0, a risk score of 1.00 and the high-risk tail, and retire ruled out for eight dependents.
  • K-07 checks the disposition agent's own signoff_queue against its dispositions below 0.80. In run exec_2cd7a953335b it compared the critic's queue after rejections, and failed when the model rejected APP-001 under K-02.

[0.2.0] - 2026-11-05

Added

  • Code checks (ADR 0011, app/arithmetic.py, app/business_logic.py): pre_process works out K-04 (risk), K-05 (confidence), K-06 (TCO), K-07 (sign-off routing) and K-11 (schema and 7R enum) from the producers' records and shows the result to the model as checked_in_code; post_process sets those checks, the sign-off queue, the rejected dispositions and the verdict. The model's checks (K-01 to K-03, K-08 to K-10, K-12) are kept as it wrote them; a different reading of a code check is kept in unverified_claims.
  • Tests on the records of run exec_4d88027a4d26, where the critic model expected a score of 0.70 for 1.00 and summed 0.90 - 0.10 - 0.20 - 0.10 to 0.60. With the code checks, that run's verdict is pass.

[0.1.6] - 2026-11-05

Fixed

  • The prompt carries the producers' rules it recalculates with (ADR 0001): ALZ-ASM-03's factor, dependent, scoring and tail rules, and ALZ-ASM-04's 7R rule set, confidence and TCO rules, copied from their prompts by the scaffold. Run exec_1779863642d6 failed K-04 because the critic had no risk rules; the K-04 and K-05 passes of earlier runs had no rules behind them either.

[0.1.5] - 2026-11-05

Fixed

  • K-08 says that listing security findings as advisory in the scoring note, as ALZ-ASM-04 must (Objective 5), passes; only a confidence adjustment or rule-trace basis citing one fails. Run exec_5fd4a145a5d9 rejected a disposition for its scoring note alone.

[0.1.4] - 2026-11-05

Changed

  • K-12 is settled when the workflow is built (ADR 0010); the critic reports it from critic_model and executor_models alone. Run exec_0b0afb70b8b9 failed K-12 again on a Discovery note about Discovery's own critic model, with every other check passing.

[0.1.3] - 2026-11-05

Fixed

  • The verdict rule is stated plainly: an unverified K-10 never fails the run on its own (ADR 0006). Run exec_effdf1042137 passed every other check and still returned fail on K-10 unverified under the earlier wording.
  • K-10 names where ALZ-ASM-05's output arrives (posture_status, security_findings). The same run reported that no ALZ-ASM-05 output was supplied.

[0.1.2] - 2026-11-05

Fixed

  • K-12 compares only critic_model with executor_models. Run exec_4be193061c41 failed K-12 on a note in the Discovery package that Discovery's network agent runs on the critic's model: a Discovery agent is not an executor of this run.
  • New input in_cloud_estate, the planner's flag, so K-10 can check that ALZ-ASM-05 reports not_applicable with no findings when the estate is not in the cloud. Run exec_4be193061c41 reported K-10 unverified partly because the flag never reached it.

[0.1.1] - 2026-11-05

Changed

  • rate_card_document comes from the run input of that name, the rate card's JSON as text, not from an uploaded file (ADR 0009). The input's description says so.

[0.1.0] - 2026-11-02

Added

  • First release: Independently validates the Assessment: coverage, evidence, dependents, recalculated scores, confidence and TCO, the interim and advisory rules, and routes confidence below 0.80 to disposition sign-off.