Files
Jonathan Boniface 9e503885cc ALZ-F01 Discovery: package step, value scorecard, application grouping, cases
- New cp1-discovery-package-agent (ADR 0020): one package per reviewed run, every part
  hashed (sha256 over canonical JSON), with a manifest and a value scorecard.
- Applications grouped CMDB -> tag -> resource group with a judged model fallback (ADR 0021):
  CMDB 0.7.0 carries ownership, dependency mapping 0.6.0 groups, report 0.9.0 shows them.
- Critic 0.6.1 accepts the producers' enums; build_workflow.py refuses a consumer enum
  narrower than its producer's.
- Code hooks, sub-agents and tests for the inventory, CMDB, dependency, planner and critic
  agents; the report and Well-Architected review agents; ADRs 0012-0021.
- Workflow cases with value bars and run limits; run evaluation and usage collection scripts;
  the run context template and the field-by-field review for ADR 0016.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-05 22:13:25 +00:00

51 lines
3.8 KiB
YAML

# Live Azure, resource group crucible-kab-dev, with no CMDB and no ITSM (include_cmdb "no"). The regression case for
# a run without uploads: the same estate as azure-crucible-kab-dev-cmdb, as listed on 2026-11-04 (11 resources: 10
# scope entries and the private endpoint's network interface, folded). If the group changes, update this case.
id: azure-crucible-kab-dev
description: Live Azure resource group with no CMDB or ITSM; every source gap declared, and a complete package for F02.
inputs:
context: context.yaml
checks:
# Planner
- {id: plan-scope-accounting, step: s1, severity: critical, field: scope_accounting, contains_all: ['"listed": 11', '"scope_entries": 10'], why: "The group holds 11 resources; the NIC folds into the private endpoint."}
- {id: plan-cmdb-gap, step: s1, severity: critical, field: source_gaps, contains: '"cmdb"', why: "include_cmdb is no: the CMDB is a declared gap."}
- {id: plan-itsm-gap, step: s1, severity: major, field: source_gaps, contains: '"itsm"', why: "No ITSM source was given."}
# Inventory
- {id: inventory-ten-records, step: s3, severity: critical, field: records, contains_all: [crucible-kab-dev-aks, crucible-kab-dev-pg, crucible-kab-dev-creds, kab-dev.kyndemo.live], why: "Every scope entry is an inventory record."}
# CMDB step: nothing to reconcile
- {id: cmdb-no-drift, step: s4, severity: critical, field: drift_items, equals: [], why: "With no CMDB there is nothing to drift from: drift would be invented."}
# Dependency graph (ADR 0019)
- {id: graph-external-subnets, step: s7, severity: critical, field: nodes, contains_all: [crucible-kab-dev-aks-subnet, crucible-kab-dev-pe-subnet], why: "Dependencies outside the scope root are external nodes."}
- {id: graph-no-ci-nodes, step: s7, severity: major, field: nodes, not_contains: '"kind": "ci"', why: "No CMDB, so no CI nodes."}
- {id: graph-no-invented-vnet-edge, step: s7, severity: critical, field: edges, item: {match: 'virtualNetworks/crucible-platform-dev-vnet"', absent: true}, why: "The scan records subnets, never the VNet itself."}
# Critic
- {id: critic-no-missing-dependency, step: s8, severity: critical, field: consistency_issues, not_contains: "missing from edges", why: "Every recorded dependency is an edge, an external node or folded."}
- {id: critic-passes, step: s8, severity: major, field: verdict, equals: pass, why: "Nothing in this case should fail the run."}
# Applications (ADR 0021)
- {id: apps-by-tag, step: s7, severity: critical, field: applications, item: {match: '"name": "AppName1"', contains_all: ['"basis": "tag"', '"review_required": false']}, why: "With no CMDB, the Application tag groups all 10 records, and a tag needs no review."}
- {id: apps-no-owners, step: s7, severity: critical, field: asset_owners, equals: [], why: "No CMDB and no owner tag: no owner is invented."}
# Discovery package (ADR 0020)
- {id: package-complete, step: s13, severity: critical, field: manifest.complete, equals: true, why: "A run without a CMDB is still complete: the CMDB is optional and declared."}
- {id: package-cmdb-gap, step: s13, severity: critical, field: manifest.source_gaps, contains_all: [cmdb, itsm], why: "F02 must see that the CMDB and ITSM were not read, not that they were empty."}
- {id: package-inventory, step: s13, severity: critical, field: inventory.records, min_items: 10, why: "Parts are copied unchanged."}
# Phase 0 baseline (ADR 0020). Without a CMDB, owners and applications are declared gaps rather than missing, so
# filled_or_declared is higher here than in the CMDB case: read it with f02_filled, which is the value itself.
# Raised for ADR 0021: application is now filled by the tag on every record.
value:
f02_filled_min: 0.34
f02_filled_or_declared_min: 0.5
f02_run_met_min: 7
limits:
tokens: 160000
model_calls: 20
seconds: 600