- New cp1-discovery-package-agent (ADR 0020): one package per reviewed run, every part hashed (sha256 over canonical JSON), with a manifest and a value scorecard. - Applications grouped CMDB -> tag -> resource group with a judged model fallback (ADR 0021): CMDB 0.7.0 carries ownership, dependency mapping 0.6.0 groups, report 0.9.0 shows them. - Critic 0.6.1 accepts the producers' enums; build_workflow.py refuses a consumer enum narrower than its producer's. - Code hooks, sub-agents and tests for the inventory, CMDB, dependency, planner and critic agents; the report and Well-Architected review agents; ADRs 0012-0021. - Workflow cases with value bars and run limits; run evaluation and usage collection scripts; the run context template and the field-by-field review for ADR 0016. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
51 lines
3.8 KiB
YAML
51 lines
3.8 KiB
YAML
# Live Azure, resource group crucible-kab-dev, with no CMDB and no ITSM (include_cmdb "no"). The regression case for
|
|
# a run without uploads: the same estate as azure-crucible-kab-dev-cmdb, as listed on 2026-11-04 (11 resources: 10
|
|
# scope entries and the private endpoint's network interface, folded). If the group changes, update this case.
|
|
id: azure-crucible-kab-dev
|
|
description: Live Azure resource group with no CMDB or ITSM; every source gap declared, and a complete package for F02.
|
|
inputs:
|
|
context: context.yaml
|
|
|
|
checks:
|
|
# Planner
|
|
- {id: plan-scope-accounting, step: s1, severity: critical, field: scope_accounting, contains_all: ['"listed": 11', '"scope_entries": 10'], why: "The group holds 11 resources; the NIC folds into the private endpoint."}
|
|
- {id: plan-cmdb-gap, step: s1, severity: critical, field: source_gaps, contains: '"cmdb"', why: "include_cmdb is no: the CMDB is a declared gap."}
|
|
- {id: plan-itsm-gap, step: s1, severity: major, field: source_gaps, contains: '"itsm"', why: "No ITSM source was given."}
|
|
|
|
# Inventory
|
|
- {id: inventory-ten-records, step: s3, severity: critical, field: records, contains_all: [crucible-kab-dev-aks, crucible-kab-dev-pg, crucible-kab-dev-creds, kab-dev.kyndemo.live], why: "Every scope entry is an inventory record."}
|
|
|
|
# CMDB step: nothing to reconcile
|
|
- {id: cmdb-no-drift, step: s4, severity: critical, field: drift_items, equals: [], why: "With no CMDB there is nothing to drift from: drift would be invented."}
|
|
|
|
# Dependency graph (ADR 0019)
|
|
- {id: graph-external-subnets, step: s7, severity: critical, field: nodes, contains_all: [crucible-kab-dev-aks-subnet, crucible-kab-dev-pe-subnet], why: "Dependencies outside the scope root are external nodes."}
|
|
- {id: graph-no-ci-nodes, step: s7, severity: major, field: nodes, not_contains: '"kind": "ci"', why: "No CMDB, so no CI nodes."}
|
|
- {id: graph-no-invented-vnet-edge, step: s7, severity: critical, field: edges, item: {match: 'virtualNetworks/crucible-platform-dev-vnet"', absent: true}, why: "The scan records subnets, never the VNet itself."}
|
|
|
|
# Critic
|
|
- {id: critic-no-missing-dependency, step: s8, severity: critical, field: consistency_issues, not_contains: "missing from edges", why: "Every recorded dependency is an edge, an external node or folded."}
|
|
- {id: critic-passes, step: s8, severity: major, field: verdict, equals: pass, why: "Nothing in this case should fail the run."}
|
|
|
|
# Applications (ADR 0021)
|
|
- {id: apps-by-tag, step: s7, severity: critical, field: applications, item: {match: '"name": "AppName1"', contains_all: ['"basis": "tag"', '"review_required": false']}, why: "With no CMDB, the Application tag groups all 10 records, and a tag needs no review."}
|
|
- {id: apps-no-owners, step: s7, severity: critical, field: asset_owners, equals: [], why: "No CMDB and no owner tag: no owner is invented."}
|
|
|
|
# Discovery package (ADR 0020)
|
|
- {id: package-complete, step: s13, severity: critical, field: manifest.complete, equals: true, why: "A run without a CMDB is still complete: the CMDB is optional and declared."}
|
|
- {id: package-cmdb-gap, step: s13, severity: critical, field: manifest.source_gaps, contains_all: [cmdb, itsm], why: "F02 must see that the CMDB and ITSM were not read, not that they were empty."}
|
|
- {id: package-inventory, step: s13, severity: critical, field: inventory.records, min_items: 10, why: "Parts are copied unchanged."}
|
|
|
|
# Phase 0 baseline (ADR 0020). Without a CMDB, owners and applications are declared gaps rather than missing, so
|
|
# filled_or_declared is higher here than in the CMDB case: read it with f02_filled, which is the value itself.
|
|
# Raised for ADR 0021: application is now filled by the tag on every record.
|
|
value:
|
|
f02_filled_min: 0.34
|
|
f02_filled_or_declared_min: 0.5
|
|
f02_run_met_min: 7
|
|
|
|
limits:
|
|
tokens: 160000
|
|
model_calls: 20
|
|
seconds: 600
|