ALZ-F01 Discovery: package step, value scorecard, application grouping, cases
- New cp1-discovery-package-agent (ADR 0020): one package per reviewed run, every part hashed (sha256 over canonical JSON), with a manifest and a value scorecard. - Applications grouped CMDB -> tag -> resource group with a judged model fallback (ADR 0021): CMDB 0.7.0 carries ownership, dependency mapping 0.6.0 groups, report 0.9.0 shows them. - Critic 0.6.1 accepts the producers' enums; build_workflow.py refuses a consumer enum narrower than its producer's. - Code hooks, sub-agents and tests for the inventory, CMDB, dependency, planner and critic agents; the report and Well-Architected review agents; ADRs 0012-0021. - Workflow cases with value bars and run limits; run evaluation and usage collection scripts; the run context template and the field-by-field review for ADR 0016. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,50 @@
|
||||
# Live Azure, resource group crucible-kab-dev, with no CMDB and no ITSM (include_cmdb "no"). The regression case for
|
||||
# a run without uploads: the same estate as azure-crucible-kab-dev-cmdb, as listed on 2026-11-04 (11 resources: 10
|
||||
# scope entries and the private endpoint's network interface, folded). If the group changes, update this case.
|
||||
id: azure-crucible-kab-dev
|
||||
description: Live Azure resource group with no CMDB or ITSM; every source gap declared, and a complete package for F02.
|
||||
inputs:
|
||||
context: context.yaml
|
||||
|
||||
checks:
|
||||
# Planner
|
||||
- {id: plan-scope-accounting, step: s1, severity: critical, field: scope_accounting, contains_all: ['"listed": 11', '"scope_entries": 10'], why: "The group holds 11 resources; the NIC folds into the private endpoint."}
|
||||
- {id: plan-cmdb-gap, step: s1, severity: critical, field: source_gaps, contains: '"cmdb"', why: "include_cmdb is no: the CMDB is a declared gap."}
|
||||
- {id: plan-itsm-gap, step: s1, severity: major, field: source_gaps, contains: '"itsm"', why: "No ITSM source was given."}
|
||||
|
||||
# Inventory
|
||||
- {id: inventory-ten-records, step: s3, severity: critical, field: records, contains_all: [crucible-kab-dev-aks, crucible-kab-dev-pg, crucible-kab-dev-creds, kab-dev.kyndemo.live], why: "Every scope entry is an inventory record."}
|
||||
|
||||
# CMDB step: nothing to reconcile
|
||||
- {id: cmdb-no-drift, step: s4, severity: critical, field: drift_items, equals: [], why: "With no CMDB there is nothing to drift from: drift would be invented."}
|
||||
|
||||
# Dependency graph (ADR 0019)
|
||||
- {id: graph-external-subnets, step: s7, severity: critical, field: nodes, contains_all: [crucible-kab-dev-aks-subnet, crucible-kab-dev-pe-subnet], why: "Dependencies outside the scope root are external nodes."}
|
||||
- {id: graph-no-ci-nodes, step: s7, severity: major, field: nodes, not_contains: '"kind": "ci"', why: "No CMDB, so no CI nodes."}
|
||||
- {id: graph-no-invented-vnet-edge, step: s7, severity: critical, field: edges, item: {match: 'virtualNetworks/crucible-platform-dev-vnet"', absent: true}, why: "The scan records subnets, never the VNet itself."}
|
||||
|
||||
# Critic
|
||||
- {id: critic-no-missing-dependency, step: s8, severity: critical, field: consistency_issues, not_contains: "missing from edges", why: "Every recorded dependency is an edge, an external node or folded."}
|
||||
- {id: critic-passes, step: s8, severity: major, field: verdict, equals: pass, why: "Nothing in this case should fail the run."}
|
||||
|
||||
# Applications (ADR 0021)
|
||||
- {id: apps-by-tag, step: s7, severity: critical, field: applications, item: {match: '"name": "AppName1"', contains_all: ['"basis": "tag"', '"review_required": false']}, why: "With no CMDB, the Application tag groups all 10 records, and a tag needs no review."}
|
||||
- {id: apps-no-owners, step: s7, severity: critical, field: asset_owners, equals: [], why: "No CMDB and no owner tag: no owner is invented."}
|
||||
|
||||
# Discovery package (ADR 0020)
|
||||
- {id: package-complete, step: s13, severity: critical, field: manifest.complete, equals: true, why: "A run without a CMDB is still complete: the CMDB is optional and declared."}
|
||||
- {id: package-cmdb-gap, step: s13, severity: critical, field: manifest.source_gaps, contains_all: [cmdb, itsm], why: "F02 must see that the CMDB and ITSM were not read, not that they were empty."}
|
||||
- {id: package-inventory, step: s13, severity: critical, field: inventory.records, min_items: 10, why: "Parts are copied unchanged."}
|
||||
|
||||
# Phase 0 baseline (ADR 0020). Without a CMDB, owners and applications are declared gaps rather than missing, so
|
||||
# filled_or_declared is higher here than in the CMDB case: read it with f02_filled, which is the value itself.
|
||||
# Raised for ADR 0021: application is now filled by the tag on every record.
|
||||
value:
|
||||
f02_filled_min: 0.34
|
||||
f02_filled_or_declared_min: 0.5
|
||||
f02_run_met_min: 7
|
||||
|
||||
limits:
|
||||
tokens: 160000
|
||||
model_calls: 20
|
||||
seconds: 600
|
||||
@@ -0,0 +1,41 @@
|
||||
# Live Azure trial, narrowed to one resource group: crucible-kab-dev in subscription sub-kyn-RITM0250380-653-dev
|
||||
# (Kyndryl development), which holds the AKS cluster crucible-kab-dev-aks. No credentials in this file.
|
||||
# Store the connection with --azure-scope-root subscriptions/1e06e3e6-7ab6-41c9-a29c-dd8f55646b7e/resourceGroups/crucible-kab-dev
|
||||
# (azure-discovery 0.1.5 or later): the server applies the filter to every query, network topology included.
|
||||
workflow_inputs:
|
||||
engagement_id: ENG-AZURE-KAB-DEV-001
|
||||
provider: azure
|
||||
include_cmdb: "no"
|
||||
include_itsm: "no"
|
||||
customer:
|
||||
name: Kyndryl (internal)
|
||||
account_id: sub-kyn-RITM0250380-653-dev
|
||||
industry: technology services
|
||||
country: US
|
||||
primary_region: eastus
|
||||
regulatory: []
|
||||
contacts: [Platform Engineering]
|
||||
|
||||
plan:
|
||||
name: CP1 live Azure trial, crucible-kab-dev
|
||||
phase: discovery
|
||||
objectives:
|
||||
- Prove live discovery end to end on one resource group, the KAB development cluster crucible-kab-dev-aks.
|
||||
target: Azure landing zone
|
||||
deliverables: [Discovery report, Well-Architected review]
|
||||
milestones: []
|
||||
approver: Engagement Lead
|
||||
|
||||
context:
|
||||
scope:
|
||||
regions: []
|
||||
exclude: []
|
||||
sources:
|
||||
cmdb: not available
|
||||
itsm: not available
|
||||
owners: {}
|
||||
business_services: []
|
||||
assets: {}
|
||||
notes: >-
|
||||
Scope is the resource group crucible-kab-dev only. The cluster's node resources (resource group
|
||||
crucible-kab-dev-nodes) are outside it.
|
||||
Reference in New Issue
Block a user