Add CP1 Discovery agents in both patterns
All checks were successful
check agents / check (push) Successful in 10s
All checks were successful
check agents / check (push) Successful in 10s
ALZ-F01 Discovery as a sub-agent orchestrator (sub-agents/) and as eight individual declarative agents (individual-agents/), with their KAB workflow exports. Shared check, render and import scripts, the alz-discovery-sample MCP server, the crucible-kab-dev deploy profile, deployment docs, platform issue reports and the source material. Agent steps time out at 20 minutes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,49 @@
|
||||
# Eval cases for CP1 - Discovery Critic Agent: the Meridian Retail Group sample estate (needs the MCP server).
|
||||
schema_version: "1.0"
|
||||
agent: "cp1-discovery-critic-agent"
|
||||
defaults:
|
||||
timeout: 330
|
||||
cases:
|
||||
- id: "missing-findings-fail-coverage"
|
||||
description: "Only two of six scope entries have findings and only SE-004 is a declared gap, so coverage is incomplete and the verdict is fail."
|
||||
input:
|
||||
json:
|
||||
engagement_id: "ENG-MERIDIAN-001"
|
||||
run_id: "RUN-EVAL-01"
|
||||
coverage_gaps:
|
||||
- scope_entry_id: "SE-004"
|
||||
reason_code: "unsupported_asset_class"
|
||||
reason: "No read-only metadata interface."
|
||||
findings:
|
||||
- scope_entry_id: "SE-002"
|
||||
hostname: "app-01"
|
||||
os: "Windows Server 2012 R2"
|
||||
services:
|
||||
- "IIS 8.5"
|
||||
- "POS Backoffice (.NET Framework 4.8)"
|
||||
dependencies:
|
||||
- "SE-003"
|
||||
- "SE-004"
|
||||
migration_risks:
|
||||
- "Windows Server 2012 R2 is out of support"
|
||||
- "In PCI-DSS scope"
|
||||
prompt_injection_detected: false
|
||||
injection_note: ""
|
||||
evidence_ref: "evidence:ENG-MERIDIAN-001#2"
|
||||
- scope_entry_id: "SE-003"
|
||||
hostname: "pos-db-01"
|
||||
os: "Oracle Linux 7.9"
|
||||
services:
|
||||
- "Oracle Database 19c"
|
||||
dependencies: []
|
||||
migration_risks:
|
||||
- "In PCI-DSS scope"
|
||||
prompt_injection_detected: false
|
||||
injection_note: ""
|
||||
evidence_ref: "evidence:ENG-MERIDIAN-001#3"
|
||||
checks:
|
||||
- schema: true
|
||||
- field: "verdict"
|
||||
equals: "fail"
|
||||
- field: "coverage_gaps"
|
||||
contains: "SE-001"
|
||||
Reference in New Issue
Block a user