Some checks failed
check agents / check (push) Failing after 14s
- Report (cp1-assessment-report-agent 0.2.0, step s7): a model writes the Assessment report from facts worked out in code (register, gaps, scorecard, rule traces, checks, and what each application is from the Discovery package); code sets the verdict and renders the pages. The disposition_signoff review point moves from the critic to the report. - Package (cp1-assessment-package-agent 0.1.1, step s8): after sign-off, every step's output in one package, with a register, a gaps register, the sign-off record, lineage and a sha256 per part, in code. Page step s9. - scripts/kab_register_agents.py: registers deployed agents in KAB's agent catalog (an in-place workflow update doesn't). - Runs exec_1b1257380df7 (014) and exec_374d5d577077 (015) completed on crucible-kab-dev: critic pass, report figures all in its facts, package complete with every digest recomputing. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
31 lines
1.4 KiB
YAML
31 lines
1.4 KiB
YAML
# Eval cases for CP1 - Assessment Package Agent.
|
|
schema_version: '1.0'
|
|
agent: cp1-assessment-package-agent
|
|
defaults:
|
|
timeout: 300
|
|
cases:
|
|
- id: a-passing-run-is-a-complete-signed-off-package
|
|
description: 'Every part present, critic pass, Discovery verified, one application in the queue: complete, and that application signed off.'
|
|
input:
|
|
json:
|
|
engagement_id: ENG-EVAL-001
|
|
run_id: RUN-EVAL-01
|
|
discovery_execution_id: exec_eval00000001
|
|
intake_verified: true
|
|
discovery_run_id: RUN-D-01
|
|
plan_status: planned
|
|
applications: [{"application_id": "APP-001", "name": "Eval app", "assets": ["discovery:exec_eval00000001/ALZ-DSC-03/CI-001"]}]
|
|
profiles: [{"application_id": "APP-001", "telemetry": "none", "signals": []}]
|
|
scores: [{"application_id": "APP-001", "score": 0.1, "partial": false, "missing_factors": [], "high_risk": false}]
|
|
posture_status: not_applicable
|
|
security_findings: []
|
|
dispositions: [{"application_id": "APP-001", "disposition": "rehost", "confidence": 0.7, "signoff_required": true, "evidence_ref": "discovery:exec_eval00000001/ALZ-DSC-03/CI-001", "rule_trace": [{"category": "rehost", "matched": true, "basis": "x"}], "tco_model": {"currency": "USD", "target_annual": 100}}]
|
|
verdict: pass
|
|
signoff_queue: [APP-001]
|
|
checks:
|
|
- schema: true
|
|
- field: manifest.complete
|
|
equals: true
|
|
- field: manifest.signoff.signed_off
|
|
equals: [APP-001]
|