Files
tom_analysis_agent/eval/results/20261021T203624Z/lessons/candidates/bench-landing-zone-shared/case-01-landing-zone-shared-r2.json
Jonathan Boniface 628b6ee170 docs: publish the runs of 2026-10-21
The evaluation (both cases three times: report, results, spread, each
run's Deliverables and lesson candidates) and the hand-off through the
Orchestration engine (report, the document of links, both agents' kept
files and records). Benchmark cases only, all fictional; no machine paths,
and the links carry no signatures. Other runs stay ignored.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 09:25:03 +01:00

64 lines
2.4 KiB
JSON

{
"execution_id": "case-01-landing-zone-shared-r2",
"customer_case": "bench-landing-zone-shared",
"status": "completed",
"role_skills": {
"capability-modeller": [
"operating-capabilities",
"operating-chain"
],
"operating-model-architect": [
"operating-capabilities",
"operating-chain",
"rate-card"
],
"operations-analyst": [
"operating-scoping",
"operating-chain"
],
"orchestrator": [],
"packager": [
"operating-guide"
],
"reply-writer": [],
"scope-analyst": [
"operating-scoping"
],
"validator": [
"operating-chain"
]
},
"skill_versions": {
"operating-capabilities": "49a7e66857a1",
"operating-chain": "ec53ad8875e6",
"operating-guide": "85b48d5998da",
"operating-scoping": "08da33f8cddf",
"rate-card": "f86d17a9bcce"
},
"candidates": [
{
"type": "revision",
"deliverable": "target_operating_model",
"reason": "OC-1 failed: Finding AF-1 does not stand. The operating model should provide alert configurations itself using the existing native Google Cloud monitoring tools, rather than raising a finding against the solution.; OC-3 failed: Finding AF-1 does not stand. The operating model should provide alert configurations itself using the existing native Google Cloud monitoring tools, rather than raising a finding against the solution.; SC-budget failed: A month's cost of operating is compared with the budget of 60,000 GBP. The cost is 64,125 GBP, over the budget.",
"requested_by": "orchestrator"
},
{
"type": "failed_check",
"attempt": 1,
"check": "OC-1",
"evidence": "Finding AF-1 does not stand. The operating model should provide alert configurations itself using the existing native Google Cloud monitoring tools, rather than raising a finding against the solution."
},
{
"type": "failed_check",
"attempt": 1,
"check": "OC-3",
"evidence": "Finding AF-1 does not stand. The operating model should provide alert configurations itself using the existing native Google Cloud monitoring tools, rather than raising a finding against the solution."
},
{
"type": "failed_check",
"attempt": 1,
"check": "SC-budget",
"evidence": "A month's cost of operating is compared with the budget of 60,000 GBP. The cost is 64,125 GBP, over the budget."
}
]
}