Files
gcp_solution_architecture_a…/.env.example
Jonathan Boniface 654370bb46 feat: all four evaluation cases pass; intake, checklist review, thresholds
Case 04 (interactive)
- A scripted answer may name who it is for, so facts written for
  requirements discovery are not given to a Specialist confirming a draft.
- A reply that restates what the agreed requirements already say is read
  as an answer, not a request for changes.
- With a user present, a first submission is refused until the user has
  been shown a draft of that Deliverable (CONFIRM_DRAFTS).

Routing and reviews
- Intake: a message that starts something is read first. A question is
  answered and starts nothing; a change to delivered work starts as a new
  request with a note, until Change requests are built.
- Requirements and recommendations list what infrastructure code can show
  (conditions) apart from what it cannot (outside_code); the latter needs
  no Check and validation proposes nothing for it.
- A requirements review, "names no products", behind its own switch (off).
- Each pillar advisor reviews its pillar's checklist; the engine writes the
  reviews into the design recommendations. The judged checklist check went
  from 9-45% a pillar to 100% in one run of case 04.

Evaluation
- Per-case thresholds for Revisions, seconds and tokens, set from every
  completed run on this build.
- A progress file after every agent run, so an interrupted run keeps its
  time and tokens.
- eval/calibrate_judge.py with a 32-question set awaiting a person's
  labels. Unlabelled: Jev stable at 1.00, Gemini 0.92, agreeing on 0.91.

Smaller
- An Execution that ends with warnings writes its Deliverables, with the
  warnings and each status in the manifest.
- CI installs the application's dependencies before linting and testing.
- A load-balancer pattern in the IaC patterns Skill.

Plans record nine runs of 2026-10-08. Iteration 6 is complete.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 09:32:57 +01:00

81 lines
3.0 KiB
Plaintext

# GCP Solution Architecture Agent Environment Variables
# Agent Identity
AGENT_NAME=gcp_solution_architecture_agent
AGENT_VERSION=1.0.0
LOG_LEVEL=INFO
# A2A server (python -m app.main). The container image sets A2A_PORT=8080.
A2A_HOST=0.0.0.0
A2A_PORT=8000
# A2A_PUBLIC_URL=https://agents.example.com/solution-architect
# Models (providers/<name>.yaml): gemini/<model> uses ADK's native Gemini client.
# These are read by Google's client, not by this app's settings. The app exports them
# from this file at start-up; a value already set in the environment wins.
# Vertex AI with Application Default Credentials:
# GOOGLE_GENAI_USE_ENTERPRISE=true
# GOOGLE_CLOUD_PROJECT=your-project-id
# GOOGLE_CLOUD_LOCATION=global
# GOOGLE_APPLICATION_CREDENTIALS=/app/credentials/adc.json
# Or the Gemini API: GOOGLE_API_KEY=...
MODEL_TIMEOUT_SECONDS=180
# Cloud Provider Bundle (providers/<name>.yaml) & Remote MCP Servers
CLOUD_PROVIDER=gcp
MCP_ENABLED=true
MCP_ENABLE_PREVIEW=true
# MCP_QUOTA_PROJECT=your-project-id # defaults to the Application Default Credentials project
MCP_TIMEOUT_SECONDS=30
# Local Terraform tools (fmt, validate, plan; never apply)
TERRAFORM_BINARY=terraform
TERRAFORM_TIMEOUT_SECONDS=300
# Terraform providers are cached here so each check does not download them again.
# Relative to the repository root; set it empty to disable.
TF_PLUGIN_CACHE_DIR=.cache/terraform-plugins
# Hierarchical Execution Engine
ORCHESTRATOR=router # router | model
ORCHESTRATOR_BUDGET=40
SPECIALIST_BUDGET=15
# With a user present, a Deliverable is shown to them before it is first submitted.
CONFIRM_DRAFTS=true
MAX_REVISIONS=3
MAX_ORCHESTRATOR_TURNS=100
MAX_PARALLEL_SPECIALISTS=4
CHECKPOINTER=sqlite
CHECKPOINT_DB_PATH=checkpoints.db
# Jev decision service, through the TypeSafe AI Python SDK (typesafe-sdk).
# Leave the key unset to run without it: every decision then takes its fallback.
# TYPESAFE_API_KEY=
# TYPESAFE_BASE_URL= # defaults to the SDK's endpoint
# TYPESAFE_DEFAULT_MODEL= # defaults to the SDK's model
JEV_TIMEOUT_SECONDS=5
JEV_REQUESTS_PER_SECOND=5
JEV_MAX_IN_FLIGHT=8
JEV_BUDGET_CALLS=500
JEV_BUDGET_TOKENS=1000000
JEV_ACT_THRESHOLD=0.75
JEV_CLOSE_THRESHOLD=0.15
JEV_CONFIDENCE_THRESHOLD=0.6
# Review a design's coverage with Jev before it is submitted: for each condition a
# requirement lists, which Check verifies it. Off until a full case has run with it.
JEV_COVERAGE_REVIEW=false
# How likely "no Check verifies this" must be before the condition is raised.
JEV_COVERAGE_THRESHOLD=0.6
# Review the requirements with Jev before they are submitted: does any name a cloud
# product? Off until a full case has run with it.
JEV_REQUIREMENTS_REVIEW=false
JEV_REQUIREMENTS_THRESHOLD=0.3
# PostgreSQL (Execution records, and checkpoints when CHECKPOINTER=postgres)
POSTGRES_HOST=localhost
POSTGRES_PORT=5432
POSTGRES_DB=gcp_agent_db
POSTGRES_USER=postgres
POSTGRES_PASSWORD=postgres
# DATABASE_URL=postgresql://postgres:postgres@localhost:5432/gcp_agent_db
SQLITE_FALLBACK_DB=gcp_agent_local.db