Files
orchestration_engine/.agents/plans/iter-01-execution-engine/steps/step-4.md

4.4 KiB

Step 4: a toy Workflow, and an agent root to test the rest of the engine on

Built 2026-10-13.

What was built

The toy Workflow (tests/toy/workflow.py): planning a picnic. Four Deliverables in three Phases: a menu, a shopping list written from it, a check that every dish can be made from the list, and the plan that puts them together. It has no spec, no graph and no cloud. It uses each kind of part a Workflow can supply at least once: data checks along a chain, code that adds a view on submission, a validation that reopens the list or the menu, an account of what a Change request changed, an option a caller may set, a local tool of its own, its own facts at an Approval, its own entries in a Specialist's task and in the manifest, and its card.

Its agent root (tests/toy/root/): a provider bundle, six role files with a shared partial, one Skill and one overlay Skill. All are stand-ins.

Its tests (tests/toy/, 62 tests):

File What it covers
test_workflow.py A Workflow is checked when built; names written as an enum are held as strings
test_execution.py Whole Executions: pre-approved to the end; each Phase waiting for its Approval; a Specialist's question and its answer; a failed Check reopening the list; a Check failing twice reopening the menu; a user's request for changes; a Change request and its account; options
test_roles.py The role loader on a Workflow and bundle that are not the Reference's
test_assembly.py open_assembly from settings, the agent's folder and a Workflow
test_server.py The card, /health, /generate, A2A tasks, and messages that start nothing

tests/test_independence.py keeps three things true: the engine imports nothing from its tests, it names none of the Reference's Deliverables, and the toy imports nothing from the Reference's example.

What the toy found in the engine

Each was a place the engine still assumed the Reference, and each is fixed.

  • A provider bundle had to name an output template. providers.py now takes it as optional.
  • Overlay Skills were looked for under the engine's own folder. Settings.overlay_dirs, discover_overlays and skill_dirs now take the agent's root.
  • A whole number in an A2A message arrived as a float. A message's metadata holds every number as a double, so guests: 9 reached the option's check as 9.0 and was refused. a2a_server._options now returns whole numbers as ints.
  • Message intake spoke of architectures. nodes/intake.py no longer holds what the agent says it does (the Workflow's about is used), its notes and its questions to the decider say "work", and DeliveredAnswers is told the Workflow's final Deliverable in place of reading solution_guide.
  • Settings defaulted to the Reference's names for the agent and its databases. They are now agent, agent_db and agent_local.db.

Differed from the plan

  • Four Deliverables in three Phases, where the spec said three in two: with the check as the final Deliverable the toy could not show that a section written for readers is kept from the next Specialist and given to the final one.
  • The three tests removed in step 2 (open_decider twice, gate_cloud_read) are back, now that the modules they need are here.

Still not tested here

  • The six of the Reference's test files set aside in step 3 are still not brought. What they covered in the engine is now covered on the toy, except: starting from a spec through ExecutionEngine.start (the toy has no spec), the lighter model for a first attempt, and the lessons Skill being given to a role. tests/test_lessons_loop and tests/agents/test_adk_engine are also not brought.
  • main.serve and create_app with a real open_assembly (it builds the ADK runtime).
  • Nothing has run with real models.

Left in the engine from the Reference's subject

Unchanged from step 3, less what this step fixed: providers.py still parses terraform and pillar_skills; config.py still holds the Terraform and review settings and BASE_DIR; RoleSpec.modules_skill; the router's action names and a few messages; recorder.SESSION_AGENT_NAME is solution-architect; the scheduler is still whole in the example.

Verified

pytest -q: 521 passed. ruff check ., ruff format --check . and mypy . (112 files): clean. git status in the Reference shows the same nine modified files as before this work began.