docs: record the first runs with and without Terraform modules

Case 03's request once each way, both at 100%. Opted in, a module was used
for private Cloud SQL only and 14 Checks were met through its inputs. The
difference in time and cost between the two runs is their Revisions, not
the modules.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
2026-10-09 22:47:09 +01:00
parent ef37f59bad
commit 10d23a5f91
3 changed files with 30 additions and 3 deletions

View File

@@ -60,3 +60,30 @@ Reference routing (iteration 5 step 8) does not choose within the modules Skill,
- A module version in the catalogue goes stale; nothing flags a newer one.
Tests: `tests/tools/test_modules.py` (24), `tests/test_iac_modules.py` (6), `tests/execution/test_terraform_modules.py` (7).
## Run on 2026-10-09
Case 03's request, once each way, side by side (`20261009T210931Z` plain, `20261009T210935Z` opted in as `case-07-approved-modules`). Both completed at 100%.
| | Plain resources | Modules opted in |
|---|---|---|
| Minutes | 35 | 22 |
| Tokens | 5.66 million | 3.08 million |
| Cost, about | $5.50 | $3.17 |
| Revisions of the Target architecture | 3 | 1 |
| Checks, all passed | 77 | 54 |
| Module calls / resources / lines of Terraform | 0 / 35 / 555 | 2 / 25 / 448 |
| Design quality score | 0.82 | 0.62 |
**The difference in time and cost is the Revisions, not the modules.** The two runs produced different designs before any code was written: 77 Checks against 54, three Revisions against one. One run each way cannot say modules are cheaper.
What the opted-in run does show:
- The IaC author used a module for one thing, private Cloud SQL (`sql-db//modules/postgresql` with `//modules/private_service_access`, 28.3.0), and wrote the network, load balancer, Cloud Run, storage, secrets, IAM and monitoring as plain resources. A VPC with one subnet did not get the network module.
- 14 of 54 Checks are met through module inputs, each recorded as `module.cloud_sql.<input>`; the validator passed all 14 citing the input's value.
- `terraform_module` was called four times by the author and once by the validator. No module was refused, and the code validated.
- For a Check met by leaving an input unset, the validator's evidence is that the module falls back to its default. That rests on the module's documentation.
The plain run was given neither the Skill nor the tool, and wrote no module.
The design quality score of 0.62 is below the bar of 0.67. It is scored on the design recommendations, written before any code.