thanhnvandClaude Fable 5
da66a36f97
Close the three gaps the scoring report itself flagged for H6 plus V15, each as a real MVP + fail-able adversarial test (same pattern that lifted H5): - D1 alert-dispatch.sh: alerts POST to a real HTTP webhook (severity routing, dedup window, retry) + dead-letter queue with redelivery; fail-loud in strict. Wired into agent-metrics.sh so a failing step pages live end-to-end. - D2 provider-usage-fetch.sh + telemetry-reconcile.sh: pull usage from a provider usage HTTP API (all-or-nothing schema gate, fail-loud) + reconcile local vs provider ground truth — token under-reporting/hidden runs => TELEMETRY_DISCREPANCY. - D3 dashboard-serve.sh + dashboard-server.py: serve the dashboard over HTTP with a stale-aware /healthz probe (fresh=200 ok, telemetry silent-death=503 stale). - D4 circuit-breaker-check.sh: sliding-window failure-rate breaker (V15) — interleaved successes no longer evade the consecutive-failure breaker (CIRCUIT_OPEN_WINDOW). New suite phase-h6-agentops-tests.sh: 20/20, all live against local HTTP endpoints (webhook sink, mock provider API, dashboard server) — deterministic, no model needed. Also fix sign-policy-bundle.sh key-sync invariant: the local-fallback branch only exported policy-public.pem when generating a NEW key, so a Vault-DOWN run after a Vault-signed run verified a local-key signature against the Vault pubkey (RSA padding error, run-casan4 died mid-suite). Now always re-exports the pubkey before signing — same fix class as tool-audit-lib.sh / governance-check.sh. Full battery re-run sequentially: 175/175 PASS, 0 FAIL across 8 suites (KMS SKIP this run — Vault down; validated live 2026-07-04). Docs synced: scoring-run-report (H6 79→80, no harness below 80, 155→175), CASAN_HARDENING_STATUS (Phase 5 D1–D4), Plan-07, submission README, and run-hardening.sh (H6+ scenes HO1–HO4). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
258 lines
9.3 KiB
YAML
258 lines
9.3 KiB
YAML
# CASAN4 demo pipeline context
|
|
generated-at: 2026-07-04T16:03:44Z
|
|
feature-id: casan-demo
|
|
module-id: mod-casan
|
|
module-keyword: harness
|
|
mode: autonomous
|
|
language: Vietnamese
|
|
casan-harness:
|
|
level-target: 4
|
|
h4-security:
|
|
audit-log: .specify/logs/audit/security.jsonl
|
|
h5-governance:
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
alert-log: .specify/agentops/alerts.log
|
|
steps:
|
|
step-0:
|
|
status: COMPLETE
|
|
agent: detect-existing-spec
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-10af0fa9-12a3-4e61-82d4-a034fe8c3771.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-464bb377-4c1e-489a-b388-7e5c469d1784.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-236cb598-7a82-413d-8817-dde96e58cfa3.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-1-srs:
|
|
status: COMPLETE
|
|
agent: okr.srs
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-14c11a55-f4c8-4b52-9c35-55a0d2fb9003.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-f193b886-e340-4c29-a0f1-9c17d850198a.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-432d6880-9240-461b-9a81-77cdcc30da75.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-2-bd:
|
|
status: COMPLETE
|
|
agent: okr.bd
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-5afc5ff5-3130-467e-b04f-7a34489da81f.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-464bb377-4c1e-489a-b388-7e5c469d1784.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-4e14ae44-8f88-4e0f-89ab-3e52ad7d0987.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-3-spec:
|
|
status: COMPLETE
|
|
agent: speckit.specify
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-60909d76-5ae0-40c5-a433-f1f6a4d5ebc4.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-f193b886-e340-4c29-a0f1-9c17d850198a.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-5092d8b7-62b1-470d-b474-5f7340c9701c.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-4-clarify:
|
|
status: COMPLETE
|
|
agent: speckit.clarify
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-a3e4f81b-fcf6-43b4-879f-3a840eaaacb5.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-464bb377-4c1e-489a-b388-7e5c469d1784.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-69c773cb-4c43-4d8f-b933-65e692a59509.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-5-review-spec:
|
|
status: COMPLETE
|
|
agent: okr.reviewspec
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-f22da2ba-c99b-4335-8895-8e133b927a82.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-f193b886-e340-4c29-a0f1-9c17d850198a.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-70219708-1c20-45a5-964e-107a3bcbb4ea.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-6-plan:
|
|
status: COMPLETE
|
|
agent: speckit.plan
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-f495655e-4018-4c54-8e39-d8d4010ea6f8.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-464bb377-4c1e-489a-b388-7e5c469d1784.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-790ad863-fef7-418e-9716-ea0ab1c2e5c1.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-7-review-plan:
|
|
status: COMPLETE
|
|
agent: okr.reviewplan
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-10af0fa9-12a3-4e61-82d4-a034fe8c3771.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-f193b886-e340-4c29-a0f1-9c17d850198a.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-812b0adb-8253-4a79-ac4c-0b181f7ded41.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-8-dd:
|
|
status: COMPLETE
|
|
agent: okr.dd
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-14c11a55-f4c8-4b52-9c35-55a0d2fb9003.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-464bb377-4c1e-489a-b388-7e5c469d1784.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-92cab24c-4988-4996-bc2f-74ae9b1684cf.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-8b-testcases:
|
|
status: COMPLETE
|
|
agent: okr.testkit.gen-testcases
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-5afc5ff5-3130-467e-b04f-7a34489da81f.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-f193b886-e340-4c29-a0f1-9c17d850198a.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-da53987e-b91b-49de-a42a-6af44c685638.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-9-tasks:
|
|
status: COMPLETE
|
|
agent: speckit.tasks
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-60909d76-5ae0-40c5-a433-f1f6a4d5ebc4.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-464bb377-4c1e-489a-b388-7e5c469d1784.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-ddae00a1-7960-4a99-8741-de089b93e283.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-10-implement:
|
|
status: COMPLETE
|
|
agent: speckit.implement
|
|
governance-action: write_code
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-a3e4f81b-fcf6-43b4-879f-3a840eaaacb5.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-a6d0e737-0260-4ad7-8f2a-81da8fd5f44e.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-e75e1165-3a92-4b54-9473-eff24e8a8b60.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-11-review-code:
|
|
status: COMPLETE
|
|
agent: okr.reviewcode
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-f22da2ba-c99b-4335-8895-8e133b927a82.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-f193b886-e340-4c29-a0f1-9c17d850198a.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-f25ea973-62bb-41ad-8db2-f5c0f6df239c.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-12-testkit:
|
|
status: COMPLETE
|
|
agent: okr.testkit.run-tests
|
|
governance-action: agent_step
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-f495655e-4018-4c54-8e39-d8d4010ea6f8.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-464bb377-4c1e-489a-b388-7e5c469d1784.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-f4cea8da-c6e6-4aa9-887f-4fcfd5a8770f.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|
|
step-13-launch:
|
|
status: COMPLETE
|
|
agent: boss.launch
|
|
governance-action: deploy
|
|
casan:
|
|
h4-security:
|
|
status: PASS
|
|
trace: .specify/logs/trace/security-10af0fa9-12a3-4e61-82d4-a034fe8c3771.json
|
|
h5-governance:
|
|
decision: approved
|
|
trace: .specify/logs/trace/governance-a6d0e737-0260-4ad7-8f2a-81da8fd5f44e.json
|
|
audit-log: .specify/logs/audit/audit.jsonl
|
|
h6-agentops:
|
|
status: success
|
|
trace: .specify/logs/trace/agentops-fa952bbb-64a1-408a-bdb2-aa1f74c90866.json
|
|
metrics-log: .specify/logs/cost/metrics.jsonl
|