thanhnvandClaude Fable 5
da66a36f97
Close the three gaps the scoring report itself flagged for H6 plus V15, each as a real MVP + fail-able adversarial test (same pattern that lifted H5): - D1 alert-dispatch.sh: alerts POST to a real HTTP webhook (severity routing, dedup window, retry) + dead-letter queue with redelivery; fail-loud in strict. Wired into agent-metrics.sh so a failing step pages live end-to-end. - D2 provider-usage-fetch.sh + telemetry-reconcile.sh: pull usage from a provider usage HTTP API (all-or-nothing schema gate, fail-loud) + reconcile local vs provider ground truth — token under-reporting/hidden runs => TELEMETRY_DISCREPANCY. - D3 dashboard-serve.sh + dashboard-server.py: serve the dashboard over HTTP with a stale-aware /healthz probe (fresh=200 ok, telemetry silent-death=503 stale). - D4 circuit-breaker-check.sh: sliding-window failure-rate breaker (V15) — interleaved successes no longer evade the consecutive-failure breaker (CIRCUIT_OPEN_WINDOW). New suite phase-h6-agentops-tests.sh: 20/20, all live against local HTTP endpoints (webhook sink, mock provider API, dashboard server) — deterministic, no model needed. Also fix sign-policy-bundle.sh key-sync invariant: the local-fallback branch only exported policy-public.pem when generating a NEW key, so a Vault-DOWN run after a Vault-signed run verified a local-key signature against the Vault pubkey (RSA padding error, run-casan4 died mid-suite). Now always re-exports the pubkey before signing — same fix class as tool-audit-lib.sh / governance-check.sh. Full battery re-run sequentially: 175/175 PASS, 0 FAIL across 8 suites (KMS SKIP this run — Vault down; validated live 2026-07-04). Docs synced: scoring-run-report (H6 79→80, no harness below 80, 155→175), CASAN_HARDENING_STATUS (Phase 5 D1–D4), Plan-07, submission README, and run-hardening.sh (H6+ scenes HO1–HO4). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
47 lines
1.4 KiB
JSON
47 lines
1.4 KiB
JSON
{
|
|
"bundle_id": "casan-okr-harness-policy",
|
|
"files": [
|
|
{
|
|
"bytes": 2856,
|
|
"path": ".specify/security/prompt-filter.yaml",
|
|
"sha256": "4bd0b747aed9751d0a39b0021656884672624c746fca972ccc38ce1856403cde"
|
|
},
|
|
{
|
|
"bytes": 1255,
|
|
"path": ".specify/security/output-policy.yaml",
|
|
"sha256": "742f73c04a3a2bdab88c140fc18299ece8ef63b093da221350452c555132cf05"
|
|
},
|
|
{
|
|
"bytes": 1935,
|
|
"path": ".specify/governance/approval-flow.yaml",
|
|
"sha256": "5ee774fd595fae08429fa7832fccf1c3fa7b607446e5f8b602b36dfabedbe5b9"
|
|
},
|
|
{
|
|
"bytes": 2003,
|
|
"path": ".specify/governance/risk-registry.yaml",
|
|
"sha256": "a37a7eb3db26389f3bf024637ed88a95bf159beec0f60b25fa17c969bb762440"
|
|
},
|
|
{
|
|
"bytes": 1053,
|
|
"path": ".specify/agentops/metrics.yaml",
|
|
"sha256": "3b8b7d1b71dd654bf600c5366b012daf7dea6415e71b50688872526bfac5af33"
|
|
},
|
|
{
|
|
"bytes": 2308,
|
|
"path": ".specify/level5/tool-registry.yaml",
|
|
"sha256": "c7f0081617b754b84a70ee6386277f3e8cd827ba8685d0245bc2b4f979951837"
|
|
},
|
|
{
|
|
"bytes": 722,
|
|
"path": ".specify/level5/model-fallback.yaml",
|
|
"sha256": "731f98e9ca8182af9183de3711c0376c2e5daf38c769f27a5556d438aa53e2d7"
|
|
},
|
|
{
|
|
"bytes": 389,
|
|
"path": ".specify/level5/drift-policy.yaml",
|
|
"sha256": "e81ea7435052b1cfbb3d296789a8d6c8bd839675150298a879ad7f5f1d853312"
|
|
}
|
|
],
|
|
"generated_at": "2026-07-04T16:03:46Z"
|
|
}
|