Ran all 7 suites sequentially on 2026-07-04 @ 00aabfa with Vault dev live so KMS
runs (not skips): run-casan4 35 · adversarial 44 · phase1-track-a 25 ·
phase2-track-c 29 · phase3-evidence 7 · phase-h5-approval 8 · phase-h5-infra 7
= 155 PASS / 0 FAIL; security-gate PASS=11 FAIL=0.
- scoring-run-report.md: fair re-score — H5 76→80 (approval-identity + KMS live
rotate/non-exportable + WORM), lowest harness now H6=79, avg ~80.7/100, Level 4.
Evidence lists the live KMS + WORM results.
- CASAN_HARDENING_STATUS.md: new Phase 4 (C4 approval-identity, B3 KMS, C5 WORM =
implemented+tested); test inventory 140→155 (7 suites); planned→partial for
KMS/approval/WORM with honest remaining gaps (live IdP, S3 WORM store, KMS default).
- Plan-07 §2: key-mgmt 2.5→4, policy-approval 2.5→4, external-audit 1.5→3.5;
header now H5 76→80, lowest harness H6.
- INDEX row, README claim boundary, video-guide Q&A: 155 checks, H5=80, lowest H6=79.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Evidence Index
This folder is an index only. The canonical evidence remains inside ../AINative_OKR_CASAN5 so the source package, logs, reports, and scripts stay together.
Fastest Verification
cd ../AINative_OKR_CASAN5
bash .specify/tests/run-casan4-harness-tests.sh
Expected result: all checks pass.
High-Value Evidence Paths
| Evidence Type | Path |
|---|---|
| Full test report | ../AINative_OKR_CASAN5/docs/output/casan/evidence/harness-test-report.md |
| Security attack block | ../AINative_OKR_CASAN5/docs/output/casan/evidence/01-security-attack.stderr |
| PII masking output | ../AINative_OKR_CASAN5/docs/output/casan/evidence/02-pii-output.txt |
| Governance deny evidence | ../AINative_OKR_CASAN5/docs/output/casan/evidence/03-governance-deny.stderr |
| Approved high-risk evidence | ../AINative_OKR_CASAN5/docs/output/casan/evidence/04-high-risk-approved-output.txt |
| Audit-chain verification | ../AINative_OKR_CASAN5/docs/output/casan/evidence/06b-audit-chain.stdout |
| Demo pipeline context | ../AINative_OKR_CASAN5/docs/output/output_logs/casan-demo/pipeline-context.yaml |
| Level 5 evidence folder | ../AINative_OKR_CASAN5/docs/output/casan/level5-evidence/ |
| Central dashboard | ../AINative_OKR_CASAN5/docs/output/casan/central-agentops-dashboard.html |
| Policy signature | ../AINative_OKR_CASAN5/.specify/level5/central-governance/policy-manifest.sig |
| Public verification key | ../AINative_OKR_CASAN5/.specify/level5/central-governance/policy-public.pem |
Evidence Review Order
- Run the test harness.
- Open
harness-test-report.md. - Open
pipeline-context.yaml. - Open
central-agentops-dashboard.html. - Inspect signed policy files and confirm
policy-private.pemis not packaged.