# CASAN4 Harness Test Report

Generated: 2026-07-07T05:59:07Z

PASS: H4 blocks prompt injection
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02-pii-output.txt contains ***MASKED_EMAIL***
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02-pii-output.txt contains ***MASKED_PHONE***
PASS: H4 blocks jailbreak attempt
PASS: H4 blocks private key material
PASS: H5 denies high-risk action by default
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/04-high-risk-approved-output.txt contains Deploy
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/cost/metrics.jsonl contains "latency_ms"
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/cost/metrics.jsonl contains "cost_estimate"
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/cost/metrics.jsonl contains "cost_source"
PASS: H6 detects hallucination signals (count=4)
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/cost/metrics.jsonl contains "cost_source":"provider_telemetry"
PASS: H6 preserves failing command exit code
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/agentops/alerts.log contains execution-failed
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/audit/tool-calls.jsonl contains "tool": "Bash"
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/06b-audit-chain.stdout contains AUDIT_CHAIN_VALID
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/07-wrapper-output.txt contains ***MASKED_EMAIL***
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/07b-wrapper-cache.stdout contains cache=cached
PASS: H2 cache hit still records CASAN traces
validated 32 trace json files
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/output_logs/casan-demo/pipeline-context.yaml contains step-13-launch
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/09-drift.stdout contains DRIFT_PASS
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/10-fallback.stdout contains route=fallback
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/10-fallback-output.txt contains fallback model output
PASS: L5 tool registry denies deploy without idempotency key
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/12-tool-approve.stdout contains TOOL_APPROVED
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/audit/tool-calls.jsonl contains "tool": "deploy"
PASS: H2 tool registry denies unauthorized agent
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/11b-tool-unauthorized.stderr contains unauthorized_agent
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/11c-tool-audit-verify.stdout contains TOOL_AUDIT_VALID
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/13-rollback-marker.txt contains rolled_back
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/14-business-kpi.stdout contains status=pass
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/16-policy-verify.stdout contains POLICY_SIGNATURE_VALID
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/17-provider-telemetry.stdout contains PROVIDER_TELEMETRY_IMPORTED
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/18-harness-reuse.stdout contains HARNESS_REUSE_VALID
PASS: /mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/central-agentops-dashboard.html contains CASAN Level 4 Central AgentOps Dashboard

## Evidence Files
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/01-attack-input.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/01-attack-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/01-security-attack.stderr
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/01-security-attack.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02-pii-input.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02-pii-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02-security-pii.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02b-jailbreak-input.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02b-jailbreak-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02b-jailbreak.stderr
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02b-jailbreak.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02c-private-key-input.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02c-private-key-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02c-private-key.stderr
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/02c-private-key.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/03-governance-deny.stderr
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/03-governance-deny.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/03-high-risk-input.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/03-high-risk-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/04-governance-approve.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/04-high-risk-approved-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/05-agentops.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/05-metrics-input.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/05-metrics-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/05b-hallucination-input.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/05b-hallucination-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/05b-hallucination.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/05c-provider-import.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/05c-provider-metrics.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/05c-provider-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/06-agentops-fail.stderr
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/06-agentops-fail.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/06-failure-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/06b-audit-chain.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/07-wrapper-input.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/07-wrapper-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/07-wrapper.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/07b-wrapper-cache.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/08-demo-context.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/evidence/harness-test-report.md

## Trace Files
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-236cb598-7a82-413d-8817-dde96e58cfa3.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-4e14ae44-8f88-4e0f-89ab-3e52ad7d0987.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-69c773cb-4c43-4d8f-b933-65e692a59509.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-70219708-1c20-45a5-964e-107a3bcbb4ea.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-790ad863-fef7-418e-9716-ea0ab1c2e5c1.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-812b0adb-8253-4a79-ac4c-0b181f7ded41.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-92cab24c-4988-4996-bc2f-74ae9b1684cf.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-ddae00a1-7960-4a99-8741-de089b93e283.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-e75e1165-3a92-4b54-9473-eff24e8a8b60.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-f25ea973-62bb-41ad-8db2-f5c0f6df239c.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-fc199d1f-efc5-407f-917d-b96f0f042975.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-fd2a8ee9-d78d-4f41-8fe8-2a6ed988141e.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-trace-1783403957-11014.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-trace-1783403958-11069.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-trace-1783403960-11136.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-trace-1783403961-11186.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-trace-1783403965-11798.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/agentops-trace-1783403972-12960.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/governance-trace-1783403956-10930.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/governance-trace-1783403956-10970.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/governance-trace-1783403964-11754.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/governance-trace-1783403971-12916.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/security-trace-1783403949-9341.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/security-trace-1783403950-9708.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/security-trace-1783403952-10182.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/security-trace-1783403954-10549.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/security-trace-1783403963-11289.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/security-trace-1783403966-11851.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/security-trace-1783403968-12317.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/security-trace-1783403969-12451.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/security-trace-1783403974-13021.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/trace/security-trace-1783403975-13487.json

## Audit Files
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/audit/audit-head.sig
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/audit/audit-head.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/audit/audit.jsonl
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/audit/security.jsonl
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/audit/tool-calls-head.sig
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/audit/tool-calls-head.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/audit/tool-calls.jsonl

## Metrics Files
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/cost/metrics.jsonl

## Demo Pipeline Context
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/output_logs/casan-demo/pipeline-context.yaml

## Level 5 Evidence
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/09-drift-candidate.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/09-drift-report.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/09-drift.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/10-fallback-output.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/10-fallback.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/11-tool-deny.stderr
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/11-tool-deny.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/11b-tool-unauthorized.stderr
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/11b-tool-unauthorized.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/11c-tool-audit-verify.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/12-tool-approve.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/13-rollback-execute.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/13-rollback-marker.txt
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/13-rollback-record.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/14-business-kpi-input.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/14-business-kpi-report.json
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/14-business-kpi.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/15-dashboard.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/15-policy-sign.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/16-policy-verify.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/17-provider-telemetry.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/level5-evidence/18-harness-reuse.stdout
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/agentops-dashboard.html
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/docs/output/casan/central-agentops-dashboard.html

## Level 5 Logs
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/level5/fallback.jsonl
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/level5/provider-usage.jsonl
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/level5/rollback-backups/tx-1783403980-13719.bak
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/level5/rollback-transactions.jsonl
/mnt/d/AI/casan5-main/casan5/AINative_OKR_CASAN5/.specify/logs/level5/tool-registry.jsonl