CASAN Level 4 Central AgentOps Dashboard

7-harness security posture · Level-5 controls demonstrated locally · điểm công tâm theo rubric (evidence/scoring-run-report.md) · Generated: 2026-07-11T02:34:11Z

CASAN Level 4 — chứng minh bằng tấn công Average 80.9/100 Harness thấp nhất 80 218 core tests · 0 fail Recall model 0.85 > regex 0.00

Đánh giá trưởng thành 7 Harness · rubric công tâm (2026-07-05)

H1 · Context84/100 · Strong
H2 · Tool80/100 · Good
H3 · Evaluation82/100 · Strong
H4 · Security80/100 · Good
H5 · Governance80/100 · Good
H6 · AgentOps80/100 · Good
H7 · Orchestration80/100 · Good
Average 80.9/100 · Harness thấp nhất 80 → CASAN Level 4 (chưa lên "Strong/production" — bản production của IdP/WORM-store/HSM/sandbox-isolation còn planned).
Strong 81–100 (production) Good 61–80 Partial 31–60 GAP 0–30

Bảo mật & Governance đã kiểm chứng (test đối kháng thật)

Kiểm thử đối kháng 218 / 0 fail H4 recall model 0.85 > regex 0.00 Benign FP 0.00% · block 100.00% Audit hash-chain + ký KMS (rotate/non-exportable) WORM audit ngoài (gap/tamper detected) Approval ký-danh-tính (chống giả/replay/tự-duyệt) Cost-spike 4 chế độ · drift · hallucination scan Alert live: webhook · dead-letter Unicode/base64 normalize · tool-output scan action / supply-chain / data-exfil gate

Telemetry trực tiếp (live) · pipeline harness

Total Runs
28
Average Latency
13123.61 ms
Estimated Cost
$0.083668
Failures
7
Fallback Routes
3
Provider Runs
39
Provider Tokens (thật)
25370
Provider Cost
$0.16668
Tool Denials
6
Hallucination Signals
8

Governance Signals

SignalValue
Tool registry denials6
Fallback records3
Tool registry records11
Provider telemetry records39
Registered harness projects0

Recent AgentOps Metrics (live)

TraceAgentStepStatusLatencyTokensCost
96b4c003…chat.ask-casanask-casan-readonlyfailed141ms10$0.0
c924568f…chat.ask-casanask-casan-readonlyfailed219ms10$0.0
10331f30…chat.ask-casanask-casan-readonlyfailed342ms10$0.0
2e9b93cb…chat.ask-casanask-casan-readonlysuccess57161ms57$0.0
d8796e51…chat.ask-casanask-casan-readonlysuccess57864ms833$0.0
b5ad414a…chat.ask-casanask-casan-readonlysuccess43174ms799$0.0
1fd5d347…chat.ask-casanask-casan-readonlysuccess51212ms421$0.0
1c93ce8a…goal.orchestratorlocal-worker-cloud-reviewerdegraded55732ms1087$0.0
6700500f…goal.orchestratorlocal-worker-cloud-reviewerdegraded51117ms593$0.0
21b6f387…goal.orchestratorlocal-worker-cloud-reviewersuccess44058ms560$0.0