CASAN Level 4 Central AgentOps Dashboard

7-harness security posture · Level-5 controls demonstrated locally · điểm công tâm theo rubric (evidence/scoring-run-report.md) · Generated: 2026-07-05T14:11:36Z

CASAN Level 4 — chứng minh bằng tấn công Average 80.9/100 Harness thấp nhất 80 175 test · 0 fail Recall model 0.85 > regex 0.00

Đánh giá trưởng thành 7 Harness · rubric công tâm (2026-07-05)

H1 · Context84/100 · Strong
H2 · Tool80/100 · Good
H3 · Evaluation82/100 · Strong
H4 · Security80/100 · Good
H5 · Governance80/100 · Good
H6 · AgentOps80/100 · Good
H7 · Orchestration80/100 · Good
Average 80.9/100 · Harness thấp nhất 80 → CASAN Level 4 (chưa lên "Strong/production" — bản production của IdP/WORM-store/HSM/sandbox-isolation còn planned).
Strong 81–100 (production) Good 61–80 Partial 31–60 GAP 0–30

Bảo mật & Governance đã kiểm chứng (test đối kháng thật)

Kiểm thử đối kháng 175 / 0 fail H4 recall model 0.85 > regex 0.00 Benign FP 0.00% · block 100.00% Audit hash-chain + ký KMS (rotate/non-exportable) WORM audit ngoài (gap/tamper detected) Approval ký-danh-tính (chống giả/replay/tự-duyệt) Cost-spike 4 chế độ · drift · hallucination scan Alert live: webhook · dead-letter Unicode/base64 normalize · tool-output scan action / supply-chain / data-exfil gate

Telemetry trực tiếp (live) · pipeline harness

Total Runs
17
Average Latency
303.06 ms
Estimated Cost
$0.083650
Failures
5
Fallback Routes
2
Provider Runs
4
Provider Tokens (thật)
5937
Provider Cost
$0.16668
Tool Denials
6
Hallucination Signals
8

Governance Signals

SignalValue
Tool registry denials6
Fallback records2
Tool registry records11
Provider telemetry records4
Registered harness projects3

Recent AgentOps Metrics (live)

TraceAgentStepStatusLatencyTokensCost
f609cd3b…advstep-1-srssuccess209ms26$5.2e-05
19f46739…advstep-1-srssuccess215ms14$2.8e-05
24b1b289…unknown-agenttest_timeoutfailed2237ms1$2e-06
e68d8bcf…unknown-agentt4-telemetry-testsuccess221ms210$0.0
49db33c3…unknown-agentfetch_stepsuccess240ms12$2.4e-05
117249f3…unknown-agentfetch_stepsuccess232ms12$2.4e-05
db9c318c…h6.e2ee2e_fail_stepfailed201ms1$2e-06
23f82b77…unknown-agentagent_stepsuccess58ms6$1.2e-05
b8297c02…unknown-agentagent_stepsuccess204ms6$1.2e-05
4efee641…video.demodeploy_stepfailed196ms2$4e-06