gitea-admin/CASAN
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

scorecard: chấm live 2 mục hardcode; pipeline: fallback real + honest scoring doc

Browse Source 
Hướng A — scorecard.sh (video demo):
- h5_1 approval workflow: hardcode 0 → governance-check deploy live (approval_required)
- h6_2 hallucination rate: hardcode 0 → hallucination-scan phân biệt dirty>clean live
- "N/5 mục" chuyển từ text cứng sang đếm động
- H4/H5/H6 → 100/100 (5/5 gate live), Average 57.9 → 90.0

Hướng B — run-casan-pipeline.mjs:
- fallback: stub 'exit 9' → 'cat /nonexistent' (real failure, nhất quán adversarial T3)
- drift: giữ so fallback-output vs golden (clean run=1.0); năng lực phát hiện
  drift thật chứng minh ở adversarial suite
- Full 12-step run verify: H1 CONTEXT_VALID=24, H2 tool-audit records=25 signed,
  H5 audit-chain records=22 signed, H6 provider_telemetry per-step thật, H7 rollback real

phase3-real-run-scoring.md: giải thích vì sao scorecard cũ cho H5=60/H6=80
(hardcode), phân biệt scorecard-90 vs re-score-84 (2 mục đích khác nhau).

Verify: adversarial 44/0, security-gate 11/0/0, pipeline 12 steps OK.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
thanhnv
2026-07-03 00:18:43 +09:00
co-authored by Claude Sonnet 4.6
parent fda0d6447d
commit 2f06662f5d
26 changed files with 469 additions and 189 deletions
Download Patch File Download Diff File Expand all files Collapse all files
AINative_OKR_CASAN5/.specify/logs/audit/audit.jsonl
+10 -9
View File
@@ -1,9 +1,10 @@
{"timestamp":"2026-07-01T08:22:19Z","trace_id":"9b50a7f9-9e6a-4187-8064-78d3dca1472b","harness":"H5-governance","action":"deploy","actor":"developer","risk_level":"high","decision":"denied","approval_status":"approval_required","approver":"","input_hash":"3c1cf354bd8e23e98738dd97e726a7c751cf9c7574454d52b9698bfbb9000bff","output_hash":"3c1cf354bd8e23e98738dd97e726a7c751cf9c7574454d52b9698bfbb9000bff","previous_record_hash":"","record_hash":"ad93297d9f059d29a81f1b79332cb389bc6a7949ce6905889c9313bb07134a54"}
{"timestamp":"2026-07-01T08:22:19Z","trace_id":"a8e0d352-87d3-47b4-8bd3-8377b104274b","harness":"H5-governance","action":"deploy","actor":"developer","risk_level":"high","decision":"approved","approval_status":"human_approved","approver":"architect@example.local","input_hash":"3c1cf354bd8e23e98738dd97e726a7c751cf9c7574454d52b9698bfbb9000bff","output_hash":"3c1cf354bd8e23e98738dd97e726a7c751cf9c7574454d52b9698bfbb9000bff","previous_record_hash":"ad93297d9f059d29a81f1b79332cb389bc6a7949ce6905889c9313bb07134a54","record_hash":"99448ee04ba04a32c4e075d531dab51c390affd192483e05155fb79508373b6d"}
{"timestamp":"2026-07-01T08:22:24Z","trace_id":"b9d24467-ceb9-40a6-9d07-0afaa7c3790e","harness":"H5-governance","action":"agent_step","actor":"developer","risk_level":"low","decision":"approved","approval_status":"auto_approved","approver":"","input_hash":"0649852ef55d103b9b1134daf5324e92a3e2254386dc137787ca9432b2e4b9bf","output_hash":"0649852ef55d103b9b1134daf5324e92a3e2254386dc137787ca9432b2e4b9bf","previous_record_hash":"99448ee04ba04a32c4e075d531dab51c390affd192483e05155fb79508373b6d","record_hash":"8bd93fcfcd6e7fbc3552a66cedfbafe81c3ac6be1bef9607ef5723c44866b992"}
{"timestamp":"2026-07-01T08:22:33Z","trace_id":"a2ddaefd-da89-4e50-8643-586ce72d4e7e","harness":"H5-governance","action":"agent_step","actor":"developer","risk_level":"low","decision":"approved","approval_status":"auto_approved","approver":"","input_hash":"0649852ef55d103b9b1134daf5324e92a3e2254386dc137787ca9432b2e4b9bf","output_hash":"0649852ef55d103b9b1134daf5324e92a3e2254386dc137787ca9432b2e4b9bf","previous_record_hash":"8bd93fcfcd6e7fbc3552a66cedfbafe81c3ac6be1bef9607ef5723c44866b992","record_hash":"c7d0241e2fa1294912a0ef23397b25154053832911fd09ab582d6bf10e083451"}
{"timestamp":"2026-07-01T08:22:45Z","trace_id":"9d3a11ac-4d79-418e-8ba9-80f4f41548bc","harness":"H5-governance","action":"deploy","actor":"alice","risk_level":"high","decision":"denied","approval_status":"separation_of_duties_violation","approver":"alice","input_hash":"ec9c2145d75be1bf0080711b5bd106465a8307147205ea249bfa1faa0bf05bbb","output_hash":"ec9c2145d75be1bf0080711b5bd106465a8307147205ea249bfa1faa0bf05bbb","previous_record_hash":"c7d0241e2fa1294912a0ef23397b25154053832911fd09ab582d6bf10e083451","record_hash":"2ea3ea3b993e2f1da5f1b7779a43af5eb75ec65422ac6b6e0fc8644d8d0baf37"}
{"timestamp":"2026-07-01T08:22:45Z","trace_id":"2c0ae8fb-a394-44fe-a7c9-4d55137be9f1","harness":"H5-governance","action":"deploy","actor":"alice","risk_level":"high","decision":"approved","approval_status":"human_approved","approver":"bob","input_hash":"ec9c2145d75be1bf0080711b5bd106465a8307147205ea249bfa1faa0bf05bbb","output_hash":"ec9c2145d75be1bf0080711b5bd106465a8307147205ea249bfa1faa0bf05bbb","previous_record_hash":"2ea3ea3b993e2f1da5f1b7779a43af5eb75ec65422ac6b6e0fc8644d8d0baf37","record_hash":"a6cfec4b39a2668e1187d36ad083462d576d5cece19cef2e27429e596b69cd9e"}
{"timestamp":"2026-07-01T08:22:56Z","trace_id":"486b1393-7c02-43f4-990b-9f47d70806b2","harness":"H5-governance","action":"write_code","actor":"developer","risk_level":"medium","decision":"approved","approval_status":"policy_auto_approved_with_audit","approver":"","input_hash":"d62056ac97257e952127e4ee599f12b633725abe0c5a7c8fbaa82d6c29561190","output_hash":"d62056ac97257e952127e4ee599f12b633725abe0c5a7c8fbaa82d6c29561190","previous_record_hash":"a6cfec4b39a2668e1187d36ad083462d576d5cece19cef2e27429e596b69cd9e","record_hash":"535810bb851a289a01a73fb04ef611d7500227a8a1fe983a084e67c72a76a76e"}
{"timestamp":"2026-07-01T08:22:58Z","trace_id":"0e8d6c15-73db-4d47-b140-d222c2ceed58","harness":"H5-governance","action":"write_code","actor":"developer","risk_level":"medium","decision":"approved","approval_status":"policy_auto_approved_with_audit","approver":"","input_hash":"d62056ac97257e952127e4ee599f12b633725abe0c5a7c8fbaa82d6c29561190","output_hash":"d62056ac97257e952127e4ee599f12b633725abe0c5a7c8fbaa82d6c29561190","previous_record_hash":"535810bb851a289a01a73fb04ef611d7500227a8a1fe983a084e67c72a76a76e","record_hash":"fa1030b0aa61ae5d54b1f090179f74c0cf88332833dea7fca82b2eb10e0f7e3e"}
{"timestamp":"2026-07-01T08:23:15Z","trace_id":"592279b5-0f99-46af-8003-12ae1742fc17","harness":"H5-governance","action":"test_timeout","actor":"developer","risk_level":"low","decision":"approved","approval_status":"auto_approved","approver":"","input_hash":"c96c6d5be8d08a12e7b5cdc1b207fa6b2430974c86803d8891675e76fd992c20","output_hash":"c96c6d5be8d08a12e7b5cdc1b207fa6b2430974c86803d8891675e76fd992c20","previous_record_hash":"fa1030b0aa61ae5d54b1f090179f74c0cf88332833dea7fca82b2eb10e0f7e3e","record_hash":"87b66e698d5aeb09080855db698e67788ea23a4db3650784b455bca9ecd8a7d2"}
{"timestamp":"2026-07-02T15:15:40Z","trace_id":"031578cf-afc6-49ba-ac6a-e2fbae743b8b","harness":"H5-governance","action":"deploy","actor":"developer","risk_level":"high","decision":"denied","approval_status":"approval_required","approver":"","input_hash":"3c1cf354bd8e23e98738dd97e726a7c751cf9c7574454d52b9698bfbb9000bff","output_hash":"3c1cf354bd8e23e98738dd97e726a7c751cf9c7574454d52b9698bfbb9000bff","previous_record_hash":"","record_hash":"1ab87ffb85110b3997e6896f43b428ed0498f6ff56d7040fa928ed4f733462dd"}
{"timestamp":"2026-07-02T15:15:40Z","trace_id":"1855461d-417f-4c47-a048-e4a56eb584d7","harness":"H5-governance","action":"deploy","actor":"developer","risk_level":"high","decision":"approved","approval_status":"human_approved","approver":"architect@example.local","input_hash":"3c1cf354bd8e23e98738dd97e726a7c751cf9c7574454d52b9698bfbb9000bff","output_hash":"3c1cf354bd8e23e98738dd97e726a7c751cf9c7574454d52b9698bfbb9000bff","previous_record_hash":"1ab87ffb85110b3997e6896f43b428ed0498f6ff56d7040fa928ed4f733462dd","record_hash":"19dcc7c8e3c7e3bf7f1cd198c11177948c9821987648dac4c0befbadc84a8c0c"}
{"timestamp":"2026-07-02T15:15:43Z","trace_id":"f54dd264-6cb4-4777-a98c-799708d4c54e","harness":"H5-governance","action":"agent_step","actor":"developer","risk_level":"low","decision":"approved","approval_status":"auto_approved","approver":"","input_hash":"0649852ef55d103b9b1134daf5324e92a3e2254386dc137787ca9432b2e4b9bf","output_hash":"0649852ef55d103b9b1134daf5324e92a3e2254386dc137787ca9432b2e4b9bf","previous_record_hash":"19dcc7c8e3c7e3bf7f1cd198c11177948c9821987648dac4c0befbadc84a8c0c","record_hash":"d658160f7e7507e6eef8df3d3e05faad220b317b1dfc1277afb0df9fae136434"}
{"timestamp":"2026-07-02T15:15:45Z","trace_id":"9271b5fd-b3d3-4732-a8ca-0a1a3feba5d3","harness":"H5-governance","action":"agent_step","actor":"developer","risk_level":"low","decision":"approved","approval_status":"auto_approved","approver":"","input_hash":"0649852ef55d103b9b1134daf5324e92a3e2254386dc137787ca9432b2e4b9bf","output_hash":"0649852ef55d103b9b1134daf5324e92a3e2254386dc137787ca9432b2e4b9bf","previous_record_hash":"d658160f7e7507e6eef8df3d3e05faad220b317b1dfc1277afb0df9fae136434","record_hash":"8407112bd7e6977af334991bef9bab4bbd5314cb6b1723fb275c9564309782a6"}
{"timestamp":"2026-07-02T15:15:52Z","trace_id":"489deeeb-1060-4b77-9a7c-57c200e0ff7b","harness":"H5-governance","action":"deploy","actor":"alice","risk_level":"high","decision":"denied","approval_status":"separation_of_duties_violation","approver":"alice","input_hash":"ec9c2145d75be1bf0080711b5bd106465a8307147205ea249bfa1faa0bf05bbb","output_hash":"ec9c2145d75be1bf0080711b5bd106465a8307147205ea249bfa1faa0bf05bbb","previous_record_hash":"8407112bd7e6977af334991bef9bab4bbd5314cb6b1723fb275c9564309782a6","record_hash":"0204909926ae9e674da6bf9881bc7a8095229aefdf1859a056149d985ca1d1c5"}
{"timestamp":"2026-07-02T15:15:52Z","trace_id":"46ccccad-7a0a-4aff-b22a-141ea6968d27","harness":"H5-governance","action":"deploy","actor":"alice","risk_level":"high","decision":"approved","approval_status":"human_approved","approver":"bob","input_hash":"ec9c2145d75be1bf0080711b5bd106465a8307147205ea249bfa1faa0bf05bbb","output_hash":"ec9c2145d75be1bf0080711b5bd106465a8307147205ea249bfa1faa0bf05bbb","previous_record_hash":"0204909926ae9e674da6bf9881bc7a8095229aefdf1859a056149d985ca1d1c5","record_hash":"0a969401dbaa596680b237e0f1980edb22af062ad25d89262ce6f22d6fce3cd1"}
{"timestamp":"2026-07-02T15:15:54Z","trace_id":"ee75b221-3ab2-4cca-8480-1a1c5467bf65","harness":"H5-governance","action":"write_code","actor":"developer","risk_level":"medium","decision":"approved","approval_status":"policy_auto_approved_with_audit","approver":"","input_hash":"d62056ac97257e952127e4ee599f12b633725abe0c5a7c8fbaa82d6c29561190","output_hash":"d62056ac97257e952127e4ee599f12b633725abe0c5a7c8fbaa82d6c29561190","previous_record_hash":"0a969401dbaa596680b237e0f1980edb22af062ad25d89262ce6f22d6fce3cd1","record_hash":"4dd52c02151fa3c3e70c54426a0740bdb14aa3650900ed1a29cf4c75536b5cb3"}
{"timestamp":"2026-07-02T15:15:55Z","trace_id":"0aabaec4-e6b0-472f-9b60-6b93931cb3b8","harness":"H5-governance","action":"write_code","actor":"developer","risk_level":"medium","decision":"approved","approval_status":"policy_auto_approved_with_audit","approver":"","input_hash":"d62056ac97257e952127e4ee599f12b633725abe0c5a7c8fbaa82d6c29561190","output_hash":"d62056ac97257e952127e4ee599f12b633725abe0c5a7c8fbaa82d6c29561190","previous_record_hash":"4dd52c02151fa3c3e70c54426a0740bdb14aa3650900ed1a29cf4c75536b5cb3","record_hash":"3b3df7bb584200c71b5d0e796e370bbb9aa0261dc23277b084bdc68076a784cc"}
{"timestamp":"2026-07-02T15:16:02Z","trace_id":"d3e6da2b-993b-4ad5-a23b-9db7de22a664","harness":"H5-governance","action":"test_timeout","actor":"developer","risk_level":"low","decision":"approved","approval_status":"auto_approved","approver":"","input_hash":"c96c6d5be8d08a12e7b5cdc1b207fa6b2430974c86803d8891675e76fd992c20","output_hash":"c96c6d5be8d08a12e7b5cdc1b207fa6b2430974c86803d8891675e76fd992c20","previous_record_hash":"3b3df7bb584200c71b5d0e796e370bbb9aa0261dc23277b084bdc68076a784cc","record_hash":"c49b1b14b13b474a74e38b36b05970ddb618bff931978abf80ce00f10dd39233"}
{"timestamp":"2026-07-02T15:17:49Z","trace_id":"40b6eef8-18a9-4409-b331-b42285fd1424","harness":"H5-governance","action":"deploy","actor":"developer","risk_level":"high","decision":"denied","approval_status":"approval_required","approver":"","input_hash":"c3a4b726eb38096f511200d9be903d32beec1278a54f2855b9437fce73e7e216","output_hash":"c3a4b726eb38096f511200d9be903d32beec1278a54f2855b9437fce73e7e216","previous_record_hash":"c49b1b14b13b474a74e38b36b05970ddb618bff931978abf80ce00f10dd39233","record_hash":"df102e5989d1275c34f83fc83ffb3ee7e19ba08e8ef63d87e138c1c4dd782420"}