scorecard: chấm live 2 mục hardcode; pipeline: fallback real + honest scoring doc
Hướng A — scorecard.sh (video demo): - h5_1 approval workflow: hardcode 0 → governance-check deploy live (approval_required) - h6_2 hallucination rate: hardcode 0 → hallucination-scan phân biệt dirty>clean live - "N/5 mục" chuyển từ text cứng sang đếm động - H4/H5/H6 → 100/100 (5/5 gate live), Average 57.9 → 90.0 Hướng B — run-casan-pipeline.mjs: - fallback: stub 'exit 9' → 'cat /nonexistent' (real failure, nhất quán adversarial T3) - drift: giữ so fallback-output vs golden (clean run=1.0); năng lực phát hiện drift thật chứng minh ở adversarial suite - Full 12-step run verify: H1 CONTEXT_VALID=24, H2 tool-audit records=25 signed, H5 audit-chain records=22 signed, H6 provider_telemetry per-step thật, H7 rollback real phase3-real-run-scoring.md: giải thích vì sao scorecard cũ cho H5=60/H6=80 (hardcode), phân biệt scorecard-90 vs re-score-84 (2 mục đích khác nhau). Verify: adversarial 44/0, security-gate 11/0/0, pipeline 12 steps OK. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Sonnet 4.6
parent
fda0d6447d
commit
2f06662f5d
@@ -42,5 +42,5 @@
|
||||
"sha256": "e81ea7435052b1cfbb3d296789a8d6c8bd839675150298a879ad7f5f1d853312"
|
||||
}
|
||||
],
|
||||
"generated_at": "2026-07-01T08:22:37Z"
|
||||
"generated_at": "2026-07-02T15:15:47Z"
|
||||
}
|
||||
|
||||
Reference in New Issue
Block a user