gitea-admin/CASAN
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

scorecard: chấm live 2 mục hardcode; pipeline: fallback real + honest scoring doc

Browse Source 
Hướng A — scorecard.sh (video demo):
- h5_1 approval workflow: hardcode 0 → governance-check deploy live (approval_required)
- h6_2 hallucination rate: hardcode 0 → hallucination-scan phân biệt dirty>clean live
- "N/5 mục" chuyển từ text cứng sang đếm động
- H4/H5/H6 → 100/100 (5/5 gate live), Average 57.9 → 90.0

Hướng B — run-casan-pipeline.mjs:
- fallback: stub 'exit 9' → 'cat /nonexistent' (real failure, nhất quán adversarial T3)
- drift: giữ so fallback-output vs golden (clean run=1.0); năng lực phát hiện
  drift thật chứng minh ở adversarial suite
- Full 12-step run verify: H1 CONTEXT_VALID=24, H2 tool-audit records=25 signed,
  H5 audit-chain records=22 signed, H6 provider_telemetry per-step thật, H7 rollback real

phase3-real-run-scoring.md: giải thích vì sao scorecard cũ cho H5=60/H6=80
(hardcode), phân biệt scorecard-90 vs re-score-84 (2 mục đích khác nhau).

Verify: adversarial 44/0, security-gate 11/0/0, pipeline 12 steps OK.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
thanhnv
2026-07-03 00:18:43 +09:00
co-authored by Claude Sonnet 4.6
parent fda0d6447d
commit 2f06662f5d
26 changed files with 469 additions and 189 deletions
Download Patch File Download Diff File Expand all files Collapse all files
AINative_OKR_CASAN5/docs/output/output_logs/001-okr-web-app/casan/04-reviewspec-output.md
+2 -2
View File
@@ -1,12 +1,12 @@
## Spec Conformance Review Report
Criteria checked: FR coverage, role filtering, validation, golden regression. Missing: none.
Criteria checked: FR coverage, role filtering, validation, golden regression. Missing: none. model-judge: REJECTED (tokens=420).
Generated by 04-reviewspec attempt 1 for 001-okr-web-app.
<!-- STEP-RESULT
status: COMPLETE
verdict: APPROVED
verdict: REJECTED
artifacts:
- docs/output/specs/001-okr-web-app/spec.md
critical-issues:
AINative_OKR_CASAN5/docs/output/output_logs/001-okr-web-app/casan/06-reviewplan-attempt-1-output.md
+1 -5
View File
@@ -1,6 +1,6 @@
## Plan Conformance Review Report — Attempt 1
Criteria checked against plan.md and required companion artifacts. Verdict is REJECTED.
Criteria checked against plan.md and required companion artifacts. model-judge: SKIP (rule_already_rejected). Verdict is REJECTED.
Generated by 06-reviewplan attempt 1 for 001-okr-web-app.
@@ -16,8 +16,4 @@ artifacts:
critical-issues:
- missing plan criterion: Golden regression test
- missing plan criterion: Rollback strategy
- missing artifact: docs/output/specs/001-okr-web-app/data-model.md
- missing artifact: docs/output/specs/001-okr-web-app/research.md
- missing artifact: docs/output/specs/001-okr-web-app/quickstart.md
- missing artifact: docs/output/specs/001-okr-web-app/contracts/openapi.md
/STEP-RESULT -->
AINative_OKR_CASAN5/docs/output/output_logs/001-okr-web-app/casan/08-reviewplan-attempt-2-output.md
+2 -2
View File
@@ -1,12 +1,12 @@
## Plan Conformance Review Report — Attempt 2
Criteria checked against plan.md and required companion artifacts. Verdict is APPROVED.
Criteria checked against plan.md and required companion artifacts. model-judge: REJECTED (tokens=373). Verdict is REJECTED. Rollback executed: plan restored to pre-overwrite state (tx=56b6f5f6-a343-4958-a557-167ef20fd392).
Generated by 06-reviewplan attempt 2 for 001-okr-web-app.
<!-- STEP-RESULT
status: COMPLETE
verdict: APPROVED
verdict: REJECTED
artifacts:
- docs/output/specs/001-okr-web-app/plan.md
- docs/output/specs/001-okr-web-app/data-model.md
AINative_OKR_CASAN5/docs/output/output_logs/001-okr-web-app/casan/12-reviewcode-output.md
+3 -3
View File
@@ -1,12 +1,12 @@
# STEP 10: Code Review Report
Reviewed 5 backend/test files. DB data usage verification: Prisma Client used, frontend API client used, seed data exists, no static endpoint data found.
Reviewed 5 backend/test files. DB data usage verification: Prisma Client used, frontend API client used, seed data exists, no static endpoint data found. model-judge: SKIP (rule_already_rejected).
Generated by 10-reviewcode attempt 1 for 001-okr-web-app.
<!-- STEP-RESULT
status: COMPLETE
verdict: APPROVED
verdict: REJECTED
artifacts:
- backend/src/auth/auth.service.ts
- backend/src/objectives/objectives.service.ts
@@ -16,5 +16,5 @@ artifacts:
- frontend/src/lib/api.ts
- backend/prisma/seed.ts
critical-issues:
- none
- golden test not found
/STEP-RESULT -->