gitea-admin/CASAN
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

scorecard: chấm live 2 mục hardcode; pipeline: fallback real + honest scoring doc

Browse Source 
Hướng A — scorecard.sh (video demo):
- h5_1 approval workflow: hardcode 0 → governance-check deploy live (approval_required)
- h6_2 hallucination rate: hardcode 0 → hallucination-scan phân biệt dirty>clean live
- "N/5 mục" chuyển từ text cứng sang đếm động
- H4/H5/H6 → 100/100 (5/5 gate live), Average 57.9 → 90.0

Hướng B — run-casan-pipeline.mjs:
- fallback: stub 'exit 9' → 'cat /nonexistent' (real failure, nhất quán adversarial T3)
- drift: giữ so fallback-output vs golden (clean run=1.0); năng lực phát hiện
  drift thật chứng minh ở adversarial suite
- Full 12-step run verify: H1 CONTEXT_VALID=24, H2 tool-audit records=25 signed,
  H5 audit-chain records=22 signed, H6 provider_telemetry per-step thật, H7 rollback real

phase3-real-run-scoring.md: giải thích vì sao scorecard cũ cho H5=60/H6=80
(hardcode), phân biệt scorecard-90 vs re-score-84 (2 mục đích khác nhau).

Verify: adversarial 44/0, security-gate 11/0/0, pipeline 12 steps OK.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
thanhnv
2026-07-03 00:18:43 +09:00
co-authored by Claude Sonnet 4.6
parent fda0d6447d
commit 2f06662f5d
26 changed files with 469 additions and 189 deletions
Download Patch File Download Diff File Expand all files Collapse all files
AINative_OKR_CASAN5/docs/output/output_logs/001-okr-web-app/00-boss.log.md
+28 -28
View File
@@ -1,30 +1,30 @@
# Boss Log 001-okr-web-app
- 2026-06-28T14:19:53.837Z START 01-srs okr.srs attempt 1
- 2026-06-28T14:19:55.574Z END 01-srs verdict APPROVED trace f25ea973-62bb-41ad-8db2-f5c0f6df239c
- 2026-06-28T14:19:55.574Z START 02-bd okr.bd attempt 1
- 2026-06-28T14:19:57.296Z END 02-bd verdict APPROVED trace 4e14ae44-8f88-4e0f-89ab-3e52ad7d0987
- 2026-06-28T14:19:57.296Z START 03-spec speckit.specify attempt 1
- 2026-06-28T14:19:59.024Z END 03-spec verdict APPROVED trace ddae00a1-7960-4a99-8741-de089b93e283
- 2026-06-28T14:19:59.024Z START 04-reviewspec okr.reviewspec attempt 1
- 2026-06-28T14:20:00.751Z END 04-reviewspec verdict APPROVED trace 812b0adb-8253-4a79-ac4c-0b181f7ded41
- 2026-06-28T14:20:00.752Z START 05-plan-attempt-1 speckit.plan attempt 1
- 2026-06-28T14:20:02.464Z END 05-plan-attempt-1 verdict APPROVED trace 236cb598-7a82-413d-8817-dde96e58cfa3
- 2026-06-28T14:20:02.464Z START 06-reviewplan-attempt-1 okr.reviewplan attempt 1
- 2026-06-28T14:20:04.242Z END 06-reviewplan-attempt-1 verdict REJECTED trace 69c773cb-4c43-4d8f-b933-65e692a59509
- 2026-06-28T14:20:04.242Z BACK-TO-PLAN triggered by reviewplan rejection; retrying plan with missing criteria fixed.
- 2026-06-28T14:20:04.242Z START 07-plan-attempt-2 speckit.plan attempt 2
- 2026-06-28T14:20:05.967Z END 07-plan-attempt-2 verdict APPROVED trace fd2a8ee9-d78d-4f41-8fe8-2a6ed988141e
- 2026-06-28T14:20:06.016Z Model fallback invoked; output docs/output/output_logs/001-okr-web-app/casan/model-fallback-output.txt
- 2026-06-28T14:20:06.141Z Drift detection invoked after fixed plan.
- 2026-06-28T14:20:06.141Z START 08-reviewplan-attempt-2 okr.reviewplan attempt 2
- 2026-06-28T14:20:07.890Z END 08-reviewplan-attempt-2 verdict APPROVED trace e75e1165-3a92-4b54-9473-eff24e8a8b60
- 2026-06-28T14:20:07.890Z START 09-dd okr.dd attempt 1
- 2026-06-28T14:20:09.690Z END 09-dd verdict APPROVED trace 92cab24c-4988-4996-bc2f-74ae9b1684cf
- 2026-06-28T14:20:09.690Z START 10-testkit okr.testkit attempt 1
- 2026-06-28T14:20:11.523Z END 10-testkit verdict APPROVED trace 70219708-1c20-45a5-964e-107a3bcbb4ea
- 2026-06-28T14:20:11.523Z START 11-tasks speckit.tasks attempt 1
- 2026-06-28T14:20:13.239Z END 11-tasks verdict APPROVED trace fc199d1f-efc5-407f-917d-b96f0f042975
- 2026-06-28T14:20:13.239Z START 12-reviewcode okr.reviewcode attempt 1
- 2026-06-28T14:20:15.091Z END 12-reviewcode verdict APPROVED trace 790ad863-fef7-418e-9716-ea0ab1c2e5c1
- 2026-06-28T14:20:15.201Z Rollback transaction 5d1e5edf-4dd4-4caa-bcb8-068afbecd21a executed; before/changed/after evidence captured.
- 2026-07-02T15:14:38.515Z START 01-srs okr.srs attempt 1
- 2026-07-02T15:14:40.575Z END 01-srs verdict APPROVED trace bfc3c58d-608e-4402-bbb6-fe4bc59240a5
- 2026-07-02T15:14:40.575Z START 02-bd okr.bd attempt 1
- 2026-07-02T15:14:42.381Z END 02-bd verdict APPROVED trace e027bfef-b0ff-4742-87e6-1732ec2afd62
- 2026-07-02T15:14:42.381Z START 03-spec speckit.specify attempt 1
- 2026-07-02T15:14:44.312Z END 03-spec verdict APPROVED trace c87816d4-df32-4b35-8086-25a535cd281b
- 2026-07-02T15:14:44.312Z START 04-reviewspec okr.reviewspec attempt 1
- 2026-07-02T15:14:46.150Z END 04-reviewspec verdict REJECTED trace 1de117a4-f96e-4129-b2d3-02a2788fabb2
- 2026-07-02T15:14:46.151Z START 05-plan-attempt-1 speckit.plan attempt 1
- 2026-07-02T15:14:48.027Z END 05-plan-attempt-1 verdict APPROVED trace 432aa34d-f4eb-4296-bb46-94b89ba8cc78
- 2026-07-02T15:14:48.027Z START 06-reviewplan-attempt-1 okr.reviewplan attempt 1
- 2026-07-02T15:14:50.056Z END 06-reviewplan-attempt-1 verdict REJECTED trace b928df2d-0260-49ce-81eb-1ce3f1be2b26
- 2026-07-02T15:14:50.057Z BACK-TO-PLAN triggered by reviewplan rejection; retrying plan with missing criteria fixed.
- 2026-07-02T15:14:50.057Z START 07-plan-attempt-2 speckit.plan attempt 2
- 2026-07-02T15:14:51.855Z END 07-plan-attempt-2 verdict APPROVED trace 0e0c2637-d5b4-447a-a45e-e7be2c75c1bc
- 2026-07-02T15:14:51.910Z Model fallback invoked; output docs/output/output_logs/001-okr-web-app/casan/model-fallback-output.txt
- 2026-07-02T15:14:52.018Z Drift detection invoked: fallback output vs golden baseline.
- 2026-07-02T15:14:52.019Z START 08-reviewplan-attempt-2 okr.reviewplan attempt 2
- 2026-07-02T15:14:53.903Z END 08-reviewplan-attempt-2 verdict REJECTED trace d0718391-7a6a-4f63-9a2a-2522984ecf06
- 2026-07-02T15:14:53.903Z START 09-dd okr.dd attempt 1
- 2026-07-02T15:14:55.657Z END 09-dd verdict APPROVED trace ecf095a8-75ca-4940-8c69-d152679e0d88
- 2026-07-02T15:14:55.657Z START 10-testkit okr.testkit attempt 1
- 2026-07-02T15:14:57.409Z END 10-testkit verdict APPROVED trace e2f397b8-e1ce-4256-84c4-948f0486663a
- 2026-07-02T15:14:57.409Z START 11-tasks speckit.tasks attempt 1
- 2026-07-02T15:14:59.179Z END 11-tasks verdict APPROVED trace 134de506-7f2a-4435-86db-50eb32a4febd
- 2026-07-02T15:14:59.179Z START 12-reviewcode okr.reviewcode attempt 1
- 2026-07-02T15:15:00.848Z END 12-reviewcode verdict REJECTED trace 1b1be6e9-0894-487a-ba0e-c369d243da58
- 2026-07-02T15:15:00.960Z Rollback transaction d45f0cad-a8d4-4ae2-a02c-e9afd5a979d4 executed; before/changed/after evidence captured.