thanhnvandClaude Opus 4.8
36a4812ef3
Standard production layout: the OKR app (was nested under AINative_OKR_CASAN5/) is now
the repository root. No more wrapper directory.
- Promote AINative_OKR_CASAN5/* -> repo root (backend/ frontend/ packages/ apps/
.specify/ docs/ infra/ nginx/ scripts/ + configs). Merge tool dirs: .gitea (kept the
active deploy ci.yml, added harness-ci.yml + runbooks), .claude (agents/commands +
launch.json), .github moved up.
- Remove redundant: 00_SUBMISSION_PACKAGE, scattered root notes (FPT_CASAN_Full.md,
tu-tuong-casan.md, casan-tu-sinh..., casan_harness_assessment.md, source-review...,
README_CASAN5_REFINED.md), casan-next-plans/ and optimize-docs/ (competition/planning
artifacts — roadmap + design history preserved in git log / commit messages).
- Update all references to the old layout:
- .gitea/workflows/{ci,harness-ci}.yml, .github/workflows/{ci,deploy}.yml:
working-directory .; drop AINative_OKR_CASAN5/ prefix; .specify/{tests,scripts}
-> packages/casan-harness/... (.specify/logs state kept)
- .claude/launch.json, .gitea/*-runbook.md: path prefixes
- CLAUDE.md, README.md: docs/input -> apps/okr/domain/input
- policy-bundle.yaml: 8 policy paths -> packages/casan-harness/...; manifest re-signed
- secrets-scan.sh: fixture excludes -> new package/domain paths.
Full gate from the new root: PASS=64 FAIL=0 SKIP=3.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
69 lines
2.3 KiB
Bash
69 lines
2.3 KiB
Bash
#!/usr/bin/env bash
|
|
set -uo pipefail
|
|
|
|
# CASAN H6 — local-vs-provider telemetry reconciliation (D2).
|
|
# Provider-API usage records are the billing ground truth; local metrics must
|
|
# not under-report tokens (the cost-hiding attack: trim local metrics so a
|
|
# runaway/exfil step looks cheap). Per step, local claimed tokens must cover
|
|
# provider-reported tokens within a tolerance; a provider step entirely absent
|
|
# from local metrics is also a discrepancy (hidden run).
|
|
#
|
|
# Usage: telemetry-reconcile.sh <local-metrics.jsonl> <provider-usage.jsonl> [tolerance_pct]
|
|
#
|
|
# Greppable outputs: TELEMETRY_RECONCILED | TELEMETRY_DISCREPANCY
|
|
|
|
LOCAL_LOG="${1:-}"
|
|
PROVIDER_LOG="${2:-}"
|
|
TOLERANCE_PCT="${3:-10}"
|
|
|
|
if [[ -z "$LOCAL_LOG" || -z "$PROVIDER_LOG" || ! -f "$PROVIDER_LOG" ]]; then
|
|
echo "Usage: telemetry-reconcile.sh <local-metrics.jsonl> <provider-usage.jsonl> [tolerance_pct]" >&2
|
|
exit 64
|
|
fi
|
|
|
|
python - "$LOCAL_LOG" "$PROVIDER_LOG" "$TOLERANCE_PCT" <<'PY'
|
|
import json
|
|
import sys
|
|
|
|
local_path, provider_path, tol_pct = sys.argv[1], sys.argv[2], float(sys.argv[3])
|
|
|
|
def sums_by_step(path):
|
|
totals = {}
|
|
try:
|
|
with open(path, encoding="utf-8") as fh:
|
|
for line in fh:
|
|
line = line.strip()
|
|
if not line:
|
|
continue
|
|
rec = json.loads(line)
|
|
step = rec.get("step")
|
|
if step is None:
|
|
continue
|
|
totals[step] = totals.get(step, 0) + int(rec.get("total_tokens", 0))
|
|
except OSError:
|
|
pass
|
|
return totals
|
|
|
|
local = sums_by_step(local_path)
|
|
provider = sums_by_step(provider_path)
|
|
if not provider:
|
|
raise SystemExit("TELEMETRY_DISCREPANCY provider log empty — nothing to reconcile against")
|
|
|
|
issues = []
|
|
for step, prov_tokens in sorted(provider.items()):
|
|
loc_tokens = local.get(step)
|
|
if loc_tokens is None:
|
|
issues.append(f"step={step} local=MISSING provider={prov_tokens}")
|
|
continue
|
|
floor = prov_tokens * (1 - tol_pct / 100.0)
|
|
if loc_tokens < floor:
|
|
issues.append(f"step={step} local={loc_tokens} provider={prov_tokens} (under-reported beyond {tol_pct}%)")
|
|
|
|
if issues:
|
|
for issue in issues:
|
|
print(f"TELEMETRY_DISCREPANCY {issue}", file=sys.stderr)
|
|
raise SystemExit(1)
|
|
print(f"TELEMETRY_RECONCILED steps={len(provider)} tolerance_pct={tol_pct}")
|
|
PY
|
|
exit $?
|