thanhnvandClaude Opus 4.8
3adc48ed82
Resolve every root by marker walk-up instead of a fixed depth that only lands on the app via the .specify compat symlink, so the harness runs correctly when invoked by its real packages/casan-harness path — proven by a full gate run via that path: 64/0/0. - 95 scripts/tests: PROJECT_ROOT/ROOT "$SCRIPT_DIR/../.."-style computations -> $CASAN_APP_ROOT. - 6 leaf scripts (infra-lab, context-validate, secrets-scan, path-guard, toolchain-verify, phase2-sourcegen) now source casan-paths + use CASAN_APP_ROOT. - run-casan4: source casan-paths as a package sibling (facade-independent), PROJECT_ROOT=CASAN_APP_ROOT. - 8 Python files: project_root()/REPO_ROOT/bundle_root walk UP for the .specify marker (control-plane-settings, loop_common, model-call, context-compress, test-integrity, bundle-integrity, traceability-matrix; generate-* fixed earlier). - evidence-pack-build.py + traceability-matrix.py: domain refs -> apps/okr/domain (input/, corpus/redteam-vectors.jsonl, traceability-map.json). - ci-harness-gate.sh: export CASAN_TESTS_DIR/CASAN_TEST_MANIFEST/CASAN_BUNDLE_ROOT so the integrity Python resolves via the harness root regardless of invocation path; ROOT=CASAN_APP_ROOT. - Remove the domain compat symlinks from packages/casan-harness/security (redteam-corpus, redteam-vectors, benign-corpus) — packages now holds NO domain data. Both invocation paths pass (compat facade still present): .specify/... and packages/... Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
73 lines
3.5 KiB
Bash
73 lines
3.5 KiB
Bash
#!/usr/bin/env bash
|
|
set -uo pipefail
|
|
|
|
# CASAN Plan-16 SEC-14 (M-03 / SC-03) — model-digest env-override is NOT trusted
|
|
# in enforced mode.
|
|
#
|
|
# current_digest() honored CASAN_MODEL_DIGEST unconditionally, so an attacker who
|
|
# swapped the local model could also set CASAN_MODEL_DIGEST to the pinned value
|
|
# and pass verification. Under CASAN_PROFILE=prod (or CASAN_MODEL_DIGEST_STRICT=1)
|
|
# the override is ignored and the digest must come from the live model backend.
|
|
# This proves:
|
|
# * dev/CI: override still honored (pin + verify deterministic) — regression,
|
|
# * dev/CI: a swapped override is a MISMATCH (control still works),
|
|
# * prod: a forged override equal to the pin is NOT accepted (fail-closed),
|
|
# * strict flag: same enforced behavior without a full prod profile.
|
|
#
|
|
# Deterministic; hermetic (temp pin file; live backend pointed at a dead port).
|
|
|
|
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
|
|
source "$SCRIPT_DIR/../scripts/bash/casan-paths.sh"
|
|
PROJECT_ROOT="$CASAN_APP_ROOT"
|
|
MDC="$CASAN_HARNESS_ROOT/scripts/bash/model-digest-check.sh"
|
|
WORK="$(mktemp -d)"
|
|
trap 'rm -rf "$WORK"' EXIT
|
|
|
|
PIN="$WORK/model-digest.pin"
|
|
DEAD_OLLAMA="127.0.0.1:1" # unreachable → live digest fetch fails deterministically
|
|
|
|
PASS=0; FAIL=0
|
|
pass() { echo "PASS: $1"; PASS=$((PASS + 1)); }
|
|
fail() { echo "FAIL: $1"; FAIL=$((FAIL + 1)); }
|
|
|
|
echo "===== Plan-16 SEC-14: model-digest env-override not trusted in enforced mode ====="
|
|
|
|
# Setup: pin an approved digest in dev mode (override honored).
|
|
CASAN_MODEL_DIGEST_PIN="$PIN" CASAN_MODEL_DIGEST="digest-approved" \
|
|
bash "$MDC" pin ornith:9b >/dev/null 2>&1
|
|
|
|
# 1) dev/CI regression: matching override verifies OK.
|
|
rc=$(set +e; CASAN_MODEL_DIGEST_PIN="$PIN" CASAN_MODEL_DIGEST="digest-approved" \
|
|
bash "$MDC" verify ornith:9b >/dev/null 2>&1; echo $?)
|
|
[[ "$rc" -eq 0 ]] && pass "dev: matching override verifies OK (regression)" \
|
|
|| fail "dev: matching override should verify OK (rc=$rc)"
|
|
|
|
# 2) dev/CI regression: swapped override is a MISMATCH (block).
|
|
rc=$(set +e; CASAN_MODEL_DIGEST_PIN="$PIN" CASAN_MODEL_DIGEST="digest-swapped" \
|
|
bash "$MDC" verify ornith:9b >/dev/null 2>&1; echo $?)
|
|
[[ "$rc" -eq 2 ]] && pass "dev: swapped override detected as MISMATCH (rc=2)" \
|
|
|| fail "dev: swapped override should MISMATCH (rc=$rc)"
|
|
|
|
# 3) SEC-14 core (prod): a FORGED override equal to the pin must NOT be accepted.
|
|
# Override is ignored; live backend is unreachable → cannot verify (rc=3), never OK.
|
|
err="$WORK/prod.err"
|
|
rc=$(set +e; CASAN_PROFILE=prod OLLAMA_HOST="$DEAD_OLLAMA" \
|
|
CASAN_MODEL_DIGEST_PIN="$PIN" CASAN_MODEL_DIGEST="digest-approved" \
|
|
bash "$MDC" verify ornith:9b >/dev/null 2>"$err"; echo $?)
|
|
[[ "$rc" -ne 0 ]] && pass "prod: forged override not accepted as OK (rc=$rc)" \
|
|
|| fail "prod: forged override was accepted (rc=0) — env override still trusted"
|
|
grep -q "MODEL_DIGEST_OVERRIDE_IGNORED" "$err" \
|
|
&& pass "prod: override explicitly ignored (MODEL_DIGEST_OVERRIDE_IGNORED)" \
|
|
|| fail "prod: override was not ignored (no OVERRIDE_IGNORED marker)"
|
|
|
|
# 4) strict flag: same enforced behavior without a full prod profile.
|
|
rc=$(set +e; CASAN_MODEL_DIGEST_STRICT=1 OLLAMA_HOST="$DEAD_OLLAMA" \
|
|
CASAN_MODEL_DIGEST_PIN="$PIN" CASAN_MODEL_DIGEST="digest-approved" \
|
|
bash "$MDC" verify ornith:9b >/dev/null 2>&1; echo $?)
|
|
[[ "$rc" -ne 0 ]] && pass "strict: forged override not accepted (rc=$rc)" \
|
|
|| fail "strict: forged override accepted (rc=0)"
|
|
|
|
echo ""
|
|
echo "===== SEC-14 SUMMARY: PASS=$PASS FAIL=$FAIL ====="
|
|
[[ "$FAIL" -eq 0 ]] || exit 1
|