thanhnvandClaude Opus 4.8
d54d7f5f4c
Move the harness-config files out of the mixed .specify/level5 and .specify/agentops
dirs (which also hold governance/domain/state) into packages/casan-harness, leaving a
per-file compat symlink at each old path. Runtime state and governance stay in place.
Moved (+ .specify symlink each):
level5: drift-policy.yaml kpi-schema.yaml model-fallback.yaml tool-registry.yaml
harness-package.json project-registry.json provider-usage-sample.json
agentops: alerts.yaml hallucination-tracking.yaml metrics.yaml rate-limits.yaml tracking.yaml
top: init-options.json
Stays in .specify: level5/central-governance (governance), level5/golden-runs (domain,
Phase 3), agentops/alerts.log (state), traceability-map.json (domain, Phase 3).
Full gate: PASS=64 FAIL=0 SKIP=3 (CASAN_CI_STEP_TIMEOUT_SEC=1200).
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
87 lines
1.5 KiB
YAML
87 lines
1.5 KiB
YAML
version: 1.0
|
|
description: AgentOps Alert Rules
|
|
|
|
alerts:
|
|
|
|
- id: ALERT-001
|
|
name: High Latency
|
|
condition: latency_ms > 5000
|
|
severity: medium
|
|
action:
|
|
- log
|
|
- notify
|
|
|
|
- id: ALERT-002
|
|
name: High Retry
|
|
condition: retry_count > 2
|
|
severity: medium
|
|
action:
|
|
- log
|
|
- notify
|
|
|
|
- id: ALERT-003
|
|
name: Failure Detected
|
|
condition: status == "failed"
|
|
severity: high
|
|
action:
|
|
- log
|
|
- notify
|
|
- escalate
|
|
|
|
- id: ALERT-004
|
|
name: High Cost Spike
|
|
condition: cost_estimate > 0.05
|
|
severity: medium
|
|
action:
|
|
- log
|
|
|
|
- id: ALERT-005
|
|
name: Hallucination Risk
|
|
condition: output contains ("maybe" or "might be incorrect")
|
|
severity: low
|
|
action:
|
|
- log
|
|
- flag
|
|
|
|
- id: ALERT-006
|
|
name: Token Overuse
|
|
condition: total_tokens > 5000
|
|
severity: medium
|
|
action:
|
|
- log
|
|
- notify
|
|
|
|
notification:
|
|
|
|
channels:
|
|
|
|
- type: log
|
|
path: ".specify/agentops/alerts.log"
|
|
|
|
- type: console
|
|
enabled: true
|
|
|
|
# future integration
|
|
# - type: slack
|
|
# webhook: "https://hooks.slack.com/..."
|
|
|
|
escalation:
|
|
|
|
enabled: true
|
|
|
|
rules:
|
|
- severity: high
|
|
action: immediate_alert
|
|
|
|
- severity: medium
|
|
action: batched_alert
|
|
|
|
- severity: low
|
|
action: log_only
|
|
|
|
level4_gate:
|
|
alert_log_must_exist: true
|
|
failed_step_must_emit_alert: true
|
|
retry_threshold_must_emit_alert: true
|
|
cost_spike_must_emit_alert: true
|