Testing

The four test surfaces and how to run each one.

Testing

CodeVetter has four test surfaces. CI runs all of them in .github/workflows/ci.yml.

1. Frontend unit tests (Node `node:test` + `tsx`)

cd apps/desktop
pnpm test:unit                                   # all src/**/*.test.ts
pnpm test:review-proof                           # review-proof only
pnpm test:agent-fix-packet                       # agent-fix-packet only
pnpm test:synthetic-qa                           # synthetic-qa fixtures
pnpm test:intent-debugger                        # intent-debugger report
pnpm test:coverage                               # c8 coverage

Runner is the built-in Node test runner via tsx — no Jest/Vitest. Add a *.test.ts next to the module it tests.

2. Playwright e2e (chromium)

cd apps/desktop
npx playwright install chromium   # first time only
pnpm test                         # full suite (starts Vite dev server)
pnpm test:e2e:ui                  # interactive UI mode
npx playwright test tests/e2e/smoke.spec.ts
npx playwright test -g "App loads without crashing"

Config: apps/desktop/playwright.config.ts
Browser: chromium only (single CI project)
Base URL: http://localhost:1420 (the Vite dev server)
Tests live in apps/desktop/tests/

3. Rust tests (`cargo test`)

cd apps/desktop/src-tauri
cargo test                                  # all unit + integration tests
cargo test mcp::                            # MCP protocol + safety tests
cargo test --release --test mcp_stdio       # release-mode stdio lifecycle
cargo test --release perf_bench -- --ignored --nocapture --test-threads=1   # benches

~385 Rust tests + the MCP binary + real offline stdio integration.
Benches are #[ignore]d so they never gate normal cargo test.
CV_ENFORCE_GRAPH_BUDGETS=1 makes the real-repo structural bench enforce the release envelope — see performance.md.

4. Benchmark tests (Node `node --test`)

pnpm test:benchmark    # scripts/run-catch-rate-benchmark.test.mjs
pnpm bench:public      # 27 public cases, catch-rate/precision/F1

See benchmark.md.

Native Agent Island

On macOS, the Apple-framework-only helper has a framework-independent protocol self-test and focused Rust coverage:

cd apps/desktop
pnpm test:agent-island
cargo test --manifest-path src-tauri/Cargo.toml native_agent_island --lib
cargo test --manifest-path src-tauri/Cargo.toml agent_stream --lib
cargo test --manifest-path src-tauri/Cargo.toml claude_hook --lib

Architecture, privacy boundaries, and remaining release qualification are in native-agent-island.md.

CI order

ci.yml runs, in order: lint → typecheck → unit tests → MCP sidecar build smoke → desktop build → MCP protocol/safety tests → MCP release-mode stdio lifecycle. A failure stops the pipeline.

Strictness gates

Biome is the linter/formatter (biome.json, root pnpm lint).
tsc --noEmit typecheck in apps/desktop.
Clippy zero-warning in release qualification.
Bundle budgets via apps/desktop/scripts/bundle-budget.mjs.
OpenSpec strict validation for specs under openspec/.
Pre-commit (.husky/pre-commit): lint-staged runs biome check --write on staged apps/desktop/src/**/*.{ts,tsx}.
Pre-push (.husky/pre-push): runs pnpm lint + a secret-pattern scan over tracked files (with anchored exclusions for fixtures, benchmarks, and secret_policy.rs).

Adding tests

Pure logic → *.test.ts next to the module, Node test runner.
UI flow → tests/e2e/*.spec.ts, Playwright.
Rust behavior → #[test] in the module or tests/ integration target.
Benchmark regression → extend scripts/run-catch-rate-benchmark.test.mjs or add a #[ignore]d Rust bench in perf_bench.rs.