2.6 KiB
2.6 KiB
Quickstart — Spec 116 Baseline Drift Engine
This quickstart is for developers validating the behavior locally.
Prerequisites
- Sail up:
vendor/bin/sail up -d - Install deps (if needed):
vendor/bin/sail composer install - Run migrations:
vendor/bin/sail artisan migrate
Workflow
1) Run an inventory sync (establish coverage)
- Trigger inventory sync for a tenant using the existing UI/command for inventory sync.
- Verify the latest inventory sync
operation_runs.contextcontains a coverage payload:inventory.coverage.policy_types.{type}.status = succeeded|failed- (optionally)
inventory.coverage.foundation_types.{type}.status = ...
Expected:
- If some types fail or are not processed, the coverage payload reflects that.
2) Capture a baseline snapshot
- Use the Baseline Profile UI to capture a snapshot.
Expected:
- Snapshot items store
baseline_hashcomputed from the Inventory Meta Contract. - Snapshot identity/dedupe follows existing snapshot identity rules, but content hashes come from the explicit contract.
3) Compare baseline to tenant
- Trigger “Compare now” from the Baseline Compare landing page.
Expected:
- Compare uses latest successful baseline snapshot by default (or explicit snapshot selection if provided).
- Compare uses the latest inventory sync run coverage:
- For uncovered policy types, no findings are emitted.
- OperationRun outcome becomes “completed with warnings” (partial) when uncovered types exist.
summary_counts.errors_recorded = count(uncovered_types).- Edge case: if effective scope expands to zero types, outcome is still partial (warnings) and
summary_counts.errors_recorded = 1.
- Findings identity:
- stable
recurrence_keyusesbaseline_snapshot_idand does not include baseline/current hashes. fingerprint == recurrence_key.scope_keyremains profile-scoped (baseline_profile:{id}).
- stable
4) Validate UI counts
- Verify baseline compare stats remain grouped by the profile scope (
scope_key = baseline_profile:{id}), consistent with research.md Decision #2. - Validate that re-capturing (new snapshot) creates a new set of findings due to snapshot-scoped identity (recurrence key includes
baseline_snapshot_id).
Minimal smoke test checklist
- Compare with full coverage: produces correct findings; outcome success.
- Compare with partial coverage: produces findings only for covered types; outcome partial; uncovered types listed in context.
- Re-run compare with no changes: no new findings;
times_seenincrements. - Re-capture snapshot and compare: findings identity changes (snapshot-scoped).