cutover-evidence-system
Repo-canonical workflow for preflight reruns, normalized compare output, master-pack generation, a...
Document Metadata
- title: Cutover Evidence System
- description: Repo-canonical workflow for preflight reruns, normalized compare output, master-pack generation, and post-cutover reuse.
- status: evolving
- lastUpdated: "2026-04-19 13:47 ET (America/New_York)"
- owner: Engineering
Cutover Evidence System Use the cutover evidence system to keep pre-cutover and post-cutover p
Cutover Evidence System
Use the cutover evidence system to keep pre-cutover and post-cutover proof in one repo-canonical structure.
Goals
- Normalize the current pre-cutover baseline into one trustworthy packet.
- Re-run the automated cutover checks from repo-level commands instead of reconstructing the workflow from multiple docs.
- Keep Maggie-owned manual evidence explicit without turning manual screenshots into the storage layer.
- Reuse the same compare schema after cutover so Dawn, pre-cutover headless, and final-domain post-cutover results can live in one CSV.
Commands
pnpm cutover:preflight- Runs the automated cutover stack, captures command output, and writes a timestamped run directory under
docs/evidence/active/cutover-runs/<timestamp>/. - Output contract:
run-manifest.jsonsummary.mdsummary.jsoncompare.csv
- Runs the automated cutover stack, captures command output, and writes a timestamped run directory under
pnpm cutover:compare- Writes a normalized compare CSV into the current master-pack date directory.
- Uses the latest cutover run automatically when one exists.
pnpm cutover:master-pack- Generates the canonical current baseline packet under
docs/evidence/active/cutover-master/<date>/. - Output contract:
master-pack.mdmaster-pack.jsoncompare.csv
- Generates the canonical current baseline packet under
Default Command Coverage
The automated preflight includes:
pnpm buildpnpm test:unitpnpm test:e2epnpm seo:auditpnpm parity:auditpnpm shopify:audit:analytics-baselinepnpm shopify:audit:channel-readinesspnpm agent:catalog:auditpnpm growth:reports:cyclewhen likely Google credentials are present
Important Flags
pnpm cutover:preflight -- --dry-run- Writes the run structure without executing commands.
pnpm cutover:preflight -- --base-url https://example.com- Targets a different URL for
seo:audit,parity:audit, channel readiness, and Playwright base-url wiring.
- Targets a different URL for
pnpm cutover:preflight -- --state final_domain_post- Uses the same output contract for a post-cutover final-domain run.
pnpm cutover:preflight -- --skip-e2e- Skips Playwright when the runtime is not appropriate.
pnpm cutover:preflight -- --skip-growth- Skips the
1085growth reporting cycle even if credentials appear available.
- Skips the
Canonical Storage Model
- Source of truth:
- repo artifacts under
docs/evidence/
- repo artifacts under
- Current timestamped automated runs:
docs/evidence/active/cutover-runs/<timestamp>/
- Current canonical baseline packet:
docs/evidence/active/cutover-master/<date>/master-pack.md
- Optional downstream spreadsheet view:
- import
compare.csvinto Google Sheets if you want a live operator surface
- import
Do not use Sheets as the evidence store.
Maggie-Owned Manual Gates
The automation does not replace the true manual blocker tail. Maggie still owns:
- Review the programmatic GSC supplement and decide whether one Page Indexing export is still required.
- If required, capture the Page Indexing export.
- Capture Shopify Analytics
404s. - Capture Shopify Analytics
Web Performance. - Confirm the
1045CMS keep-vs-move split and empty defer bucket. - Run collaborative walkthrough/sign-off for
1075,1076, and1077. - Approve launch-window timing and go/no-go readiness.
The system keeps these manual blockers visible in the generated master pack rather than burying them inside stale packet prose.
Post-Cutover Reuse
- Run
pnpm cutover:preflight -- --state final_domain_post --base-url https://www.rockpaperscisso.rsonce the final domain is live. - Regenerate
pnpm cutover:master-pack. - Import the refreshed
compare.csvinto Google Sheets if you want side-by-side operator review. - Feed new deltas back into the existing
1077remediation queue instead of creating a second comparison system.
Provenance
- Source file:
docs/development/cutover-evidence-system.md - Source URL: https://github.com/maggielerman/shopify-headless/blob/main/docs/development/cutover-evidence-system.md