Skip to content

Add project-local CLI routing for skills-based setup#159

Draft
hmishra2250 wants to merge 3 commits into
hm/router-card-state-servicefrom
hm/router-card-cli-state-experiment
Draft

Add project-local CLI routing for skills-based setup#159
hmishra2250 wants to merge 3 commits into
hm/router-card-state-servicefrom
hm/router-card-cli-state-experiment

Conversation

@hmishra2250

@hmishra2250 hmishra2250 commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add the project-local CLI-capability router card used by the powered P2 study
  • install it by default when firecrawl init completes an eligible project state: authenticated CLI, installed skills, explicit Claude/Codex agent, and explicit project path
  • provide --no-router-card as a per-run opt-out and --remove-router-card as a bounded removal command
  • preserve existing user context through a delimited, idempotent managed block

Exact journey

Default-on eligible setup:

firecrawl init --yes --agent claude --project /path/to/project
# or
firecrawl init --yes --agent codex --project /path/to/project

This writes only the project-local native context file (CLAUDE.md for Claude, AGENTS.md for Codex). It does not write a global instruction file.

Opt out for one run:

firecrawl init --yes --agent claude --project /path/to/project --no-router-card

Remove only the managed block without rerunning onboarding:

firecrawl init --agent claude --project /path/to/project --remove-router-card

Package installation alone, login/logout, unsupported agents, missing authentication, skipped skills, and commands without an explicit project do not write a card.

Decision-grade evidence

P2 ran 384 immutable Convex-backed traces across Claude Sonnet 5 and Codex Terra at 30-way E2B concurrency.

  • card with native web available: 50% → 100%, +50pp pooled, Holm-adjusted p ≈ 0.000003
  • Claude: 0% → 100%, +100pp; Codex: 100% → 100%, ceiling/null
  • safety: 0/96 treatment-only regressions; simultaneous upper bound 4.18%, passes the preregistered <5% gate
  • native-web suppression was independently rejected: 21/96 regressions and no incremental benefit once the card was present

Recommendation: ship this project-local card for the CLI + skills state and leave native web tools available. The result transfers by machine-state equivalence, not by command-name similarity.

Aggregate decision artifact: Convex kg2e1vb0xg4k95v70wb2ahzn018arvnv. Raw traces and receipts are not stored in Git.

Scope

This draft does not write global CLAUDE.md/AGENTS.md, mutate project files during package install or login/logout, or suppress native web tools. Additional onboarding aliases should adopt the card only after a small state-parity canary.

Verification

  • pnpm test (401 passed)
  • pnpm run build
  • git diff --check
  • GitHub checks run on Ubuntu, macOS, and Windows

@hmishra2250 hmishra2250 changed the title Add a project-local CLI router experiment Add project-local CLI routing for skills-based setup Jul 18, 2026
@hmishra2250
hmishra2250 force-pushed the hm/router-card-cli-state-experiment branch from ac71610 to 2b7f539 Compare July 18, 2026 12:00
@hmishra2250
hmishra2250 changed the base branch from hm/router-card-launch-product to hm/router-card-state-service July 18, 2026 12:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant