Skip to content

docs(cli): trim SKILL.md and emphasize CLI-first lookup#1286

Open
stefanjudis wants to merge 1 commit intomainfrom
trim-down-actual-skill-file
Open

docs(cli): trim SKILL.md and emphasize CLI-first lookup#1286
stefanjudis wants to merge 1 commit intomainfrom
trim-down-actual-skill-file

Conversation

@stefanjudis
Copy link
Copy Markdown
Collaborator

@stefanjudis stefanjudis commented Apr 10, 2026

Affected Components

  • CLI
  • Create CLI
  • Test
  • Docs
  • Examples
  • Other

Notes for the Reviewer

Trims the always-loaded SKILL.md so agents lean on npx checkly skills <action> for progressive disclosure instead of loading every sub-reference upfront.

  • Removes the per-reference sub-command listings (#### npx checkly skills <action> <ref>) from SKILL.md.
  • Rewrites the intro with a Required: directive telling agents to run npx checkly skills first, since the CLI is the source of truth and actions change between releases.
  • Extends the skill description to mention account plan, entitlements, and feature limits.
  • Drops the now-unused inner references loop from generateSkillCommands() in prepare-ai-context.ts and regenerates skills/checkly/SKILL.md to match.

Tradeoff worth flagging: agents reading only SKILL.md no longer see hints like configure api-checks directly — they have to run npx checkly skills configure to discover sub-references. Intentional, since we want to serve as much as possible from the CLI.

Remove per-reference sub-command listings from SKILL.md so agents
lean on `npx checkly skills <action>` for progressive disclosure
instead of loading everything upfront.
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR reduces the always-loaded Checkly agent skill context and shifts detailed guidance to on-demand CLI lookups, making npx checkly skills the primary source of truth across releases.

Changes:

  • Updates the skill description and replaces the intro with a “Required” CLI-first directive.
  • Removes per-reference sub-command listings from the published SKILL.md to enforce progressive disclosure.
  • Simplifies generateSkillCommands() by removing the inner references loop so generated output matches the trimmed docs.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated no comments.

File Description
skills/checkly/SKILL.md Trims always-loaded skill content and updates intro/description to direct agents to npx checkly skills first.
packages/cli/src/ai-context/skill.md Updates the SKILL template to match the new CLI-first guidance and regenerated output.
packages/cli/scripts/prepare-ai-context.ts Removes reference expansion from SKILL command generation while leaving reference generation for npx checkly skills <action> intact.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@sorccu
Copy link
Copy Markdown
Member

sorccu commented Apr 13, 2026

@stefanjudis If you resolve the conflicts and rebase the branch, tests should pass again. Following that we can merge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants