Skip to content

Document scrape freshness and cache metadata#156

Draft
hmishra2250 wants to merge 2 commits into
mainfrom
agent/cache-provenance-phase1-20260714
Draft

Document scrape freshness and cache metadata#156
hmishra2250 wants to merge 2 commits into
mainfrom
agent/cache-provenance-phase1-20260714

Conversation

@hmishra2250

@hmishra2250 hmishra2250 commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Summary

  • document existing firecrawl scrape --max-age and --json in the scrape skill
  • add fresh-retrieval/cache provenance guidance for final verification scrapes
  • add job/ATS liveness guidance for agent workflows

Root cause / behavior change

CLI agents could already pass --max-age, but the skill did not teach when to request a fresh retrieval path or how to inspect cache provenance. The scrape skill now makes the final-verification pattern explicit without treating retrieval freshness as source-object liveness.

Validation

  • scoped grep for --max-age, --json, metadata.cache, ATS/liveness guidance ✅
  • git diff --check
  • GitHub Actions ✅: tests, macOS/Linux/Windows binary tests, and macOS/Linux/Windows npm package smoke tests

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant