Skip to content

chore(toolkit-docs): add missing summaries for 5 toolkits#929

Merged
jottakka merged 2 commits intomainfrom
chore/add-missing-toolkit-summaries
Apr 20, 2026
Merged

chore(toolkit-docs): add missing summaries for 5 toolkits#929
jottakka merged 2 commits intomainfrom
chore/add-missing-toolkit-summaries

Conversation

@jottakka
Copy link
Copy Markdown
Contributor

@jottakka jottakka commented Apr 17, 2026

Summary

  • Adds a hand-written summary for 5 toolkits that have always shipped with summary: null because LLM generation was skipped or failed on their first auto-update run: posthog, granola, microsoftoutlookcalendar, microsoftoutlookmail, zohocreatorapi.
  • Each summary is derived from the toolkit's actual tool list, auth, and secrets in toolkit-docs-generator/data/toolkits/<id>.json. Format matches what LlmToolkitSummaryGenerator produces (60–140 words, Capabilities bullets, OAuth / Secrets sections).

Why

Without a summary the rendered toolkit page (app/_components/toolkit-docs/components/toolkit-page.tsx:647) omits the prose overview block. Readers land on a page with just the header + tool list and no narrative orientation.

Per-toolkit notes

Toolkit Notes
posthog API key auth; summary calls out dashboards, insights, experiments, feature flags, surveys, errors, ad-hoc HogQL.
granola API key auth; small toolkit (list meetings, get meeting, get transcript) — short but complete bullet set.
microsoftoutlookcalendar OAuth (microsoft) — replacement toolkit for the deprecated outlookcalendar (see #874).
microsoftoutlookmail OAuth (microsoft) — replacement toolkit for the deprecated outlookmail (see #874).
zohocreatorapi OAuth (zoho) with ZOHO_SERVER_URL secret for regional domain selection.

Why separate from #927 / #928

  • #927 is the code fix that prevents summaries from being wiped on future runs.
  • #928 restores summaries that were wiped from previously populated toolkits.
  • This PR is net-new content for toolkits that never had one. Keeping it separate lets reviewers evaluate truthfulness per toolkit without re-reading restoration diffs.

Test plan

  • Word count 60–140 for each summary.
  • OAuth scopes listed in summary match .auth.allScopes in the JSON.
  • Secrets section only mentions secrets actually present in the toolkit.
  • Confirmed microsoftoutlookcalendar/microsoftoutlookmail are not in excluded-toolkits.txt or ignored-toolkits.txt.
  • Preview the rendered overview on a Vercel deploy (e.g. /en/mcp-servers/productivity/posthog).

Refs #926
🤖 Generated with Claude Code


Note

Low Risk
Low risk documentation-only change: adds summary strings to existing toolkit JSON metadata without altering tool definitions, auth, or runtime code paths.

Overview
Adds summary fields to five toolkit definition JSONs (granola, microsoftoutlookcalendar, microsoftoutlookmail, posthog, zohocreatorapi), providing a prose overview plus Capabilities, and where applicable OAuth/Secrets sections.

Also normalizes the JSON file endings by keeping generatedAt and appending the new summary field with proper trailing comma/newline so the metadata is valid and complete.

Reviewed by Cursor Bugbot for commit ac753d2. Bugbot is set up for automated code reviews on this repo. Configure here.

posthog, granola, microsoftoutlookcalendar, microsoftoutlookmail, and
zohocreatorapi never received a summary — LLM generation was either
skipped or failed on the first auto-update run and the null state has
persisted ever since (see #926 for the underlying regression).

Each summary is written from the actual tool list in the toolkit JSON,
matching the structure the LLM prompt targets (60–140 words, Capabilities
bullets, OAuth / Secrets sections) so the rendered overview looks
consistent with LLM-generated peers.

Refs #926

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@vercel
Copy link
Copy Markdown

vercel bot commented Apr 17, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
docs Ready Ready Preview, Comment Apr 18, 2026 6:32pm

Request Review

…cade auth provider docs

Same follow-up as #928 applied to the five toolkits with brand-new
summaries. Each OAuth section now states the provider and links to
/en/references/auth-providers/<provider> instead of enumerating scopes.
Secrets sections were also tightened with per-secret provenance and a
link to the Arcade secret setup guide.

Refs #926

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
jottakka added a commit that referenced this pull request Apr 18, 2026
…scopes

Per follow-up on PRs #928 and #929, the OAuth section of each summary
should name the provider and link to the Arcade per-provider auth docs
rather than enumerate scopes. Scopes already live on the provider
reference page and repeating them in toolkit summaries creates drift
every time a provider page updates.

Changes:
- Add ARCADE_AUTH_PROVIDERS_BASE_URL constant alongside the existing
  Arcade secret URLs in secret-coherence.ts.
- Rewrite the OAuth bullet in toolkit-summary-generator.ts's prompt to
  require a link to {base}/<providerId> and explicitly forbid listing
  scopes.
- Drop scopes from formatAuth's prompt payload so the model has no
  stray scope list to fall back on.
- README: note the no-scopes-in-summary rule and point to the provider
  reference pages as the source of truth.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@jottakka jottakka marked this pull request as ready for review April 18, 2026 18:40
@jottakka jottakka requested a review from a team April 18, 2026 22:13
@jottakka jottakka merged commit a0fe256 into main Apr 20, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants