Skip to content

fix(audit): union providers for shared model ids in the gap audit#823

Open
Erin McNulty (erin2722) wants to merge 2 commits into
mainfrom
fix/audit-shared-id-provider-union
Open

fix(audit): union providers for shared model ids in the gap audit#823
Erin McNulty (erin2722) wants to merge 2 commits into
mainfrom
fix/audit-shared-id-provider-union

Conversation

@erin2722

Copy link
Copy Markdown
Contributor

The gap audit worked provider-by-provider and attributed a shared owner/model id (e.g. zai-org/GLM-5.2, served by both baseten and together) to a single provider, then deduped the rest — so zai-org/GLM-5.1 was together-only despite baseten serving it, and GLM-5.2 was filed together-only (#819) even though baseten serves it too.

Instruct the audit to: (1) for a shared id, check every inventory provider that serves that exact id and report the full available_providers set; (2) treat a provider that serves an already-cataloged id but is missing from its available_providers as a fileable provider-mapping gap (not suppressed by the duplicate check); and (3) report only the model_list.json available_providers set — index.ts may be intentionally narrower (a model pinned to one provider for pricing), so a difference there is not a gap.

This fixes the source (model_list available_providers) where the human/bot can judge intent, rather than auto-rewriting index.ts (which would clobber intentional single-provider mappings like openai/gpt-oss-20b's groq-only entry).

The gap audit worked provider-by-provider and attributed a shared owner/model
id (e.g. zai-org/GLM-5.2, served by both baseten and together) to a single
provider, then deduped the rest — so zai-org/GLM-5.1 was together-only despite
baseten serving it, and GLM-5.2 was filed together-only (#819) even though
baseten serves it too.

Instruct the audit to: (1) for a shared id, check every inventory provider that
serves that exact id and report the full available_providers set; (2) treat a
provider that serves an already-cataloged id but is missing from its
available_providers as a fileable provider-mapping gap (not suppressed by the
duplicate check); and (3) report only the model_list.json available_providers
set — index.ts may be intentionally narrower (a model pinned to one provider
for pricing), so a difference there is not a gap.

This fixes the source (model_list available_providers) where the human/bot can
judge intent, rather than auto-rewriting index.ts (which would clobber
intentional single-provider mappings like openai/gpt-oss-20b's groq-only entry).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@vercel

vercel Bot commented Jun 18, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
ai-proxy Ready Ready Preview, Comment Jun 18, 2026 5:31pm

Request Review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 926a1e1798

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "Codex (@codex) address that feedback".

Comment thread .github/workflows/agent-provider-model-sync.yaml Outdated
…existing ids

A provider-mapping gap filed for an id already in model_list.json must set
kind: "stale_metadata" in the fix-bot-issue metadata block. fix_bot_issue.ts
defaults absent/missing_model issues to the add path and closes them as
already_present without applying changes when the named models exist, so a
provider-union gap filed as missing_model would be silently dropped without
updating available_providers.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants