Add model discovery integration tests without managed config - #662
Open
andy-xu-db wants to merge 1 commit into
Open
andy-xu-db wants to merge 1 commit into
andy-xu-db wants to merge 1 commit into
Conversation
andy-xu-db
force-pushed
the
andy/model-discovery-integration-unmanaged
branch
from
September 16, 2026 15:02
5204d14 to
9751ad8
Compare
andy-xu-db
changed the base branch from
main
to
codex/model-discovery-test-stack
September 16, 2026 15:02
andy-xu-db
force-pushed
the
codex/model-discovery-test-stack
branch
from
September 16, 2026 18:32
d85847c to
2c0b3df
Compare
andy-xu-db
force-pushed
the
andy/model-discovery-integration-unmanaged
branch
from
September 16, 2026 18:32
9751ad8 to
88b4d6f
Compare
andy-xu-db
changed the base branch from
codex/model-discovery-test-stack
to
andy/model-discovery-integration-tests
September 16, 2026 20:06
andy-xu-db
force-pushed
the
andy/model-discovery-integration-unmanaged
branch
3 times, most recently
from
September 17, 2026 20:03
e907761 to
e4a7d5c
Compare
andy-xu-db
force-pushed
the
andy/model-discovery-integration-tests
branch
from
September 17, 2026 21:37
8cc5eb8 to
ecd7c40
Compare
andy-xu-db
force-pushed
the
andy/model-discovery-integration-unmanaged
branch
from
September 17, 2026 21:37
e4a7d5c to
5404b69
Compare
lilly-luo
approved these changes
Sep 17, 2026
andy-xu-db
force-pushed
the
andy/model-discovery-integration-unmanaged
branch
from
September 17, 2026 22:47
5404b69 to
debbbfb
Compare
andy-xu-db
force-pushed
the
andy/model-discovery-integration-unmanaged
branch
from
September 17, 2026 22:54
debbbfb to
6fb6e7f
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Cases
Each test function includes its Tests-table case number (
test_case_13_...throughtest_case_24_...). Together with #655, the stack has 44 numbered discovery executions.Managed workspace coverage inherited from #655
This branch is rebased on #655 head
76d42794a3061efe256f32dc3f5a6b5d7a644168. It therefore inherits the one-live-fetch-per-agent managed-config fixtures and their dedicated ca-central-1 MPS targets:main.default.ci_e2e_anthropic_mpsmain.default.ci_e2e_openai_mpsBoth managed-config lanes pass on CI run 35284318193.
Live result
Run 35284318193 exercised Claude Code 2.1.268 and Codex 0.154.0 against the integration workspace.
These failures are intentionally reported rather than weakened or skipped; they demonstrate the current client/catalog gaps the new tests cover. A separate Claude agent-launch shard also fails because
system.ai.claude-opus-5rejects Claude Code'sadvisor_20260301tool type.Stack
andy/model-discovery-integration-tests), which contains managed-config Cases 1–12.codex/model-discovery-test-stack, rebased on currentmain.Verification
6fb6e7f9fb4ef6b25d15e771dee8d24eb806e6a6.tests/test_integration_contract.py: 5 passed.