Skip to content

feat(bench): add terminal-bench supervisor arm#491

Merged
drewstone merged 1 commit into
mainfrom
feat/tb-supervisor-ab-arm-clean
Jul 7, 2026
Merged

feat(bench): add terminal-bench supervisor arm#491
drewstone merged 1 commit into
mainfrom
feat/tb-supervisor-ab-arm-clean

Conversation

@drewstone

Copy link
Copy Markdown
Contributor

Summary

  • add a Terminal-Bench supervisor arm that mounts the coordination MCP into opencode
  • run spawned workers inside the same graded container through the tb-container executor
  • add repo-relative smoke/run scripts and ignore local A/B run output
  • fail loudly if supervisor orchestration cannot start, instead of silently falling back to the raw arm

Verification

  • python3 -m py_compile bench/tb_agents/opencode_supervisor_agent.py
  • bash -n bench/run-ab-arm.sh bench/smoke-sidecar.sh
  • bash bench/smoke-sidecar.sh (Docker smoke: tools/list, spawn_agent, await_event, same-container worker receipt)
  • env -u TB_TARGET_CONTAINER pnpm exec tsx bench/src/tb-supervisor-sidecar.mts exits 2
  • pnpm run typecheck
  • pnpm run build
  • pnpm test: 127 files passed, 1,254 tests passed, 2 skipped
  • pnpm run verify:package
  • git merge-tree --write-tree origin/main HEAD

@tangletools tangletools left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Auto-approved drewstone PR — 3cac8968

This PR was opened by the trusted drewstone account.
The full PR reviewer audit still runs separately and will publish findings if it detects issues.

tangletools · auto-approval · reason: drewstone_author · 2026-07-07T23:53:23Z

@drewstone drewstone merged commit 8923777 into main Jul 7, 2026
1 check passed
@drewstone drewstone deleted the feat/tb-supervisor-ab-arm-clean branch July 8, 2026 00:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants