Skip to content

Add Benchmarking Orchestration#275

Open
Max Smythe (maxsmythe) wants to merge 8 commits into
agent-substrate:mainfrom
maxsmythe:headless-benchmarking-phased-commits
Open

Add Benchmarking Orchestration#275
Max Smythe (maxsmythe) wants to merge 8 commits into
agent-substrate:mainfrom
maxsmythe:headless-benchmarking-phased-commits

Conversation

@maxsmythe

Copy link
Copy Markdown
Collaborator

The main thrust of this PR is to add early automated benchmarking Orchestration code.

Apologies for the large PR, I've split it into coherent commits.

  • "fix imports; overwrite RAM buffer; add status metric": is Add baseline glutton #243 (is synced to the current state of that PR, so it's possible to just merge this one)

  • "add http support to glutton" : adds http support to the glutton and documents its proto commands

  • "streamline locust install + fix performance bugs": makes installing locust for ad-hoc tests a one-liner and fixes the fact that Python's gRPC client interferes with greenlets by default, causing deadlocks in the test runner

  • "verify licenses of Python dependencies": figured it would be good to guard against AGPL, etc.

  • "add automated benchmarking Orchestration": creates an orchestrator that lives in its own cluster, running load tests on target clusters (prow-lite until we have more defined infrastructure)

@maxsmythe Max Smythe (maxsmythe) force-pushed the headless-benchmarking-phased-commits branch 3 times, most recently from 736ef94 to a395a0e Compare June 18, 2026 08:00
@maxsmythe Max Smythe (maxsmythe) force-pushed the headless-benchmarking-phased-commits branch from a395a0e to 6d68e46 Compare June 19, 2026 23:21
@maxsmythe Max Smythe (maxsmythe) force-pushed the headless-benchmarking-phased-commits branch from 6d68e46 to 11f9ef3 Compare June 19, 2026 23:23
@maxsmythe Max Smythe (maxsmythe) force-pushed the headless-benchmarking-phased-commits branch 8 times, most recently from 2e6c389 to 4453b52 Compare June 20, 2026 07:43
@maxsmythe Max Smythe (maxsmythe) force-pushed the headless-benchmarking-phased-commits branch from 4453b52 to 34ced80 Compare June 21, 2026 00:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant