Skip to content

feat(engine): add evaluation runtime tuning#239

Merged
abhinav-galileo merged 6 commits into
mainfrom
abhi/agent-control-runtime-tuning
Jun 17, 2026
Merged

feat(engine): add evaluation runtime tuning#239
abhinav-galileo merged 6 commits into
mainfrom
abhi/agent-control-runtime-tuning

Conversation

@abhinav-galileo

Copy link
Copy Markdown
Collaborator

Summary:

  • Exposes evaluation concurrency as a configurable engine setting.
  • Adds Luna HTTP connection and client-pool tuning.
  • Preserves Luna HTTP error metadata for evaluator failures.

Validation:

  • git diff --check passed for the split diff.
  • make engine-test did not reach tests because uv timed out fetching greenlet from the package index.

@abhinav-galileo abhinav-galileo changed the title feat: add evaluation runtime tuning feat(engine): add evaluation runtime tuning Jun 15, 2026
@abhinav-galileo abhinav-galileo marked this pull request as ready for review June 15, 2026 15:35
@abhinav-galileo abhinav-galileo force-pushed the abhi/agent-control-runtime-tuning branch from a3606fa to 9b234e4 Compare June 15, 2026 16:02
@codecov

codecov Bot commented Jun 15, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 97.34513% with 3 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
engine/src/agent_control_engine/core.py 85.71% 2 Missing ⚠️
.../agent_control_evaluator_galileo/luna/evaluator.py 95.23% 1 Missing ⚠️

📢 Thoughts on this report? Let us know!

Comment thread evaluators/contrib/galileo/src/agent_control_evaluator_galileo/luna/client.py Outdated
@namrataghadi-galileo

Copy link
Copy Markdown
Contributor

[client.py:87 / core.py:31 / server] Three divergent env-int parsers across packages

_load_int_env (client.py), _env_positive_int (core.py), and presumably a third in the server package all parse integers from env vars but differ on: empty-string handling, exception type (ValueError vs RuntimeError), and positivity validation. Any fix to one is invisible to the others.

@abhinav-galileo

Copy link
Copy Markdown
Collaborator Author

For the env parser consistency note: I fixed the immediate Luna parser inconsistency for empty values in 35a12c1. I did not extract a shared env parser across packages in this PR to avoid broadening the runtime-tuning change.

@abhinav-galileo abhinav-galileo force-pushed the abhi/luna-internal-api-url branch from 44185bb to 1a18fcc Compare June 17, 2026 12:12
Base automatically changed from abhi/luna-internal-api-url to main June 17, 2026 12:31
@abhinav-galileo abhinav-galileo force-pushed the abhi/agent-control-runtime-tuning branch from 35a12c1 to 664a78f Compare June 17, 2026 12:37
@abhinav-galileo abhinav-galileo merged commit 2f1e5fe into main Jun 17, 2026
6 checks passed
@abhinav-galileo abhinav-galileo deleted the abhi/agent-control-runtime-tuning branch June 17, 2026 15:35
galileo-automation pushed a commit that referenced this pull request Jun 17, 2026
## [3.1.0](ts-sdk-v3.0.0...ts-sdk-v3.1.0) (2026-06-17)

### Features

* **engine:** add evaluation runtime tuning ([#239](#239)) ([2f1e5fe](2f1e5fe))
* **server:** bound database connection pool ([#236](#236)) ([80aea8f](80aea8f))

### Bug Fixes

* **evaluators:** configure Luna scorer API URL ([#237](#237)) ([fc516f0](fc516f0))
* **server:** use plain psycopg with OS libpq ([#241](#241)) ([45a33a5](45a33a5))
@galileo-automation

Copy link
Copy Markdown
Collaborator

🎉 This PR is included in version 3.1.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants