Skip to content

Add DeepSeek preset for agent loop benchmarks#126

Merged
SonAIengine merged 1 commit into
mainfrom
agent-loop-deepseek-preset
Jul 2, 2026
Merged

Add DeepSeek preset for agent loop benchmarks#126
SonAIengine merged 1 commit into
mainfrom
agent-loop-deepseek-preset

Conversation

@SonAIengine

Copy link
Copy Markdown
Contributor

Summary

  • add --llm-preset deepseek to the agent-loop benchmark runner
  • resolve DeepSeek defaults to https://api.deepseek.com/v1, deepseek-v4-flash, and DEEPSEEK_API_KEY
  • preserve explicit CLI overrides and keep the existing local defaults for the local preset

Why

This avoids accidentally falling back to local/Qwen defaults when the intended quality path is DeepSeek Flash.

Verification

  • uv run pytest tests/test_agent_search_benchmarks.py tests/test_agent_efficiency.py tests/test_sufficiency_gate.py
  • uv run ruff check examples/ablation/run_agent_loop_benchmarks.py tests/test_agent_search_benchmarks.py tests/test_agent_efficiency.py src/synaptic/agent_loop.py
  • git diff --check

@SonAIengine SonAIengine merged commit 7d76a8f into main Jul 2, 2026
2 checks passed
@SonAIengine SonAIengine deleted the agent-loop-deepseek-preset branch July 2, 2026 10:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant