[fix] [v1]: apply agentic-judge task weights when an isolated solver fails - #2223
Open
gtnv wants to merge 3 commits into
Open
[fix] [v1]: apply agentic-judge task weights when an isolated solver fails#2223gtnv wants to merge 3 commits into
gtnv wants to merge 3 commits into
Conversation
Scale failed solver task rewards when no judge runs.
gtnv
marked this pull request as ready for review
August 2, 2026 10:37
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes and found 1 potential issue.
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit 08d30ae. Configure here.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

closes: #2197
Problem:
this pr puts task-weight scaling in the no-judge branch before returning. judge-present paths keep existing reward oder.
Note
Fix
AgenticJudgeEnv.finalizeto apply task weights when the solver runs without a judgeWhen an agentic-judge episode has no
judgetrace (i.e. the solver ran in isolation),finalizepreviously returned without applying the configuredscore.task_weight. It now iterates over the solver's existing rewards and multiplies each non-Nonereward.weightbyscore.task_weightbefore returning. The change is inenv.py. Risk: if both thejudgeandsolvertraces are absent,finalizenow raises aKeyError.Macroscope summarized 8074f21.
Note
Low Risk
Small, localized change to reward weighting in an edge path; mirrors existing finalize logic and does not touch auth or infrastructure.
Overview
Fixes reward composition when the judge never runs. In
IsolatedAgenticJudgeEnv, a failed solver exits before the judge is invoked, sofinalize()only sees the solver trace and used to return immediately.It now scales the solver trace’s task reward weights by
config.score.task_weightin that no-judge path—the same logic already used when a judge verdict exists. With the defaulttask_weightof0, partial task rewards on failed isolated runs are suppressed as intended instead of keeping their original weights.Reviewed by Cursor Bugbot for commit 8074f21. Bugbot is set up for automated code reviews on this repo. Configure here.