[feat][evaluation] support async CustomRPC evaluators - #607
Draft
HearyShen wants to merge 15 commits into
Draft
Conversation
Codecov Report❌ Patch coverage is @@ Coverage Diff @@
## main #607 +/- ##
==========================================
+ Coverage 78.16% 78.23% +0.07%
==========================================
Files 693 693
Lines 84808 85009 +201
==========================================
+ Hits 66288 66507 +219
+ Misses 14577 14551 -26
- Partials 3943 3951 +8
Flags with carried forward coverage won't be shown. Click here to find out more.
... and 2 files with indirect coverage changes Continue to review full report in Codecov by Harness.
🚀 New features to boost your workflow:
|
…687" This reverts commit 7c4c6fc.
HearyShen
force-pushed
the
codex/trae-work-async-evaluator
branch
from
August 11, 2026 16:23
eaf6510 to
3759f6a
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
背景
Trae Work 三方 CustomRPC 评估器耗时较长,需要通过
AsyncInvokeEvaluator快速接单,由 Provider 异步上报最终结果,并恢复实验调度。改动
AsyncInvokeEvaluatorSPI。AsyncRunEvaluator的 Record -> Context -> Provider 顺序。ResumeReady,callback 恢复实验调度。2026-08-12 最终 PPE 验收
8741a167970c52527e84038fa7faa8d91cba286e,GitHub Checks 全绿。2bb98ef6461cec3eacf86c31de6b69f299d0a45a。stone.cozeloop.evaluation/default,SCM1.0.0.4415,8C16G,HL/LF/LQ 各 1/1;工单2087543570998784000成功。外场lane-default-fornax_commercial仍为1.0.0.4322。7590117564433612802、FaaS7590117563496652802、Agent7590117563496653058均从 Processing 收敛到 Success,耗时均非负。601200702并携带 PPE Header,Provider 最终失败,0 次假成功。关联
当前保持 Draft/Open,等待人工 Code Review;不合并、不创建生产发布。