Centralize runner model path mappings in runners.yaml / 在 runners.yaml 中集中管理 runner 模型路径映射 - #2383
Draft
cquil11 wants to merge 2 commits into
Draft
Centralize runner model path mappings in runners.yaml / 在 runners.yaml 中集中管理 runner 模型路径映射#2383cquil11 wants to merge 2 commits into
cquil11 wants to merge 2 commits into
Conversation
Move the B200 DGXC model-path and srt-slurm alias table into configs/runners.yaml, add typed validation, and resolve it through a reusable helper. Preserve ordered fallbacks and the existing DSv4 operator override. 中文:将 B200 DGXC 的模型路径与 srt-slurm 别名映射迁移到 configs/runners.yaml,补充类型校验,并通过可复用工具统一解析。保留有序回退机制及现有的 DSv4 运维覆盖行为。
Migrate the remaining B300, GB200, GB300, H100, and H200 launcher lookup tables into configs/runners.yaml. Generalize model resolution for framework overrides, optional aliases, and portable fallbacks, and add coverage for every affected NVIDIA multi-node config. 中文:将剩余的 B300、GB200、GB300、H100 和 H200 启动器模型查找表统一迁移到 configs/runners.yaml。扩展模型解析能力以支持框架级覆盖、可选别名及便携式回退路径,并为所有受影响的 NVIDIA 多节点配置补充覆盖测试。
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Move every launcher-level model lookup table that maps
MODEL_PREFIX/PRECISION/FRAMEWORKto cluster-local model paths and aliases into the typedmodelssection ofconfigs/runners.yaml.The migration covers all six launchers that contained this pattern:
The launchers now share one shell entrypoint and one Python resolver. The resolver supports:
MODEL_PATHoperator overrides;SRT_SLURM_MODEL_PREFIX,SERVED_MODEL_NAME, andMODEL_NAMEexports;Runner-config validation rejects unknown runner labels, relative paths, duplicate paths, and undeclared fields. Model-specific branches that select srt-slurm revisions, recipes, or setup workarounds remain in Bash because they are orchestration behavior rather than model-location metadata.
No
perf-changelog.yamlentry is included because this refactor is intended to preserve the existing benchmark matrix and runtime model selection behavior.Validation
python -m pytest utils/matrix_logic/ -q— 238 passedconfigs/runners.yamlbash -nfor all six migrated launchers and the shared helperpython -m py_compilefor the resolver and validation modulesgit diff --check中文说明
将所有启动器中按
MODEL_PREFIX/PRECISION/FRAMEWORK映射集群本地模型路径与别名的查找表,统一迁移到configs/runners.yaml中带类型校验的models配置段。本次迁移覆盖存在该模式的全部六个启动器:
这些启动器现在统一复用一个 Shell 入口和一个 Python 解析工具。解析器支持:
MODEL_PATH运维覆盖机制;SRT_SLURM_MODEL_PREFIX、SERVED_MODEL_NAME和MODEL_NAME;Runner 配置校验会拒绝未知 runner 标签、相对路径、重复路径及未声明字段。用于选择 srt-slurm 版本、配方或环境修复逻辑的模型专属分支仍保留在 Bash 中,因为这些属于作业编排行为,而不是模型存放位置元数据。
本次未修改
perf-changelog.yaml,因为该重构旨在保持现有基准测试矩阵及运行时模型选择行为不变。验证
python -m pytest utils/matrix_logic/ -q— 238 项测试通过configs/runners.yaml中的每一条模型映射bash -npython -m py_compilegit diff --check