Skip to content

[AMD/ROCM] GLM5.1 FP4 (MXFP4) MI355X Support#1098

Open
ajith-sirra-amd wants to merge 12 commits intoSemiAnalysisAI:mainfrom
ajith-sirra-amd:ajith/glm5_fp4_mi355x_sglang
Open

[AMD/ROCM] GLM5.1 FP4 (MXFP4) MI355X Support#1098
ajith-sirra-amd wants to merge 12 commits intoSemiAnalysisAI:mainfrom
ajith-sirra-amd:ajith/glm5_fp4_mi355x_sglang

Conversation

@ajith-sirra-amd
Copy link
Copy Markdown
Contributor

Overview

Add benchmark configuration and testing support for AMD MI355X hardware.

Changes

  • Added benchmark script for GLM-5 FP4 model on MI355X to run with Updated SGLang Image.
  • Updated GitHub Actions configuration for AMD master branch

Testing

  • Verify benchmark execution on MI355X hardware
  • Validate configuration settings

Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
Copy link
Copy Markdown
Contributor

@claude claude bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
@ajith-sirra-amd ajith-sirra-amd changed the title AMD GLM5 FP4 (mxfp4) MI355X Support [AMD/ROCM] GLM5 FP4 (mxfp4) MI355X Support Apr 20, 2026
@ajith-sirra-amd ajith-sirra-amd changed the title [AMD/ROCM] GLM5 FP4 (mxfp4) MI355X Support [AMD/ROCM] GLM5 FP4 (MXFP4) MI355X Support Apr 20, 2026
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
Comment thread .github/configs/amd-master.yaml Outdated
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
Comment thread .github/configs/amd-master.yaml Outdated
@seungrokj seungrokj added the AMD label Apr 20, 2026
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
@seungrokj seungrokj changed the title [AMD/ROCM] GLM5 FP4 (MXFP4) MI355X Support [AMD/ROCM] GLM5.1 FP4 (MXFP4) MI355X Support Apr 20, 2026
Comment thread .github/configs/amd-master.yaml Outdated
Comment thread .github/configs/amd-master.yaml Outdated
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions bot Apr 20, 2026
@ajith-sirra-amd
Copy link
Copy Markdown
Contributor Author

/sweep test-config --config-files .github/configs/amd-master.yaml --config-keys glm5.1-fp4-mi355x-sglang

@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions bot Apr 20, 2026
@SemiAnalysisAI SemiAnalysisAI deleted a comment from github-actions bot Apr 20, 2026
@seungrokj
Copy link
Copy Markdown
Collaborator

/sweep test-config --config-files .github/configs/amd-master.yaml --config-keys glm5.1-fp4-mi355x-sglang

@github-actions
Copy link
Copy Markdown
Contributor

@seungrokj Kicking off a sweep.

Run: https://github.com/SemiAnalysisAI/InferenceX/actions/runs/24661571939
Command: test-config --config-files .github/configs/amd-master.yaml --config-keys glm5.1-fp4-mi355x-sglang
Pinned ref: 277f774
Approval: not required (trusted collaborator).

@seungrokj
Copy link
Copy Markdown
Collaborator

@functionstackx @cquil11 can you help merging this? We used glm5.1 according to the previous discussion. Sgl cook book is wip @ajith-sirra-amd plz submit a cook book pr too

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

2 participants