Skip to content

issue/1113:NVIDIA机器添加awq_marlin_gemm算子#1137

Open
xgqdut2016 wants to merge 3 commits intomainfrom
issue/1113
Open

issue/1113:NVIDIA机器添加awq_marlin_gemm算子#1137
xgqdut2016 wants to merge 3 commits intomainfrom
issue/1113

Conversation

@xgqdut2016
Copy link
Copy Markdown
Collaborator

@xgqdut2016 xgqdut2016 commented Apr 21, 2026

这个算子需要提前使用python src/infiniop/ops/awq_marlin_gemm/nvidia/generate_kernel.py 9.0生成一大堆sm80*.cu以及对应的kernel_selector.h,否则编译测试会报错
82b25140-b3ed-48fd-a8a4-4da60bb67bcc

@xgqdut2016 xgqdut2016 requested a review from a team April 21, 2026 06:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant