Currently, trtmoe only supports Blackwell or Thor architectures.
MoE requires Blackwell or Thor GPU architecture (SM 10.x or SM 11.x)
Are there any plans on the roadmap to add support for Hopper (sm90), Ada (sm89), or Ampere (sm80) in the future? Many developers in the community are still relying on these GPUs for local development and inference.
Thanks!
Currently, trtmoe only supports Blackwell or Thor architectures.
MoE requires Blackwell or Thor GPU architecture (SM 10.x or SM 11.x)Are there any plans on the roadmap to add support for Hopper (sm90), Ada (sm89), or Ampere (sm80) in the future? Many developers in the community are still relying on these GPUs for local development and inference.
Thanks!