Skip to content

Can support google/byt5 model quantization? #2

Open
Open
Can support google/byt5 model quantization?#2

Description

@wikeeyang
wikeeyang
opened on May 26, 2025

Now I use NF4, I want to quantize ByT5-xxl models to LeanQuant 4bit, please help me to check it can support this?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions