Skip to content

asr后续优化路线 #60

Description

@zzgnb

fr2的asr效果非常好,但在实际应用时遇到并发卡点,请问大佬们后续有考虑做decoder-only架构的asr嘛,目前最常见的推理框架vllm和trt-llm对enc-dec架构的支持都不完善,很多加速的trick例如投机采样都没法应用

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions