Skip to content

fix: use Unicode-aware tokenizer in ROUGE-1 scorer to support non-English eval#6401

Open
guptaishaan wants to merge 2 commits into
google:mainfrom
guptaishaan:fix/issue-3111-931
Open

fix: use Unicode-aware tokenizer in ROUGE-1 scorer to support non-English eval#6401
guptaishaan wants to merge 2 commits into
google:mainfrom
guptaishaan:fix/issue-3111-931