Skip to content

Pull requests: open-compass/opencompass

New pull request New
106 Open 1,386 Closed
106 Open 1,386 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Make toxicity maximum NaN-safe
#2629 opened Sep 2, 2026 by zjn20030811 Loading…
1
feat(dataset): add generative CivilComments config
#2625 opened Aug 31, 2026 by motodriver Loading…
1
docs: clarify prompt version in summaries
#2623 opened Aug 31, 2026 by motodriver Loading…
@bittersweet1999
test: cover HumanEval evaluator details
#2622 opened Aug 31, 2026 by motodriver Loading…
@bittersweet1999
Fix MBPP answer extraction
#2621 opened Aug 30, 2026 by Marchematics Loading…
1
@tonysy
1
Fix gsm8k modelscope config
#2620 opened Aug 30, 2026 by Marchematics Loading…
1
Skip token type ids in Hugging Face backend
#2619 opened Aug 30, 2026 by Marchematics Loading…
3 tasks done
1
@tonysy
4
docs: correct three docstring defaults that disagree with the signatures
#2618 opened Aug 30, 2026 by avalyset Loading…
3 of 6 tasks
@tonysy
[Doc] Fix typo in custom dataset guide
#2617 opened Aug 29, 2026 by BingH225 Loading…
[Feature] Support DROP exact-match and F1 metrics
#2616 opened Aug 28, 2026 by Excelius-Wang Loading…
4 of 6 tasks
1
@tonysy
feat: add OrcaRouter as a first-class API model provider
#2614 opened Aug 28, 2026 by nissrin2020ali-ux Loading…
3 tasks done
@tonysy
tests: add unit tests for GSM8K dataset
#2613 opened Aug 26, 2026 by moonturbo Loading…
docs: fix English version link in testing guide
#2612 opened Aug 26, 2026 by moonturbo Loading…
docs: fix configs links after v0.4.0 migration
#2611 opened Aug 26, 2026 by moonturbo Loading…
[Fix] Improve PubMedQA LLM-judge verdict robustness
#2606 opened Aug 24, 2026 by zzc152 Loading…
@bittersweet1999
[Fix] Support spawn workers in LiveCodeBench evaluation
#2603 opened Aug 20, 2026 by tandede Loading…
4 of 6 tasks
@acylam
1
[Feature] dump benchmark prompt hashcode in predictions and results and repair dump-only-message-path
#2602 opened Aug 19, 2026 by Myhs-phz Collaborator Loading…
[Fix] Restore missing comma in first_option_postprocess answer patterns
#2600 opened Aug 18, 2026 by jaideeppyne Loading…
docs: fix typos in gaokao_math and hellobench dataset READMEs
#2599 opened Aug 17, 2026 by bajiu-bajiu Loading…
4 tasks done
@bittersweet1999
fix(datasets): anchored grade extraction + surface judge failures in generic llmjudge
#2598 opened Aug 15, 2026 by YuhaoLin2005 Loading…
@tonysy
[Fix] Fix broken Star History chart in README
#2597 opened Aug 14, 2026 by OctoBored Loading…
@tonysy
[Fix] Fix EESE scoring of worded judge replies
#2594 opened Aug 12, 2026 by mkzung Loading…
3 of 6 tasks
[Fix] Fix OlympiadBench grading of factored answers
#2593 opened Aug 12, 2026 by mkzung Loading…
3 of 6 tasks
[feat]: Add biren supa backend supported
#2591 opened Aug 12, 2026 by frozenleaves Loading…
6 tasks
feat: add Atlas Cloud model config
#2590 opened Aug 10, 2026 by binyangzhu000-sudo Loading…
@bittersweet1999
ProTip! Add no:assignee to see everything that’s not assigned.