Feature Support Livecodebench Issue 980 Open Compassopencompass
[Feature] Support LiveCodeBench · Issue #980 · open-compass/opencompass ...
[Feature] Support QuALITY dataset · Issue #949 · open-compass ...
[BUG] Very slow livecodebench scoring · Issue #650 · huggingface ...
Error Encountered During livecodebench eval Execution · Issue #375 ...
Cannot reproduce the livecodebench result for R1 · Issue #300 ...
[Feature] opencompass有计划支持CS-Bench数据集评测吗？ · Issue #1388 · open-compass ...
GitHub - ai-in-pm/LiveCodeBench-Pro: LiveCodeBench Pro is a cutting ...
在CPU上运行 - launch on CPU · Issue #990 · open-compass/opencompass · GitHub
希望增加livecodebench和codeforces代码能力测评 · Issue #338 · modelscope/evalscope ...
[Feature] 调用本地模型服务，如何修改配置 · Issue #1397 · open-compass/opencompass · GitHub
Advertisement Space (300x250)
[Bug] open compass hangs when evaluating chat musician trained model ...
[Feature] 建议增加Embedding模型评测 · Issue #463 · open-compass/opencompass ...
[Bug] Only Debug Mode can perform eval tasks correctly. · Issue #1859 ...
[Bug] MTBench101 dataset multi-turn · Issue #2288 · open-compass ...
[Bug] 评测lawbench数据集时偶现异常 · Issue #1185 · open-compass/opencompass · GitHub
[Bug] 评估过程中的oom 问题 · Issue #1587 · open-compass/opencompass · GitHub
[Bug] compassrank和数据集readme差距很大，且compassrank的配置文件无法获取 · Issue #1434 ...
[Feature] 请问如何加载本地模型进行测评 · Issue #1865 · open-compass/opencompass · GitHub
SafetyBench数据集评测bug · Issue #1622 · open-compass/opencompass · GitHub
[Bug] 找不到LongContext的数据集 · Issue #1047 · open-compass/opencompass · GitHub
Advertisement Space (336x280)
cmb_gen [bug] · Issue #1137 · open-compass/opencompass · GitHub
[Bug] 根据官方的Quick Start运行，输出结果为空 · Issue #1168 · open-compass ...
![[논문 리뷰] Multi-LCB: Extending LiveCodeBench to Multiple Programming ...](https://moonlight-paper-snapshot.s3.ap-northeast-2.amazonaws.com/arxiv/multi-lcb-extending-livecodebench-to-multiple-programming-languages-2.png)
[논문 리뷰] Multi-LCB: Extending LiveCodeBench to Multiple Programming ...
OpenCode can't fetch its config scheme · Issue #7601 · anomalyco ...
关于技术报告中livecodebench的pass@1-cot指标的疑问 · Issue #367 · deepseek-ai ...
[Bug] checkpoint load bug · Issue #832 · open-compass/opencompass · GitHub
评测结果内容为空 · Issue #436 · open-compass/opencompass · GitHub
[Bug] 为什么按官方文档跑会报错？ · Issue #799 · open-compass/opencompass · GitHub
opencompass榜单更新情况 · Issue #1201 · open-compass/opencompass · GitHub
部分数据的子集提示报错，没有经过测试 · Issue #996 · open-compass/opencompass · GitHub
Advertisement Space (336x280)
[Bug] 运行ceval无法结果可视化 · Issue #383 · open-compass/opencompass · GitHub
修改配置文件，无法测试本地模型，没有报错信息[Bug] · Issue #796 · open-compass/opencompass ...
评估gsm8k报错 · Issue #245 · open-compass/opencompass · GitHub
使用自定义范围测试Live_code_bench会出现卡住 · Issue #402 · modelscope/evalscope · GitHub
[Bug] 不支持windows系统运行吗 · Issue #1300 · open-compass/opencompass · GitHub
[Bug] 评测速度很慢 · Issue #974 · open-compass/opencompass · GitHub