-
Notifications
You must be signed in to change notification settings - Fork 421
Issues: open-compass/opencompass
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[Bug] AttributeError: 'ConfigDict' object has no attribute 'reader_cfg'
#1591
opened Oct 9, 2024 by
xtuhcy
2 tasks done
[Bug] It seems run wrong number of prompts when max-num-workers > 1.
#1579
opened Sep 29, 2024 by
zhulinJulia24
2 tasks done
[Bug] SciCode miss with_background
Bug
Something isn't working
#1540
opened Sep 18, 2024 by
tonysy
2 tasks done
[Bug] PreTrainedTokenizerFast inference with unexpected parameter token_type_ids
Bug
Something isn't working
#1533
opened Sep 18, 2024 by
kkwhale7
2 tasks done
使用Qwen2-72B-Base测试GPQA数据集时报错:NotImplementedError: OpenAI does not support ppl-based evaluation yet, try gen-based instead.
#1526
opened Sep 12, 2024 by
13416157913
2 tasks done
[Bug] Cibench generate matplotlib has a wrong weights which should be [175, 2, 1, 156]
#1524
opened Sep 12, 2024 by
imaginistLi
2 tasks done
您好,请教一个问题,请问OpenCompass官网公开学术榜单中,测试的Qwen2模型中temperature、repetition_penalty、、top_p这些参数是设置多少的?模型部署的方式是采用什么方式部署的?
#1523
opened Sep 12, 2024 by
13416157913
2 tasks done
Previous Next
ProTip!
Updated in the last three days: updated:>2024-10-23.