New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

本地大模型下，是不是不支持CPU下部署？ #217

Open

cristianohello opened this issue Oct 11, 2024 · 1 comment

cristianohello commented Oct 11, 2024

我安装lmdeploy通过cpu，报错：

assert CUDA_PATH is not None, 'Can not find $env:CUDA_PATH'
AssertionError: Can not find $env:CUDA_PATH

The text was updated successfully, but these errors were encountered:

aonoa commented Oct 25, 2024

你用其他工具部署大模型，然后用openai格式调用试试

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment