大家有没有使用TensorRT-LLM来加速推理并且实现functioncalling #981
-
|
大家有没有使用TensorRT-LLM来加速推理并且实现functioncalling |
Beta Was this translation helpful? Give feedback.
Answered by
zRzRzRzRzRzRzR
Apr 13, 2024
Replies: 2 comments
-
|
实现原理和transfomrer理论一样，毕竟只是改了模型推理方式 |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
zRzRzRzRzRzRzR
-
|
最近在研究，请问有什么问题吗？ |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
实现原理和transfomrer理论一样，毕竟只是改了模型推理方式