Does anyone have llama-65b throughput perf data on multi A100 40GB? #443
Answered
by
irasin
zhaoyang-star
asked this question in
Q&A
-
|
Does anyone have llama-65b throughput perf data on multi A100 40GB? |
Beta Was this translation helpful? Give feedback.
Answered by
irasin
Jul 12, 2023
Replies: 1 comment 1 reply
-
|
Here's the perf data of llama65B on A100 80GB, refer to #421, hope to help. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Thanks. I had a glace at #421 , which is a very solid work. I will go deeper in the next few days. |
Beta Was this translation helpful? Give feedback.
Answer selected by
zhaoyang-star
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Here's the perf data of llama65B on A100 80GB, refer to #421, hope to help.