Skip to content

Does the offline inference script support continuous batching memory optimization technique? #816

Unanswered
wxp16 asked this question in Q&A
Does the offline inference script support continuous batching memory optimization technique? #816
@wxp16 wxp16
Aug 21, 2023 · 0 comments
Return to top
Discussion options

wxp16
Aug 21, 2023

You must be logged in to vote

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant
@wxp16