Skip to content

Add support for eval batch size tuning for LLMs on local backend (#3957) #972

Add support for eval batch size tuning for LLMs on local backend (#3957)

Add support for eval batch size tuning for LLMs on local backend (#3957) #972

Annotations

3 warnings

cherry_pick_into_release-0.7

succeeded Mar 11, 2024 in 11s