Skip to content

0.0.11

Latest
Latest
Compare
Choose a tag to compare
@rmccorm4 rmccorm4 released this 05 Sep 22:22
· 1 commit to main since this release
0.0.11
1d872d7
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

What's Changed

  • chore: Add Llama3.1-8B support for vLLM and use KIND_MODEL for vLLM config by default by @rmccorm4 in #82
  • build: Upgrade to 24.08, TRT-LLM 0.12.0, and Triton CLI v0.0.11 by @rmccorm4 in #83

Full Changelog: 0.0.10...0.0.11

Contributors

rmccorm4
Assets 2
Loading