Skip to content

TensorRT OSS v9.1.0

Compare
Choose a tag to compare
@SimengLiu-nv SimengLiu-nv released this 20 Oct 00:34
b8ada01

TensorRT OSS release corresponding to TensorRT 9.1.0.4 GA release.

Updates since TensorRT 8.6.1 GA release.

Key Features and Updates:

  • Update the trt_python_plugin sample.
    • Python plugins API reference is part of the offical TRT Python API.
  • Added samples demonstrating the usage of the progress monitor API.
  • Remove dependencies related to python<3.8 in python samples as we no longer support python<3.8 for python samples.
  • Demo changes
    • Added LAMBADA dataset accuracy checks in the HuggingFace demo.
    • Enabled structured sparsity and FP8 quantized batch matrix multiplication(BMM)s in attention in the NeMo demo.
    • Replaced deprecated APIs in the BERT demo.
  • Updated tooling
    • Polygraphy v0.49.1