Skip to content

Issues: NVIDIA/TensorRT

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

361 Open 3,394 Closed
361 Open 3,394 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Questions about polygraphy convertsion
#4218 opened Oct 22, 2024 by EmmaThompson123
could not find any supported formats consistent with input/output data types failure of TensorRT 10.3 on jetson orin
#4217 opened Oct 22, 2024 by nainaigetuide
AttributeError: 'tensorrt_bindings.tensorrt.ICudaEngine' object has no attribute 'num_bindings'
#4216 opened Oct 21, 2024 by metehanozdeniz
TensorRT 10.5 Flux Dit BF16 precision
#4215 opened Oct 21, 2024 by QZH-eng
out of memory failure of TensorRT 10.5 when running flux dit on GPU L40S
#4214 opened Oct 21, 2024 by QZH-eng
3
Failed to pip install TensorRT 10.5.0
#4213 opened Oct 20, 2024 by NevermindNilas
1
stable diffusion quantization in inpainting task is poor
#4212 opened Oct 20, 2024 by worhar
1
How to strictly limiting the maximum GPU memory usage and clear GPU memory cache?
#4211 opened Oct 19, 2024 by EmmaThompson123
1
"Device to shape host node should not be folded into myelin" failure of TensorRT 10.5 when running trtexec on GPU L4 Export: torch.onnx https://pytorch.org/docs/stable/onnx.html internal-bug-tracked triaged Issue has been triaged by maintainers
#4210 opened Oct 18, 2024 by sean-xiang-applovin
1
Different versions of TensorRT get different model inference results Accuracy triaged Issue has been triaged by maintainers
#4209 opened Oct 18, 2024 by demuxin
2
Does Flux not support int8? Demo: Diffusion Issues regarding demoDiffusion Precision: INT8 triaged Issue has been triaged by maintainers
#4208 opened Oct 17, 2024 by algorithmconquer
1
flux model engine_from_bytes(bytes_from_path(self.engine_path)) OutOfMemory Demo: Diffusion Issues regarding demoDiffusion triaged Issue has been triaged by maintainers
#4207 opened Oct 17, 2024 by algorithmconquer
2
When converting ONNX to TensorRT, how to let the output shape determined by the input value instead of the input size? question Further information is requested triaged Issue has been triaged by maintainers
#4206 opened Oct 17, 2024 by OswaldoBornemann
2
flux-demo failure of TensorRT 10.5 when running a single L40 GPU, how to implement 2-GPUs with L40 Demo: Diffusion Issues regarding demoDiffusion triaged Issue has been triaged by maintainers
#4205 opened Oct 17, 2024 by algorithmconquer
4
optimization profile is missing values for shape input triaged Issue has been triaged by maintainers
#4204 opened Oct 16, 2024 by OswaldoBornemann
2
TensorRT output shape is different from ONNX output shape triaged Issue has been triaged by maintainers
#4203 opened Oct 16, 2024 by OswaldoBornemann
2
Deploy DeBERTa to Triton Inference Server triaged Issue has been triaged by maintainers
#4202 opened Oct 16, 2024 by nbroad1881
1
the output of onnx model is different from model inferenced by TensorRT Export: torch.onnx https://pytorch.org/docs/stable/onnx.html triaged Issue has been triaged by maintainers
#4201 opened Oct 15, 2024 by AmazDeng
7
NO Tensorrt 9.2 triaged Issue has been triaged by maintainers
#4200 opened Oct 15, 2024 by lyc728
1
ONNX to TensorRT Error: Internal Error (kv_slice: optimization profile is missing values for shape input) triaged Issue has been triaged by maintainers
#4199 opened Oct 14, 2024 by zengrh3
1
trt10.5 pytorch-quantization has compile bug triaged Issue has been triaged by maintainers
#4197 opened Oct 13, 2024 by lix19937
1
Polygraphy: How to write the data_loader.py to send the calibration data? Tools: Polygraphy triaged Issue has been triaged by maintainers
#4196 opened Oct 12, 2024 by Kongsea
9
Do modulatedDeformConvPlugin and multiscaleDeformableAttnPlugin support quantization? What quantization tools can be used? Plugins Quantization: PTQ triaged Issue has been triaged by maintainers
#4195 opened Oct 12, 2024 by IEIAuto
11
build pytorch_quantization(2.2.1) error triaged Issue has been triaged by maintainers
#4193 opened Oct 11, 2024 by 2460707925
3
Could not find any implementation for node failure of TensorRT 8.6.13 when running MHA(multi head attention) on GPU A10 triaged Issue has been triaged by maintainers
#4189 opened Oct 10, 2024 by XuDeshengCat
7
ProTip! Find all open issues with in progress development work with linked:pr.