Skip to content

Commit

Permalink
Update docs
Browse files Browse the repository at this point in the history
  • Loading branch information
kthui committed Jan 8, 2024
1 parent 33be446 commit 05ff5c0
Showing 1 changed file with 11 additions and 2 deletions.
13 changes: 11 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -80,8 +80,8 @@ used to execute both TensorFlow 1 and TensorFlow 2 models. The
[tensorflow_backend](https://github.com/triton-inference-server/tensorflow_backend)
repo contains the documentation and source for the backend.

**PyTorch**: The PyTorch backend is used to execute TorchScript
models. The
**PyTorch**: The PyTorch backend is used to execute PyTorch models in both
TorchScript and PyTorch 2.0 formats. The
[pytorch_backend](https://github.com/triton-inference-server/pytorch_backend)
repo contains the documentation and source for the backend.

Expand Down Expand Up @@ -215,6 +215,15 @@ Triton image as:
... # other files needed by mybackend
```

Starting from 24.01, the default backend shared library name can be changed by
providing the `runtime` setting in the model configuration. For example,

```
runtime: "my_backend_shared_library_name.so"
```

A model may choose a specific runtime implementation provided by the backend.

### Triton Backend API

A Triton backend must implement the C interface defined in
Expand Down

0 comments on commit 05ff5c0

Please sign in to comment.