Skip to content

Commit

Permalink
using cuda-pr-212 as intermediate-image and adapter installed from git
Browse files Browse the repository at this point in the history
Signed-off-by: Jefferson Fialho <[email protected]>
  • Loading branch information
fialhocoelho committed Oct 24, 2024
1 parent 629ab99 commit 26564a0
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions Dockerfile.ubi
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,7 @@ COPY vllm /opt/vllm/lib64/python3.12/site-packages/vllm
# RUN --mount=type=cache,target=/root/.cache/pip \
# pip install vllm-tgis-adapter==0.5.1
RUN --mount=type=cache,target=/root/.cache/pip \
--mount=type=bind,from=build,src=/workspace/dist,target=/workspace/dist \
uv pip install $(echo dist/*.whl)'[tensorizer]' git+https://github.com/opendatahub-io/vllm-tgis-adapter@ibm-20241024-adapter
pip install git+https://github.com/opendatahub-io/vllm-tgis-adapter@ibm-20241024-adapter

ENV GRPC_PORT=8033 \
PORT=8000 \
Expand Down

0 comments on commit 26564a0

Please sign in to comment.