From eae3859c75e4a4a648d5361f67175e5001320e25 Mon Sep 17 00:00:00 2001 From: Brent Salisbury Date: Tue, 24 Sep 2024 13:29:57 -0400 Subject: [PATCH 1/3] Add poetry install shell cmd to the readme Signed-off-by: Brent Salisbury --- README.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/README.md b/README.md index a8d1790..5cf9fb5 100644 --- a/README.md +++ b/README.md @@ -10,6 +10,9 @@ Install the dependencies ```sh +# Install poetry if not already available +curl -sSL https://install.python-poetry.org | python3 - + # Install dependencies poetry install From af7ae3ec6014af14e9aa81926cb67359aae03715 Mon Sep 17 00:00:00 2001 From: Brent Salisbury Date: Wed, 25 Sep 2024 11:52:25 -0400 Subject: [PATCH 2/3] Add GPU support instructions - Validated on an EC2 GPU instance to work. - Closes #8 Signed-off-by: Brent Salisbury --- README.md | 21 +++++++++++++++++++++ 1 file changed, 21 insertions(+) diff --git a/README.md b/README.md index 5cf9fb5..8dfde57 100644 --- a/README.md +++ b/README.md @@ -33,3 +33,24 @@ curl -X 'POST' \ } }' ``` + +### Cuda GPU Support + +For GPU support try the following: + +```sh +# Create a virtual env +python3 -m venv venv + +# Activate the venv +source venv/bin/active + +# Install torch with the special index +pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124 + +# Install the package +pip install -e . + +# Run the server +poetry run uvicorn docling_serve.app:app --reload +``` \ No newline at end of file From 5eacad095ac0d118282c1b9c0dc401b77bcf13eb Mon Sep 17 00:00:00 2001 From: Anil Vishnoi Date: Thu, 10 Oct 2024 23:26:16 -0700 Subject: [PATCH 3/3] Update README.md Signed-off-by: Anil Vishnoi --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 8dfde57..041e9a9 100644 --- a/README.md +++ b/README.md @@ -53,4 +53,4 @@ pip install -e . # Run the server poetry run uvicorn docling_serve.app:app --reload -``` \ No newline at end of file +```