Add GPU support instructions

- Validated on an EC2 GPU instance to work.
- Closes #8

Signed-off-by: Brent Salisbury <[email protected]>

README.md

@@ -33,3 +33,24 @@ curl -X 'POST' \
   }
 }'
 ```
+
+### Cuda GPU Support
+
+For GPU support try the following:
+
+```sh
+# Create a virtual env
+python3 -m venv venv
+
+# Activate the venv
+source venv/bin/active
+
+# Install torch with the special index
+pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124
+
+# Install the package
+pip install -e .
+
+# Run the server
+poetry run uvicorn docling_serve.app:app --reload
+```