Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] gpu-2.0.0-ls42 don't work #22

Closed
1 task done
MorganMLGman opened this issue Oct 29, 2024 · 7 comments
Closed
1 task done

[BUG] gpu-2.0.0-ls42 don't work #22

MorganMLGman opened this issue Oct 29, 2024 · 7 comments

Comments

@MorganMLGman
Copy link

Is there an existing issue for this?

  • I have searched the existing issues

Current Behavior

whisper  | [migrations] started
whisper  | [migrations] no migrations found
whisper  | ───────────────────────────────────────
whisper  |
whisper  |       ██╗     ███████╗██╗ ██████╗
whisper  |       ██║     ██╔════╝██║██╔═══██╗
whisper  |       ██║     ███████╗██║██║   ██║
whisper  |       ██║     ╚════██║██║██║   ██║
whisper  |       ███████╗███████║██║╚██████╔╝
whisper  |       ╚══════╝╚══════╝╚═╝ ╚═════╝
whisper  |
whisper  |    Brought to you by linuxserver.io
whisper  | ───────────────────────────────────────
whisper  |
whisper  | To support LSIO projects visit:
whisper  | https://www.linuxserver.io/donate/
whisper  |
whisper  | ───────────────────────────────────────
whisper  | GID/UID
whisper  | ───────────────────────────────────────
whisper  |
whisper  | User UID:    1000
whisper  | User GID:    1000
whisper  | ───────────────────────────────────────
whisper  | Linuxserver.io version: 2.0.0-ls42
whisper  | Build-date: 2024-10-27T06:41:16+00:00
whisper  | ───────────────────────────────────────
whisper  |
whisper  | [custom-init] No custom files found, skipping...
whisper  | INFO:__main__:Ready
whisper  | Connection to localhost (127.0.0.1) 10300 port [tcp/*] succeeded!
whisper  | [ls.io-init] done.
whisper  | INFO:faster_whisper:Processing audio with duration 00:10.880
whisper  | Unable to load any of {libcudnn_ops.so.9.1.0, libcudnn_ops.so.9.1, libcudnn_ops.so.9, libcudnn_ops.so}
whisper  | Invalid handle. Cannot load symbol cudnnCreateTensorDescriptor
whisper  | INFO:__main__:Ready

Expected Behavior

whisper  | [migrations] started
whisper  | [migrations] no migrations found
whisper  | ───────────────────────────────────────
whisper  |
whisper  |       ██╗     ███████╗██╗ ██████╗
whisper  |       ██║     ██╔════╝██║██╔═══██╗
whisper  |       ██║     ███████╗██║██║   ██║
whisper  |       ██║     ╚════██║██║██║   ██║
whisper  |       ███████╗███████║██║╚██████╔╝
whisper  |       ╚══════╝╚══════╝╚═╝ ╚═════╝
whisper  |
whisper  |    Brought to you by linuxserver.io
whisper  | ───────────────────────────────────────
whisper  |
whisper  | To support LSIO projects visit:
whisper  | https://www.linuxserver.io/donate/
whisper  |
whisper  | ───────────────────────────────────────
whisper  | GID/UID
whisper  | ───────────────────────────────────────
whisper  |
whisper  | User UID:    1000
whisper  | User GID:    1000
whisper  | ───────────────────────────────────────
whisper  | Linuxserver.io version: 2.0.0-ls41
whisper  | Build-date: 2024-10-20T06:40:45+00:00
whisper  | ───────────────────────────────────────
whisper  |
whisper  | [custom-init] No custom files found, skipping...
whisper  | INFO:__main__:Ready
whisper  | Connection to localhost (127.0.0.1) 10300 port [tcp/*] succeeded!
whisper  | [ls.io-init] done.
whisper  | INFO:faster_whisper:Processing audio with duration 00:15.000
whisper  | INFO:wyoming_faster_whisper.handler: Dziękuje za oglądanie.
whisper  | INFO:faster_whisper:Processing audio with duration 00:15.000
whisper  | INFO:wyoming_faster_whisper.handler: Dziękuje za oglądanie.
whisper  | INFO:faster_whisper:Processing audio with duration 00:02.080
whisper  | INFO:wyoming_faster_whisper.handler: Jaki jest dziś dzień

Steps To Reproduce

update container

Environment

- OS: Ubuntu 24.04
- How docker service was installed: distro's packagemanager

CPU architecture

x86-64

Docker creation

whisper:
    image: lscr.io/linuxserver/faster-whisper:gpu-2.0.0-ls41
    container_name: whisper
    environment:
      - PUID=$PUID
      - PGID=$PGID
      - TZ=$TZ
      - WHISPER_MODEL=large-v3
      - WHISPER_BEAM=2 #optional
      - WHISPER_LANG=pl #optional
      - NVIDIA_VISIBLE_DEVICES=all
      - NVIDIA_DRIVER_CAPABILITIES=compute,video,utility
    deploy:
      resources:
        reservations:
          devices:
            - capabilities: [gpu]
    volumes:
      - $DOCKER_APPS_DIR/whisper:/config
    ports:
      - 10300:10300
    restart: unless-stopped
    labels:
      - "com.centurylinklabs.watchtower.enable=true"


### Container logs

```bash
already uploaded
@github-actions GitHub Actions
Copy link

Thanks for opening your first issue here! Be sure to follow the relevant issue templates, or risk having this issue marked as invalid.

@thespad
Copy link
Member

thespad commented Oct 29, 2024

Looks like ctranslate2 has updated to only support CUDNN 9 but faster-whisper only supports CUDNN 8 so we might have to pin it.

@thespad thespad mentioned this issue Oct 29, 2024
Merged
1 task
@thespad
Copy link
Member

thespad commented Oct 29, 2024

Pushing two builds to #23, image names will get posted by the bot once they're available.

First pins ctranslate2 to 4.4.0 with CUDNN 8
Second upgrades CUDNN to 9.

Various linked discussion from SYSTRAN/faster-whisper#1086 suggests faster whisper should work with ctranslate 4.5.0 despite what the docs say, so that one would be preferable rather than pinning ctranslate2 to an older version.

Please can you test them and let me know if one/both/neither work for you.

@MorganMLGman
Copy link
Author

ghcr.io/linuxserver/lspipepr-faster-whisper:gpu-2.0.0-pkg-b2138dcc-dev-550713281c67d3de93e9724577979e887a40ccdc-pr-23

Works

whisper  | [migrations] started
whisper  | [migrations] no migrations found
whisper  | ───────────────────────────────────────
whisper  |
whisper  |       ██╗     ███████╗██╗ ██████╗
whisper  |       ██║     ██╔════╝██║██╔═══██╗
whisper  |       ██║     ███████╗██║██║   ██║
whisper  |       ██║     ╚════██║██║██║   ██║
whisper  |       ███████╗███████║██║╚██████╔╝
whisper  |       ╚══════╝╚══════╝╚═╝ ╚═════╝
whisper  |
whisper  |    Brought to you by linuxserver.io
whisper  | ───────────────────────────────────────
whisper  |
whisper  | To support LSIO projects visit:
whisper  | https://www.linuxserver.io/donate/
whisper  |
whisper  | ───────────────────────────────────────
whisper  | GID/UID
whisper  | ───────────────────────────────────────
whisper  |
whisper  | User UID:    1000
whisper  | User GID:    1000
whisper  | ───────────────────────────────────────
whisper  | Linuxserver.io version: 2.0.0-pkg-b2138dcc-dev-550713281c67d3de93e9724577979e887a40ccdc-pr-23
whisper  | Build-date: 2024-10-29T09:22:43+00:00
whisper  | ───────────────────────────────────────
whisper  |
whisper  | [custom-init] No custom files found, skipping...
whisper  | INFO:__main__:Ready
whisper  | Connection to localhost (127.0.0.1) 10300 port [tcp/*] succeeded!
whisper  | [ls.io-init] done.
whisper  | INFO:faster_whisper:Processing audio with duration 00:02.150
whisper  | INFO:wyoming_faster_whisper.handler: Jaki mamy dziś dzień?

@MorganMLGman
Copy link
Author

ghcr.io/linuxserver/lspipepr-faster-whisper:gpu-2.0.0-pkg-b2138dcc-dev-f3a49ddf041bf5ebabd973b04027986e0cc3c451-pr-23

Also works

whisper  | [migrations] started
whisper  | [migrations] no migrations found
whisper  | ───────────────────────────────────────
whisper  |
whisper  |       ██╗     ███████╗██╗ ██████╗
whisper  |       ██║     ██╔════╝██║██╔═══██╗
whisper  |       ██║     ███████╗██║██║   ██║
whisper  |       ██║     ╚════██║██║██║   ██║
whisper  |       ███████╗███████║██║╚██████╔╝
whisper  |       ╚══════╝╚══════╝╚═╝ ╚═════╝
whisper  |
whisper  |    Brought to you by linuxserver.io
whisper  | ───────────────────────────────────────
whisper  |
whisper  | To support LSIO projects visit:
whisper  | https://www.linuxserver.io/donate/
whisper  |
whisper  | ───────────────────────────────────────
whisper  | GID/UID
whisper  | ───────────────────────────────────────
whisper  |
whisper  | User UID:    1000
whisper  | User GID:    1000
whisper  | ───────────────────────────────────────
whisper  | Linuxserver.io version: 2.0.0-pkg-b2138dcc-dev-f3a49ddf041bf5ebabd973b04027986e0cc3c451-pr-23
whisper  | Build-date: 2024-10-29T09:28:25+00:00
whisper  | ───────────────────────────────────────
whisper  |
whisper  | [custom-init] No custom files found, skipping...
whisper  | INFO:__main__:Ready
whisper  | Connection to localhost (127.0.0.1) 10300 port [tcp/*] succeeded!
whisper  | [ls.io-init] done.
whisper  | INFO:faster_whisper:Processing audio with duration 00:02.110
whisper  | INFO:wyoming_faster_whisper.handler: Jak nam jeździ?
whisper  | INFO:faster_whisper:Processing audio with duration 00:02.660
whisper  | INFO:wyoming_faster_whisper.handler: Jaki mamy dziś dzień?

@thespad
Copy link
Member

thespad commented Oct 29, 2024

Thanks for testing, I'll get the PR reviewed and merged shortly.

@thespad
Copy link
Member

thespad commented Oct 29, 2024

Fixed via #23

@thespad thespad closed this as completed Oct 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
Issue & PR Tracker
Status: Done
Milestone
No milestone
Development

No branches or pull requests
2 participants
@thespad @MorganMLGman