RuntimeError: CUDA error: operation not supported from ComfyUI

[kienerj]

I'm trying to run SwarmUI on Ubuntu 22.04. after the installation went trough and trying to generate an imgae with flux (dev or schnell, same issue) I get an error:

ComfyUI execution error: CUDA error: operation not supported
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

The installed driver from nvida is 550.54.15 with Cuda 12.4 support.

This was right after SwarmUi launched after installation. I can use automatic1111 or fooocus just fine but these run each in their own conda environment so with SwarmUI installer I'm not all that clear were the stuff is running, do I need cuda toolkit install on OS-level or om what python environment is comfy-ui actually running?

[kienerj]

I found a solution here.

The flag --disable-cuda-malloc needs to be passed to ComfyUI

In SwarmUI interface I was able to set this under:

Server->Backends_>ExtraArgs

and then restart the backend and the error was gone and I can generate images.