API access

[Googlepuss]

I currently have Automatic1111 set as image generation in the open-webui front end. I would like to move that function over to SwarmUI (I enjoy what you all are doing here). I am having a hard time figuring out if the comfyui backends can be accessed by API. I see there is a comfyuiwebapi.md and I see that the backends have pulled a DHCP address on my local network (not the address set as static on the server SwarmUI is running on. the ports on these start 7820, and it looks like comyui default API port is 8188. I have tried a few combinations of server IP, backend IP, and ports, but no joy. Is this intended functionality? am i missing a step? i did not see a "--api" option on launch or under server settings in the UI. Thanks!

[mcmonkey4eva]

Swarm's API is documented here: https://github.com/mcmonkeyprojects/SwarmUI/blob/master/docs/API.md
If you want to bypass Swarm and grab directly into the Comfy backend, you'd want URL (Your Swarm Server)/ComfyBackendDirect which is a direct passthrough

[Googlepuss]

Thanks. "(Your Swarm Server)/ComfyBackendDirect", this change allowed the openwebui instance access the comfyui backend.

My issue currently is related to the workflow file I think. Can you take a look at the logs below and let me know if I am on the right track? I see 'NoneType' attribute error at the bottom, but not certain this is the only issue, or that it is directly related to the workflow file. if so, so you all have a default file to work form as a starting point?

2024-09-16 15:40:09.145 [Info] Sent Comfy backend direct prompt requested to backend #0 (from user local)
2024-09-16 15:40:09.151 [Warning] [ComfyUI-0/STDERR] Traceback (most recent call last):
2024-09-16 15:40:09.152 [Warning] [ComfyUI-0/STDERR] File "/home/xxxxxx/SwarmUI/dlbackend/ComfyUI/execution.py", line 323, in execute
2024-09-16 15:40:09.153 [Warning] [ComfyUI-0/STDERR] output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
2024-09-16 15:40:09.154 [Warning] [ComfyUI-0/STDERR] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-09-16 15:40:09.156 [Warning] [ComfyUI-0/STDERR] File "/home/xxxxxx/SwarmUI/dlbackend/ComfyUI/execution.py", line 198, in get_output_data
2024-09-16 15:40:09.159 [Warning] [ComfyUI-0/STDERR] return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
2024-09-16 15:40:09.163 [Warning] [ComfyUI-0/STDERR] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-09-16 15:40:09.166 [Warning] [ComfyUI-0/STDERR] File "/home/xxxxxx/SwarmUI/dlbackend/ComfyUI/execution.py", line 169, in _map_node_over_list
2024-09-16 15:40:09.169 [Warning] [ComfyUI-0/STDERR] process_inputs(input_dict, i)
2024-09-16 15:40:09.171 [Warning] [ComfyUI-0/STDERR] File "/home/xxxxxx/SwarmUI/dlbackend/ComfyUI/execution.py", line 158, in process_inputs
2024-09-16 15:40:09.173 [Warning] [ComfyUI-0/STDERR] results.append(getattr(obj, func)(**inputs))
2024-09-16 15:40:09.174 [Warning] [ComfyUI-0/STDERR] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-09-16 15:40:09.176 [Warning] [ComfyUI-0/STDERR] File "/home/xxxxxx/SwarmUI/dlbackend/ComfyUI/nodes.py", line 540, in load_checkpoint
2024-09-16 15:40:09.178 [Warning] [ComfyUI-0/STDERR] out = comfy.sd.load_checkpoint_guess_config(ckpt_path, output_vae=True, output_clip=True, embedding_directory=folder_paths.get_folder_paths("embeddings"))
2024-09-16 15:40:09.179 [Warning] [ComfyUI-0/STDERR] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-09-16 15:40:09.181 [Warning] [ComfyUI-0/STDERR] File "/home/xxxxxx/SwarmUI/dlbackend/ComfyUI/comfy/sd.py", line 522, in load_checkpoint_guess_config
2024-09-16 15:40:09.183 [Warning] [ComfyUI-0/STDERR] sd = comfy.utils.load_torch_file(ckpt_path)
2024-09-16 15:40:09.184 [Warning] [ComfyUI-0/STDERR] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-09-16 15:40:09.184 [Warning] [ComfyUI-0/STDERR] File "/home/xxxxxx/SwarmUI/dlbackend/ComfyUI/comfy/utils.py", line 33, in load_torch_file
2024-09-16 15:40:09.185 [Warning] [ComfyUI-0/STDERR] if ckpt.lower().endswith(".safetensors") or ckpt.lower().endswith(".sft"):
2024-09-16 15:40:09.186 [Warning] [ComfyUI-0/STDERR] ^^^^^^^^^^
2024-09-16 15:40:09.187 [Warning] [ComfyUI-0/STDERR] AttributeError: 'NoneType' object has no attribute 'lower'
2024-09-16 15:40:09.189 [Warning] [ComfyUI-0/STDERR]

[mcmonkey4eva]

you should probably join the swarm discord and post in the help channel there https://discord.gg/q2y38cqjNw

But that error looks like a model failed to load, exact reason why hard to tell without more context

[Googlepuss]

Thanks! I will join the discord for future usage help. The above was related to exporting the workflow API file from swarm and placing it in openwebui. I am not getting the image returned to openwebui, but have the model loading correctly now.

Thanks again for the feedback.