Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Stable Diffusion 3.5 Large bf16 support #396

Open
Ilya87 opened this issue Nov 6, 2024 · 0 comments
Open

Add Stable Diffusion 3.5 Large bf16 support #396

Ilya87 opened this issue Nov 6, 2024 · 0 comments
Labels
Feature New feature or request

Comments

@Ilya87
Copy link

Ilya87 commented Nov 6, 2024

Feature Idea

I downloaded Stable Diffusion 3.5 Large in bf16 https://civitai.com/models/882666/sd35-large-google-flan with builtin clips.
I edited metadata of model to Stable Diffusion 3.5.
Try to put to unet, Stable diffusion, diff
backend #0 failed to load model with error: Model loader for sd35LargeGoogleFLAN_large3CLIPFLANBF16.safetensors didn't work - are you sure it has an architecture ID set properly?
In command line I also see nonsence message

[Warning] Your system memory usage exceeded 98.2% just before the backend process failed. This might indicate a memory overload.
 [Warning] You appear to have a sufficient pagefile (96.9 GiB), so you might have too many background processes, or you might just be trying to run too much.
 [Warning] Consider closing background processes, or greatly expanding your pagefile size.
[Warning] Or, reduce the size of what you're trying to run. If you're running an FP16 or FP8 model, consider a quantized variant like GGUF Q4

I never had 96.9 GiB pagefile. Moreover, creator of checkpoint writes "The Full BF16 model runs at an amazing speed even on my 8GB card". My card is RTX 4070. 32 GB RAM. 10000 Megabytes pagefile.

Other

Windows 11 24H2

@Ilya87 Ilya87 added the Feature New feature or request label Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant