Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AnimateDiff producing noise output in Comfyui #484

Open
tylerknoll opened this issue Oct 10, 2024 · 3 comments
Open

AnimateDiff producing noise output in Comfyui #484

tylerknoll opened this issue Oct 10, 2024 · 3 comments

Comments

@tylerknoll
Copy link

tylerknoll commented Oct 10, 2024

Any workflow that uses AnimateDiff produces a colorful noise like the image included. Ive tried changing every possible setting in the relevant AD nodes. My nodes and Comfyui are up to date. AD was working fine then suddenly everything was just this noise output.

After some testing it seems that the FreeNoise in sample settings for FreeInit is the culprit. I uninstalled and reinstalled AD and it was working as expected. When I changed the noise type in sample settings to FreeNoise the output was starting to resemble the Noise seen in the photo I included but nowhere near as bad. Unfortunately, the damage was done and even after I changed the settings back to default and even created a new AD loader (legacy or new) the outputs slowly get worse until they look like the image. Using mm_sd_v15_v2 btw.

12fps-LCM-AnimateDiff_00001.mp4
@Kosinkadink
Copy link
Owner

FreeNoise wouldn't cause this issue. Assuming you are using the sweetspot amount of latents at a time (16 latents/more than 16 latents with context_length 16), th n your issue stems from AD not being applied correctly.

I looked to see if ComfyUI had any updates that could potentially break AD, but didn't see anything. Could you post a screenshot of your workflow, as well as the list of custom_nodes you have installed?

@Kosinkadink
Copy link
Owner

Kosinkadink commented Oct 10, 2024

Although, your video being 0 seconds/1 frame long does make me think you are simply not using 16 latents/more than 16 latents with context_length 16, and instead gave it 1 latent.

@tylerknoll
Copy link
Author

I was using multiple latents which were also generating the noise after free noise, but I will say that I wasn't increasing the context length with more latents and I wasn't aware that 16 was the sweet spot. With that in mind I created a new workflow from scratch using 16 latents with 16 context length and got no noise but it wasn't working like it was before, it wasn't really doing anything at all. Long story short I played around with some different checkpoints and cfg and eventually got it somewhat close to where it was before and freenoise is no longer causing issues. Thankyou you so much for responding, I'm new to comfy, sorry for the noob question.
Ill include a list of my custom nodes as I am still curious to see if anything could be interacting with AD
custom nodes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants