Secure Video Diffusion as I lined in an earlier submit about its launch (Secure Video Diffusion utilizing ComfyUI) is quickly taking on the web however not simply that additionally my workflow. I discover myself enjoying round with numerous Picture-to-Video setups and up to now considered one of my favorite is a modified model from Nuralunk.
The workflow makes use of SVD + SDXL mannequin mixed with LCM LoRA which you’ll be able to obtain (Latent Consistency Mannequin (LCM) SDXL and LCM LoRAs) and use it to create animated GIFs or Video outputs.
There some Customized Nodes utilised so should you get an error, simply set up the Customized Nodes utilizing ComfyUI Supervisor.
SDXL LCM LoRA SVD Workflow (11 downloads)
Choose the picture you wish to animate, outline the SDXL dimensions you need eg. 1316 x 832px which would be the dimensions for the ultimate animated video. By default, the workflow is setup to create 25 frames and create a 6 body per second (FPS) GIF. Nonetheless, you may push to increased FPS, I’ve been in a position to go as much as 24 FPS in a few of my experiments.
In my experimentation I set the motion_bucket_id to numerous values resembling 128, 192, 256 (simply caught with 64x multiples), nonetheless you may attempt any values you want.
The Video Mix node, additionally has a enjoyable function which is known as pingpong which mainly creates a looping outcomes by going ahead after which again by the frames generated, which supplies a pleasant end result. Earlier than I found this selection I used to be utilizing exterior video instrument to loop the video however that is such a time saver. It additionally means you find yourself with twice as lengthy clip.
Showcase of the Outcomes
I uploaded a number of pictures that I had from created and began to experiment with them. Beneath you will note many outcomes produced as MP4 video and GIF pictures. Fascinating how in some pictures SVD makes the topic blink.
I hope this conjures up you to create your individual animated clips or GIFs utilizing this workflow. Don’t overlook to share your outcomes through the feedback beneath, I’d like to see what you create. You may all the time tag me or WWAI_Art X handles.