I received a couple of feedback on this publish associated to the Spiral illusions which can be all the fad in the mean time utilizing SD1 QRCode Monster ControlNet mannequin. It appears that evidently there will not be sufficient ControlNet based mostly ComfyUI interfaces out there on the net. Should you use A1111 then it’s best to take a look at this publish.
So I trying right into a bit and located one or two however not ones particularly that can allow you to create such photos and even upscale their measurement.
So while you see a necessity, fill a necessity – Bigweld from Robots film.
I spent a while constructing ComfyUI workflows that can help you simply use the control_v1p_sd15_qrcode_monster mannequin.
The objective I set myself was to create 3 totally different variations: standalone fundamental, standalone with upscaler and standalone with Final SD Upscale.
Spiral Phantasm and extra (Tutorial)
The method is sort of easy when you’ve got the essential SD A1111 setup working domestically or hosted.
– obtain the mannequin control_v1p_sd15_qrcode_monster
– discover the spiral vector picture you want
– allow hires.repair in A1111
– Allow CN, set CN weight to… pic.twitter.com/Cd6OxfGLDV— Harmeet Gabha 🇦🇺 (@HarmeetGabha) September 17, 2023
Standalone Primary
The essential setup in ComfyUI contains all of the nodes to create an ControNet influenced picture that can embed the spiral, or different picture or textual content you need by supplying your Management picture, setting its power (ie affect within the subtle picture) after which your prompts to create the specified picture. You’ll be able to tweak the picture width and peak in addition to a batch measurement.
Default immediate: Medieval village scene with busy streets and chateau within the distance, french countryside, city sq.
Obtain the rename the file to .JSON extension solely (take away .TXT)
Standalone with Upscaler
This model contains all of what was in fundamental however as well as enabled the upscaler which can upscale the picture based mostly on the upscaler chosen. Therefore you may simply create giant measurement photos resembling 2048 x 2048 px.
Obtain the rename the file to .JSON extension solely (take away .TXT)
Standalone with Final SD Upscale
This model contains all of what was in fundamental however as well as enabled the Final SD Upscale node (hyperlink contains set up directions) which presents extra management on the upscale the place you may management the power of the diffusion throughout upscale, upscale multiplier (upscale_by), steps and sampler and many others. Default settings that this comes with will allow you to upscale by 2x and can work nicely for many instances. Be aware that this can be a extra superior node and upscaler so that you want slightly bit extra information on the way it works or prior expertise of utilizing it in Automatic1111.
Obtain the rename the file to .JSON extension solely (take away .TXT)
Pleased to assist when you’ve got any questions or feedback depart them under. Should you get the this type of RuntimeError: mat1 and mat2 shapes can’t be multiplied (154×1024 and 768×320) then it means the mannequin you’re utilizing is just not suitable with ControlNet so you’ll want to use one other that’s SD v1.5 suitable.