SDNext Update for for 2024-09-13

SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models - vladmandic/automatic

Major refactor of FLUX.1 support:

Full ControlNet support, better LoRA support, full prompt attention implementation
Faster execution, more flexible loading, additional quantization options, and more...
Added image-to-image, inpaint, outpaint, hires modes
Added workflow where FLUX can be used as refiner for other models
Since both Optimum-Quanto and BitsAndBytes libraries are limited in their platform support matrix,
try enabling NNCF for quantization/compression on-the-fly!

Few image related goodies...

Context-aware resize that allows for img2img/inpaint even at massively different aspect ratios without distortions!
LUT Color grading apply professional color grading to your images using industry-standard .cube LUTs!
Auto HDR image create for SD and SDXL with both 16ch true-HDR and 8-ch HDR-effect images ;)

And few video related goodies...

CogVideoX 2b and 5b variants
with support for text-to-video and video-to-video!
AnimateDiff prompt travel and long context windows!
create video which travels between different prompts and at long video lengths!

Plus tons of other items and fixes - see changelog for details!
Examples:

Built-in prompt-enhancer, TAESD optimizations, new DC-Solver scheduler, global XYZ grid management, etc.
Updates to ZLUDA, IPEX, OpenVINO...

1 comments