Release 4-bit QLoRA, Paged Optimizers, and 8-bit Memory Leak Bugfix · TimDettmers/bitsandbytes

This release brings 4-bit quantization support for QLoRA fine-tuning and a critical bugfix that doubled the memory cost of 8-bit models when they were serialized. Furthermore, paged optimizers are ...