Loading txt2img LoRA after training leads to noise images

justin
Wed, 28 Aug 2024 23:13:22 +0000

This was caused by two things:

the LoRA examples in diffusers are not all up-to-date, I copied from an SD example, but it seems only the SDXL examples get appropriate love

there was still a slight discrepency in outputs after fixing the saving/loading of LoRA weights caused by not upcasting the LoRA weights properly when saving them at the end of training.