Error when training Llama-3.2-3B-Instruct-Q5_K_L.gguf with Lora

John6666
Wed, 13 Aug 2025 11:05:00 +0000

GGUF is not usually well suited for fine tuning. There seems to be a way to decode GGUF and train directly, but I think your software doesn’t supports it.

Personally, I think it’s faster to find the Transoformers format weights before converted to GGUF and train using those in general.

Read full topic