Multi-gpu inference llama-3.2 vision with QLoRA

BenjaminB
Fri, 25 Apr 2025 16:12:54 +0000

If could open an issue on PEFT (GitHub · Where software is built) and provide a full reproducer, we will be happy to look into this. Please also attach the full error message.