Inference after QLoRA fine-tuning

rohit103
Wed, 05 Jun 2024 21:03:18 +0000

Hello Niels,

Thank you for sharing.

Did you ever try to compare QLoRA with QA-LoRA in terms of speed and accuracy during the inference time?

I would greatly appreciate sharing your experiences.

Best,
Rohit