Inference after QLoRA fine-tuning

sade-adrien
Tue, 03 Oct 2023 20:43:08 +0000

This should help:

kaitchup.substack.com

LoRA Adapters: When a Naive Merge Leads to Poor Performance

The case of LoRA adapters fine-tuned with QLoRA