Inference after QLoRA fine-tuning

Pavansatish
Fri, 07 Jun 2024 15:11:55 +0000

hey can you help me?

There is an issue while running on my local Mac machine. When changing the model name from “microsoft/DialoGPT-small” to “meta-llama/Meta-Llama-3-8B”, the machine is hanging and no response.

GitHub Link