How to choose dataset_text_field in SFTTrainer hugging face for my LLM model

pranil51
Tue, 27 Aug 2024 06:46:10 +0000

You need to provide a prompt for the LLM model and not the questions. For each row, you will need a prompt containing your question and answer. e.g. “”" Question: Which is the largest country.\n Answer: Russia"“”. This is just a demo. You can design your prompt and use the map function over your dataset to create a prompt column. You can refer to the notebook on Unsloth’s GitHub repo where they have trained llama 3.1 8b.

Read full topic