What is the text dataset format for fintune LLM?

Mustafa21
Wed, 07 Jun 2023 10:02:43 +0000

i want to finetune a LLM on my own dataset that focus on specific subject

i have thousnds of text files about this subject

what is the required dataset format for LLM?

is it just text file?

i have converted some of them to Q&A in json format like this
{
Q:“Question”
A:“Answer”
ID:"QuestionID "
}