Question answeirng Fine tuning

Berny93
Fri, 31 May 2024 07:57:20 +0000

Hello. I need to do fine tuning to extract some fields from invoices (text extracted from invoices); some pretrained models such as distilled-bert require a dataset with the content, questions, the answers and the start_id of the answer. I have a dataset containing only text extracted (the content) and the answers but not the start_id. How can I overcome this limitation? Do you know other ways or models requiring only quesions and answers as dataset?