Hi all! Looking to fine-tune a model for QA/Text-Generation (not sure how to frame this) and I’m wondering how to best prepare the dataset in a way that I can feed multiple answers to the same question? My goal is to facilitate the creation of a unique answer to a given question that is based on t…

Maybe @valhalla has some pointers?

hi @enrico ! I can think of two approaches text generation/text2text Hear as you said you could feed the question and multiple answers to the model and ask it to generate the correct answer. One way to prepare the dataset for this is to use some delimiter tokens to separate the answers. For ex. …

Thank you @valhalla leaning towards the first idea. Will give this a try

Maybe you could try also this solution https://huggingface.co/qa/

@cahya thanks a lot! Looks really interesting didn’t know about it!

Hello can i use multiple context in a question and answer huggingface api?? I am actually trying to make a context that involves several paragraphs about all the past 46 US presidents and I cannot seem to put all those under a single context. Can you please help me ???

Hi there, If I understood your situation, you have a context, questions and answers, but your context is too big to feed the model in one passage. I suggest you to take a look on Hugging Face’s question answering example notebook . They manage to solve this problem splitting up the context in sever…

Question-Answering/Text-generation/Summarizing: Fine-tune on multiple answers

Beginners

cahya December 18, 2020, 10:02am 7

@enrico please have a look also on the discussion we had about it Demo of Open Domain Long Form Question Answering

Topic		Replies	Views
Simple generative question answering with context Beginners	5	3336	August 16, 2024
Train a t5 model 🤗Transformers	1	294	September 4, 2023
Fine Tune text generation Model using different type of data 🤗Transformers	0	397	August 1, 2023
How can I put multiple questions in the same context at once using Question-Answering technique (i’m using RoBerta)? Beginners	1	555	March 4, 2023
Strange answer from api 🤗Transformers	0	651	January 10, 2022

Question-Answering/Text-generation/Summarizing: Fine-tune on multiple answers

Related topics