Hello everyone, I’m working on a project where I need to create a fine-tuned model that can take a sentence as input and output scores for a group of labels. I have a labeled dataset with 10,000 records, but I’m unsure how to handle the label columns. Specifically, I need guidance on how to convert…

Here is one approach. This just allocates a sequential number to each category. [image] Google Colaboratory

Thank you, that was really helpful! However, my dataset contains around 255 unique labels. Converting all of them to numerical values isn’t practical. How can I address this issue? i think it is zero shot classification task I’m not sure

Why isn’t it practical to convert all of them to numerical values? If you don’t want to, you can use zero-shot classification like in the following link but the result may not be as good. https://huggingface.co/docs/transformers/v4.35.0/en/main_classes/pipelines#transformers.ZeroShotClassificationP…

Thanks, I’ve converted the labels to numerical values. Now, I’m wondering if it’s possible to fine-tune a zero-shot classification model. If so, could you please share a link or guide me on how to do it? or i must use the pipeline directly without fine tune

https://huggingface.co/docs/transformers/tasks/sequence_classification Yes, it is possible to finetune a zero-shot classification model as explained in the link above. It is also possible to use a pretrained model.

Thank you for the information. I believe the first link is for text classification, not specifically designed for zero-shot classification. Can you clarify if there’s any difference in fine tuned between the two? I want a zero-shot Also, when fine-tuning a zero-shot classification model, what shoul…

https://huggingface.co/proxy/discuss.huggingface.co/t/new-pipeline-for-zero-shot-text-classification/681/14#:~:text=Thanks%20for%20the,add%20a%20bit%3A The link above describes the finetuning of zero-shot models. The difference between finetuning of sequences and NLI is that the former uses a custom number of labels and…

Fine tuned multiclass model

Beginners

MattiLinnanvuori November 11, 2023, 9:05am 8

https://huggingface.co/proxy/discuss.huggingface.co/t/fine-tuning-zero-shot-models/15338 The link above may be better.

Topic		Replies	Views
Zero-shot classification fine-tuning Beginners	2	1298	March 18, 2022
Fine tune Zero-shot classification on multi-label dataset Models	4	3869	November 30, 2023
Zero shot classification with manual pytorch Beginners	0	759	August 27, 2021
Fine-tuning Zero-shot models Intermediate	4	6424	February 7, 2023
Is it possible to fine tune zero shot text classification model for our data set? Beginners	0	243	June 19, 2023

Fine tuned multiclass model

Related topics