hi, i’m using HuggingFace for multi-label classification. i am curious if there is a way to change/customize the classifier head on top? and second question is, the default type of classifier is linear. i heard of classifiers like SVM, decision tree etc. can anyone explain their connection? between …

You can extend a pretrained model with your own layers as much as you want. Something like this can work: class BertCustomClassification(BertPreTrainedModel): def __init__(self, config): super().__init__(config) self.num_labels = config.num_labels self.bert = BertModel(…

Thanks, but i don’t know how should i use this and where should i call it. i don’t know what kind of classifiers can i use instead of default linear classifier and how to implement? this is a part of my code: max_length = 50 tokenizer = BartTokenizer.from_pretrained('facebook/bart-large', do_lower_…

How to change the linear classifier?

Beginners

newbie001 February 22, 2022, 3:24am 4

@BramVanroy I am attempting to do something similar. Can you provide some feedback about Extending a pretrained model ?

Topic		Replies	Views
How do I change the classification head of a model? 🤗Transformers	31	54087	November 14, 2024
What is the classification head doing exactly? 🤗Transformers	16	25839	November 4, 2024
Always only a single Linear layer as the classification head? 🤗Transformers	0	372	February 23, 2023
Multiple layers in the classifier for NER in BERT models 🤗AutoTrain	0	98	August 15, 2024
Fine-Tune BERT with two Classification Heads "next to each other"? Beginners	3	2999	September 17, 2021

How to change the linear classifier?

Related topics