I am trying to build a multi-label, multi-class classification model. Any input text can have zero or more labels, up to 11 possible classes. I have been trying to use the problem_type="multi_label_classification" and everything looks OK, but I get ValueError: Target size (torch.Size([16, 11])) mus…

Changes needed to run the above code are below: model = AutoModelForSequenceClassification.from_pretrained( “bert-base-uncased”, problem_type=“multi_label_classification”, num_labels=5 ) and changing label to make it float: labels = [ [0.0, 0.0, 0.0, 0.0, 1.0], [1.0, 0.0, 0.0, 0.0,…

Mismatched target and input size for BCE using "multi_label_classification"

Intermediate

sgugger July 27, 2021, 1:16pm 2

When defining your model, you did not specify the number of labels (with num_labels=xxx).

Most efficient multi-label classifier?

Topic		Replies	Views
ValueError: Target size (torch.Size([8])) must be the same as input size (torch.Size([8, 3])) Beginners	0	658	December 20, 2022
Target size (torch.Size([8])) must be the same as input size (torch.Size([8, 2])) 🤗Transformers	5	5793	October 13, 2023
Target size (torch.size([16])) must be the same as input size (torch.size([16, 9])) Beginners	1	1067	December 20, 2022
ValueError: Target size (torch.Size([8])) must be the same as input size (torch.Size([8, 8])) Beginners	15	12799	January 9, 2025
Custom BCEWithLogitsLoss for Sequence Classification using Auto Model Beginners	1	132	May 26, 2025

Mismatched target and input size for BCE using "multi_label_classification"

Related topics