# Do I need token\_type\_ids for BertForSequenceClassification?

**URL:** <https://discuss.huggingface.co/t/do-i-need-token-type-ids-for-bertforsequenceclassification/1477>\
**Category:** 🤗Transformers\
**Created:** [October 12, 2020, 7:53am UTC](https://discuss.huggingface.co/t/do-i-need-token-type-ids-for-bertforsequenceclassification/1477 "2020-10-12T07:53:59Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![PhilipMay](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/philipmay/32/2324_2.png) [@PhilipMay](https://discuss.huggingface.co/u/PhilipMay)\
**Post date:** [October 12, 2020, 7:53am UTC](https://discuss.huggingface.co/t/do-i-need-token-type-ids-for-bertforsequenceclassification/1477/1 "2020-10-12T07:53:59Z")

</div>

Since token\_type\_ids are there to tell the model which is the first and which the 2nd sequence - I think I can just remove them for BertForSequenceClassification. Is that right?

---

<div class="post-metadata">

**Author:** ![BramVanroy](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/bramvanroy/32/47360_2.png) [@BramVanroy](https://discuss.huggingface.co/u/BramVanroy)\
**Post date:** [October 12, 2020, 8:00am UTC](https://discuss.huggingface.co/t/do-i-need-token-type-ids-for-bertforsequenceclassification/1477/2 "2020-10-12T08:00:13Z")

</div>

You do not need to pass them to the model in that case, no.

---

<div class="post-metadata">

**Author:** ![PhilipMay](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/philipmay/32/2324_2.png) [@PhilipMay](https://discuss.huggingface.co/u/PhilipMay)\
**Post date:** [October 12, 2020, 8:17am UTC](https://discuss.huggingface.co/t/do-i-need-token-type-ids-for-bertforsequenceclassification/1477/3 "2020-10-12T08:17:34Z")

</div>

Ok. Thanks!