Invalid key for dataset -- is this a bug with Trainers or with my code?

notrichardren
Mon, 24 Jul 2023 16:58:02 +0000

The problem was that in this context, removed_unused_columns = True seems to delete the entire dataset for a custom loss func.

This seems to be a bug and not the default behavior, so I reported it to huggingface/transformers.

Read full topic