Use this topic for any question about Chapter 5 of the course.

Hello everyone, I am very new to the topic, so sorry if this question is obvious. I’d like to start working on this task (Chapter 5 - Time to slice and dice ): Use the techniques from Chapter 3 to train a classifier that can predict the patient condition based on the drug review. Since this labe…

Hey @juancopi81 what I had in mind was the second approach you describe - treat each condition as a label and try to train a multiclass classifier. Given so many labels, you might want to explore top-k accuracy as a metric, but the main goal of the exercise is to give you some practice training mode…

Hi there, the last “Try it out!” task here asks us to “create an own dataset of GitHub issues” and to “fine-tune a multilabel classifier” (for bonus points :wink:). I have created this dataset . It has 57 different labels and an instance may be labelled with any combination of those. I would like…

Hey @mdroth as a hint, you can checkout the problem_type parameter of TrainingArguments - this allows you to configure the loss for multilabel problems :slight_smile: You might also want to check out, the code associated with Chapter 9 of the our book , which covers a similar topic: notebooks/09_few…

Hi @lewtun , unfortunately, I couldn’t find find a problem_type parameter in the documentation of TrainingArguments (I am using transformers.__version__ = '4.17.0'). I do not want to bomb this topic with my very specific issue, so I created a new topic here . I am also still curious about adding the …

When doing: from datasets import load_dataset data_files = "https://mystic.the-eye.eu/public/AI/pile_preliminary_components/PUBMED_title_abstracts_2019_baseline.jsonl.zst" pubmed_dataset_streamed = load_dataset( "json", data_files=data_files, split="train", streaming=True ) and next(iter(pu…

Apologies if this has been addressed elsewhere, but when I try to load the dataset, I got the below erro: from datasets import load_dataset # This takes a few minutes to run, so go grab a tea or coffee while you wait :) data_files = "https://mystic.the-eye.eu/public/AI/pile_preliminary_components/…

Thanks a lot @Teme - it seems like the Pile did indeed shift location! I’ve included your fix here: Fix URL to the Pile by lewtun · Pull Request #324 · huggingface/course · GitHub

Hi everyone! I’m looking through the 5th chapter and just wanted to ask. In the Creating your own dataset part when looping over the pages in the fetch_issues function is there a reason why it’s tqdm(range(num_pages)) instead of just trange(num_pages)?

Chapter 5 questions

Course

mdroth May 23, 2022, 5:50am 27

Solved.

Topic		Replies	Views
Fetching rows of a large Dataset by index 🤗Datasets	10	1723	March 15, 2021
.get_nearest_examples() throws ArrowInvalid: offset overflow while concatenating arrays 🤗Datasets	4	3169	September 30, 2020
Image dataset performance when using map 🤗Datasets	2	175	February 28, 2026
Correct way to create a Dataset from a csv file Beginners	13	14616	March 25, 2022
Loading Custom Datasets 🤗Datasets	7	11004	May 25, 2021

Chapter 5 questions

Related topics