Add a subset to a dataset from CLI?

John6666
Wed, 05 Feb 2025 15:26:09 +0000

The latter is in Japanese, so it may be a little difficult to read. Google translate it…
I think that in the past, creating a loading_script was the best thing to do. Now, it may be smarter to use a custom DatasetBuilder.

How to create subset when pushing to hub 🤗Datasets

Hey! I have a dataset of image and text, and I am trying to upload it to the hub using the script below. I was wondering how to create a subset, because everything is been put in “gabrielsantosrv–pracegover” subset. Thanks in advance from datasets import Dataset, load_dataset from PIL import Image import io import json def try_load_image(filepath): try: with open(filepath, 'rb') as f: image = Image.open(io.BytesIO(f.read())) if isinstance(image, Image…

Zenn

HuggingFace datasetsのBuilder classを使ってデータセットを自作する

Read full topic