Gpt-oss training on A100 - OOM error

clementlr
Wed, 26 Nov 2025 17:35:14 +0000

DhineshR:

CUDA_VISIBLE_DEVICES

Dear DhineshR, thanks for your feedback.
In OpenAI cookbook documentation they state that:

***Note: This notebook is designed to be run on a single H100 GPU with 80GB of memory. If you have access to a smaller GPU, you can reduce the batch size and sequence length in the hyperparameters below.

I tried additional HW set up testing with Nvidia H100 and Nvidia 4xA10G large (which comes with 92 GB VRAM). In both cases I still get OOM error.

Any other idea ? Tx