Gpt-oss training on A100 - OOM error

DhineshR
Sat, 22 Nov 2025 08:00:23 +0000

I’d suggest checking the number of GPUs you have and make sure they are as expected by running nvidia-smi.

If you want to only use one GPU, try setting CUDA_VISIBLE_DEVICES=0 environment variable when running the training script.

However, I believe 80GB is not enough to fientune gpt-oss 20B at bf16 precision. There are many guides available online that would help you estimate the amount of memory required to fine-tune. I’d suggest performing those calculations for your use case.