# Loading weights straight to GPU & Training support

**URL:** <https://discuss.huggingface.co/t/loading-weights-straight-to-gpu-training-support/55517>\
**Category:** 🤗Accelerate\
**Created:** [September 18, 2023, 8:02pm UTC](https://discuss.huggingface.co/t/loading-weights-straight-to-gpu-training-support/55517 "2023-09-18T20:02:01Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![pratogab](https://avatars.discourse-cdn.com/v4/letter/p/bbce88/32.png) [@pratogab](https://discuss.huggingface.co/u/pratogab)\
**Post date:** [September 18, 2023, 8:02pm UTC](https://discuss.huggingface.co/t/loading-weights-straight-to-gpu-training-support/55517/1 "2023-09-18T20:02:01Z")

</div>

Going through the doc, accelerate currently does not seem to support loading weights straight to the GPU if the model is to be used for training. If this is correct, are there any plans to support this in the future?