# Setting weights as adapter weights

**URL:** <https://discuss.huggingface.co/t/setting-weights-as-adapter-weights/82205>\
**Category:** 🤗Transformers\
**Created:** [April 17, 2024, 10:43am UTC](https://discuss.huggingface.co/t/setting-weights-as-adapter-weights/82205 "2024-04-17T10:43:27Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![AfonsoSousa](https://avatars.discourse-cdn.com/v4/letter/a/5f9b8f/32.png) [@AfonsoSousa](https://discuss.huggingface.co/u/AfonsoSousa)\
**Post date:** [April 17, 2024, 10:43am UTC](https://discuss.huggingface.co/t/setting-weights-as-adapter-weights/82205/1 "2024-04-17T10:43:27Z")

</div>

I have a custom model with a T5 backbone and an additional GNN-based module. I would like to save and load just the module weights. As I understand, Transformers now has ways to handle this because of PEFT methods. How can I set my additional weights to be labeled as adapter weights for seamless saving and loading using the transformers methods (e.g., save\_pretrained() and PeftModel.from\_pretrained())?