GGUF
English

How to use it with huggingface diffusers?

#2
by hemantp66 - opened

Please give any example code to guide me how to use this with diffusers ?

Hi, I found out a way of running this model on <4gb Vram. And I have not used any quantization.
Repo: https://github.com/Jit-Roy/WeeLLM
Use this, there is a kaggle link diretly , run that code to use with diffusers.

Sign up or log in to comment