How are you deploying models without inference providers?

unmodeled-tyler
Sat, 31 Jan 2026 21:38:13 +0000

For the most part, they get served locally. But I think it also depends greatly on the project though. The average user on hugging face is browsing models they can download to run on llama.cpp, ollama, LM Studio, or other local inference apps for themselves.

If a user doesn’t have the compute on prem to run the models they want to locally, then they could download the model from hugging face, rent their own servers and run inference that way.

The inference providers on hugging face just provide a curated selection of open source models, but you can run inference on them literally however you want to. That’s the beauty of open source.