Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,308

Base only

Active filters: GGUF

tsunemoto/Nous-Hermes-2-Yi-34B-GGUF

34B • Updated Dec 26, 2023 • 276 • 1

andrijdavid/Mistral-T5-7B-v1-GGUF

Text Generation • Updated Dec 27, 2023 • 10

andrijdavid/Marcoroni-7B-v3-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 262

andrijdavid/mindy-7b-v2-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 178

andrijdavid/supermario-v2-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 144

andrijdavid/CatPPT-base-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 179 • 1

andrijdavid/LMCocktail-10.7B-v1-GGUF

Text Generation • 11B • Updated Dec 27, 2023 • 146 • 1

andrijdavid/Sakura-SOLAR-Instruct-GGUF

Text Generation • 11B • Updated Dec 28, 2023 • 128 • 1

tsunemoto/TinyLlama-1.1B-Chat-v0.6-x8-MoE-GGUF

6B • Updated Dec 29, 2023 • 562 • 6

andrijdavid/CarbonVillain-en-10.7B-v2-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 168

andrijdavid/StopCarbon-10.7B-v5-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 183 • 1

LiteLLMs/CarbonVillain-en-10.7B-v3-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 236

yargpt/vicuna-13b-v1.5-gguf

Text Generation • 13B • Updated Jan 2, 2024 • 10 • 1

andrijdavid/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Jan 19, 2024 • 734 • 2

andrijdavid/finance-chat-GGUF

Text Generation • 7B • Updated Jan 19, 2024 • 209 • 4

andrijdavid/TinyLlama-1.1B-32k-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 270

andrijdavid/MobileLLaMA-1.4B-Base-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 866 • 3

andrijdavid/tinyfrank-1.4B-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 114

andrijdavid/MiniMA-2-3B-GGUF

Text Generation • 3B • Updated Jan 2, 2024 • 182

Trelis/Tiny

Text Generation • 1B • Updated Feb 22, 2024 • 7

tsunemoto/FlatDolphinMaid-8x7B-GGUF

47B • Updated Jan 4, 2024 • 456

rabil/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated Jan 4, 2024 • 126

tsunemoto/Norobara-ZLoss-8x7B-GGUF

47B • Updated Jan 5, 2024 • 428

rabil/deepseek-coder-6.7b-instruct-llamafile

Updated Jan 5, 2024 • 31 • 3

rabil/dolphin-2_6-phi-2-llamafile

Updated Jan 7, 2024 • 63

tsunemoto/LiteLlama-460M-1T-GGUF

0.5B • Updated Jan 7, 2024 • 292 • 6

rabil/openchat-3.5-0106-llamafile

Updated Jan 11, 2024 • 59

tuantran1632001/Psyfighter2-Orca2-13B-ties-GGUF

13B • Updated Jan 12, 2024 • 451

sethuiyer/MedleyMD-GGUF

13B • Updated Jan 15, 2024 • 30 • 1

tsunemoto/NexoNimbus-7B-GGUF

7B • Updated Jan 15, 2024 • 129 • 1