Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,480

Base only

Active filters: llama-cpp

zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF

Sentence Similarity • 1B • Updated about 22 hours ago • 2

cobrakenji/granite-3b-code-base-Q5_K_M-GGUF

Text Generation • 3B • Updated May 11, 2024 • 34 • 1

NikolayKozloff/Mistral-Nemo-Instruct-2407-Q8_0-GGUF

12B • Updated Jul 22, 2024 • 5.16k • 3

faerdhinen/Fimbulvetr-11B-v2-Q4_K_M-GGUF

11B • Updated Jul 29, 2024 • 77 • 1

BafS/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 1.99k • 7

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 11.3k • 49

itlwas/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

3B • Updated Dec 19, 2024 • 306 • 2

roleplaiapp/Llama-3.3-70B-Instruct-Q4_K_S-GGUF

Text Generation • 71B • Updated Jan 15, 2025 • 54 • 1

aiplatforms/ru-uncensored-v2-gguf

Text Generation • 12B • Updated May 7 • 1.42k • 8

Astralyra/glm-4-9b-chat-hf-Q4_K_M-GGUF

Text Generation • 9B • Updated Mar 5, 2025 • 1.32k • 1

NikolayKozloff/gemma-3-1b-it-Q8_0-GGUF

Text Generation • 1.0B • Updated Mar 12, 2025 • 142 • 3

POWERHACK/Qwen3-8B-Q5_K_M-GGUF

Text Generation • 8B • Updated May 10, 2025 • 969 • 1

mahdisml/Huihui-Qwen3-4B-Instruct-2507-abliterated-Q4_K_M-GGUF

Text Generation • 4B • Updated Aug 8, 2025 • 706 • 2

elichen-skymizer/Qwen3-4B-Thinking-2507-Q6_K-GGUF

Text Generation • 4B • Updated Aug 12, 2025 • 35 • 1

enacimie/Qwen3-Embedding-0.6B-Q4_K_M-GGUF

Feature Extraction • 0.6B • Updated Sep 1, 2025 • 381 • 9

vito95311/Qwen3-Omni-30B-A3B-Thinking-INT8FP16

Text Generation • 32B • Updated Sep 24, 2025 • 36 • 6

vito95311/Qwen3-Omni-30B-A3B-Thinking-GGUF-INT8FP16

Text Generation • 16B • Updated Sep 28, 2025 • 444 • 19

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 35.8k • 25

mauroneto/Jurema-7B-Q8_0-GGUF

8B • Updated Nov 8, 2025 • 56 • 2

qvac/fabric-llm-finetune

Text Generation • 6.63M • Updated Apr 16 • 160 • 5

Ex0bit/Elbaz-Prime-Intellect-3_Prism_Abliterated

Text Generation • 107B • Updated Dec 3, 2025 • 34 • 4

Edge-Quant/GLM-4.6V-Flash-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Dec 8, 2025 • 1.4k • 1

n0kovo/Qwen3-VL-32B-Instruct-heretic-v2-Q4_K_M-GGUF

Image-Text-to-Text • 33B • Updated Dec 16, 2025 • 709 • 7

Keyven/german-ocr-2b-gguf

Image-Text-to-Text • 2B • Updated Jan 4 • 42 • 6

solarkyle/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 20 • 181 • 5

audarai/Audar-TTS-V1-Turbo

Text-to-Speech • 2B • Updated 11 days ago • 196 • 3

AstromNew/Dolphin-Mistral-24B-Venice-Edition-Q5_K_M-GGUF

Text Generation • 24B • Updated Jan 27 • 69 • 2

Odiora/Qwen3-4b-Z-Image-Turbo-AbliteratedV1-Q8_0-GGUF

4B • Updated Jan 28 • 318 • 1

Ganonook/Qwen3-VL-Embedding-8B-Q4_K_M-GGUF

Feature Extraction • 8B • Updated Feb 5 • 199 • 3

cs2764/Huihui-Qwen3.5-27B-abliterated-Q6_K-GGUF

Image-Text-to-Text • 27B • Updated Feb 28 • 253 • 2