Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

337

Base only

Active filters: Qwen/Qwen3-4B

Qwen/Qwen3-4B-GGUF

Text Generation • 4B • Updated May 21, 2025 • 535k • 173

unsloth/Qwen3-4B-GGUF

Text Generation • 4B • Updated Jun 8, 2025 • 436k • 246

DreamFast/qwen3-4b-heretic

Text Generation • 4B • Updated Aug 10 • 8.19k • • 39

AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF

Text Generation • 4B • Updated 12 days ago • 323k • 20

bssgoat/local-typed-decisions

4B • Updated 6 days ago • 140 • 1

unsloth/Qwen3-4B-unsloth-bnb-4bit

Text Generation • 4B • Updated May 13, 2025 • 57.8k • 21

unsloth/Qwen3-4B-bnb-4bit

4B • Updated May 13, 2025 • 12.8k • 3

Qwen/Qwen3-4B-FP8

Text Generation • 4B • Updated Jul 26, 2025 • 78.5k • 39

second-state/Qwen3-4B-GGUF

Text Generation • 4B • Updated May 1, 2025 • 1.04k • 6

unsloth/Qwen3-4B-128K-GGUF

Text Generation • 4B • Updated May 25, 2025 • 2.72k • 27

gaianet/Qwen3-4B-GGUF

Text Generation • 4B • Updated May 1, 2025 • 352

bartowski/Qwen_Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 173k • 21

lmstudio-community/Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 29, 2025 • 15.2k • 19

lmstudio-community/Qwen3-4B-MLX-4bit

Text Generation • 4B • Updated Apr 28, 2025 • 22.1k • 1

lmstudio-community/Qwen3-4B-MLX-8bit

Text Generation • 4B • Updated Apr 28, 2025 • 21.4k

ggml-org/Qwen3-4B-GGUF

4B • Updated Apr 28, 2025 • 10.1k • 8

MaziyarPanahi/Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 247k • 8

qwen-community/Qwen3-4B-FP8

Text Generation • 4B • Updated Apr 28, 2025 • 808

mlx-community/Qwen3-4B-4bit

Text Generation • 4B • Updated Apr 28, 2025 • 25.3k • 16

mlx-community/Qwen3-4B-3bit

Text Generation • 4B • Updated Apr 28, 2025 • 108

NikolayKozloff/Qwen3-4B-Q8_0-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 73 • 1

mlx-community/Qwen3-4B-6bit

Text Generation • 4B • Updated Apr 28, 2025 • 38

mlx-community/Qwen3-4B-8bit

Text Generation • 4B • Updated Apr 28, 2025 • 6.29k • 1

tensorblock/Qwen_Qwen3-4B-GGUF

Text Generation • 4B • Updated Jan 27 • 317 • 1

nytopop/Qwen3-4B.w8a8

Text Generation • 4B • Updated Apr 29, 2025 • 156

Aldaris/Qwen3-4B-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 29, 2025 • 2.16k • 1

charlesthefool/Qwen3-4B-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 29, 2025 • 135 • 1

Antigma/Qwen3-4B-GGUF

Text Generation • 4B • Updated May 29, 2025 • 131

DavidAU/Qwen3-4B-NEO-Imatrix-Max-GGUF

Text Generation • 4B • Updated Jul 28, 2025 • 1.43k • 8

itlwas/Qwen3-4B-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 29, 2025 • 132