Edit Models filters

Model Tree

microsoft/Phi-3-mini-128k-instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

86

Base only

Active filters: microsoft/Phi-3-mini-128k-instruct

leliuga/Phi-3-mini-128k-instruct-bnb-4bit

Text Generation • 4B • Updated Apr 23, 2024 • 9 • 1

professorf/phi-3-mini-128k-f16-gguf

Text Generation • 4B • Updated Aug 27, 2024 • 44 • 5

qwp4w3hyb/Phi-3-mini-128k-instruct-iMat-GGUF

Text Generation • 4B • Updated May 22, 2024 • 1.64k

mlc-ai/Phi-3-mini-128k-instruct-q0f32-MLC

Updated Sep 7, 2025 • 1

mlc-ai/Phi-3-mini-128k-instruct-q4f16_2-MLC

Updated Sep 7, 2025 • 2

second-state/Phi-3-mini-128k-instruct-GGUF

Text Generation • 4B • Updated Jul 29, 2024 • 433 • 2

gaianet/Phi-3-mini-128k-instruct-GGUF

Text Generation • 4B • Updated Jul 29, 2024 • 177 • 1

AlessandroW/Phi-3-mini-128k-instruct-gguf

Text Generation • 4B • Updated May 22, 2024 • 77 • 1

legraphista/Phi-3-mini-128k-instruct-IMat-GGUF

Text Generation • 4B • Updated May 26, 2024 • 1.03k

suraiy/microsoft-Phi-3-mini-128k-instruct-HQQ-4bit-smashed-Q4_K_M-GGUF

96 • Updated May 29, 2024 • 63

mlc-ai/Phi-3-mini-128k-instruct-q0f16-MLC

Updated Sep 7, 2025 • 5 • 1

radia/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Jun 3, 2024 • 14

mlc-ai/Phi-3-mini-128k-instruct-q4f16_1-MLC

Updated Sep 7, 2025 • 3 • 1

mlc-ai/Phi-3-mini-128k-instruct-q4f32_1-MLC

Updated Sep 7, 2025 • 1

heisenbug/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • 4B • Updated Jun 5, 2024 • 4

newsletter/Phi-3-mini-128k-instruct-Q6_K-GGUF

Text Generation • 4B • Updated Jul 29, 2024 • 17

gate369/Phi-3-mini-128k-instruct-IQ4_XS-GGUF

Text Generation • 4B • Updated Jun 12, 2024 • 20

CHE-72-ZLab/Microsoft-Phi3-14B-Instruct128K-GGUF

Text Generation • 14B • Updated Jun 23, 2024 • 46

CHE-72/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • 4B • Updated Jun 22, 2024 • 8

CHE-72/Phi-3-mini-128k-instruct-Q6_K-GGUF

Text Generation • 4B • Updated Jun 22, 2024 • 9

OpenVINO/Phi-3-mini-128k-instruct-int4-ov

Text Generation • Updated Oct 31, 2024 • 44 • 2

OpenVINO/Phi-3-mini-128k-instruct-int8-ov

Text Generation • Updated Nov 5, 2024 • 48 • 5

bartowski/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • 4B • Updated Aug 3, 2024 • 2.24k • 36

solidrust/Phi-3-mini-128k-instruct-AWQ

Text Generation • 4B • Updated Sep 3, 2024 • 603 • 1

awels/maximusLLM-3b-128k-gguf

4B • Updated Oct 19, 2024 • 41 • 1

awels/threadyLLM-3b-128k-gguf

4B • Updated Aug 5, 2024 • 8

RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a16

Text Generation • 4B • Updated Oct 9, 2024 • 10

RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a8

Text Generation • 4B • Updated Jan 5 • 19

huggingkot/Phi-3-mini-128k-instruct-Q5_K_M-GGUF

Text Generation • 4B • Updated Jul 13, 2024 • 5

SkyNotion/Phi-3-mini-128k-instruct-Q2_K-GGUF

Text Generation • 4B • Updated Jul 17, 2024 • 14