Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,217

Base only

Active filters: int8

transformerlab/ideogram-4-int8-w8a8

Text-to-Image • Updated 2 days ago • 3

nameistoken/Qwen3.6-27B-Quark-W8A8-INT8

Image-Text-to-Text • 27B • Updated 30 days ago • 4.24k • 5

Abiray/L2P-model-1k-merge-INT8

Text-to-Image • Updated 19 days ago • 13

vistralis/FLUX.2-klein-9b-INT8-transformer

Text-to-Image • Updated Feb 16 • 442 • 3

aufklarer/DeepFilterNet3-CoreML

Audio-to-Audio • Updated 14 days ago • 73.8k • 2

aufklarer/Qwen3.5-0.8B-Chat-MLX

Text Generation • Updated 14 days ago • 480 • 1

smcleod/cohere-transcribe-03-2026-int8

Automatic Speech Recognition • Updated Apr 13 • 3

aufklarer/Kokoro-82M-CoreML-INT8

Text-to-Speech • Updated Apr 19 • 91 • 1

nameistoken/Gemma-4-31B-it-Quark-W8A8-INT8

Image-Text-to-Text • 31B • Updated Apr 23 • 1.75k • 3

curiositytech/runeward-small-onnx-int8

Token Classification • Updated May 11 • 20 • 2

veyra-ai/Kairo-5M-Gemma4-Base-ONNX-Int8

Text Generation • Updated 4 days ago • 52 • 1

veyra-ai/Veyra2-30M-Instruct-Early-ONNX-Int8

Text Generation • 34.6M • Updated 16 days ago • 5 • 1

hadiyarajesh/indicconformer-hi-int8-onnx

Automatic Speech Recognition • Updated 7 days ago • 1

adeepv/Qwen3.6-27B-W8A16-Ascend310P

Text Generation • Updated 7 days ago • 44 • 1

bartsolutions/DeepSeek-OCR-2-GPTQ-INT8

Image-Text-to-Text • 3B • Updated 6 days ago • 353 • 1

smcleod/nemotron-3.5-asr-streaming-0.6b-int8

Automatic Speech Recognition • Updated 4 days ago • 23 • 1

LLM-OS-Models/KoHRM-Text-1.4B-CPU-Runtime

Updated 2 days ago • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc

Text Classification • Updated Jun 27, 2023 • 113 • 6

INC4AI/bert-base-uncased-mrpc-int8-qat-inc

Text Classification • Updated Mar 21, 2024 • 15 • 1

INC4AI/albert-base-v2-sst2-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 12

INC4AI/bert-base-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 49

INC4AI/roberta-base-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 14

echarlaix/distilbert-sst2-inc-dynamic-quantization-magnitude-pruning-0.1

Text Classification • Updated Jun 13, 2023 • 67

echarlaix/t5-small-int8-dynamic

Translation • Updated Oct 26, 2023 • 8 • 4

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 635 • 1

INC4AI/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 25 • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29, 2024 • 464 • 5

INC4AI/vit-base-patch16-224-int8-static-inc

Image Classification • Updated Sep 6, 2022 • 10 • 1

Intel/t5-small-xsum-int8-dynamic-inc

Updated Mar 21, 2024 • 484 • 1

AlexKoff88/bert_nm_mnli_sparse_quantized_90

Text Classification • Updated Nov 25, 2022 • 9