Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,358

Base only

Active filters: quantization

ModelsLab/Krea-2-Turbo-W4A4-Nunchaku

Text-to-Image • Updated 4 days ago • 2

amd/DeepSeek-V4-Flash-NVFP4

Text Generation • 149B • Updated 4 days ago • 38 • 2

willfalco/GLM-5.2-EXL3-TR3-3.42bpw

Text Generation • 176B • Updated 3 days ago • 125 • 2

legraphista/Hermes-2-Theta-Llama-3-8B-IMat-GGUF

Text Generation • 8B • Updated May 26, 2024 • 2.02k • 1

legraphista/internlm2-math-plus-1_8b-IMat-GGUF

Text Generation • 2B • Updated May 27, 2024 • 1.31k • 3

legraphista/internlm2-math-plus-mixtral8x22b-IMat-GGUF

Text Generation • 141B • Updated May 28, 2024 • 953 • 1

legraphista/NuminaMath-7B-TIR-IMat-GGUF

Text Generation • 7B • Updated Jul 11, 2024 • 507 • 2

legraphista/xLAM-8x7b-r-IMat-GGUF

Text Generation • 47B • Updated Aug 31, 2024 • 1.5k • 2

legraphista/xLAM-8x22b-r-IMat-GGUF

Text Generation • 141B • Updated Sep 1, 2024 • 1.83k • 1

legraphista/Yi-Coder-9B-Chat-IMat-GGUF

Text Generation • 9B • Updated Sep 5, 2024 • 793 • 2

wangkanai/wan22-qx-encoders-gguf

Text-to-Video • 6B • Updated Oct 28, 2025 • 1.31k • 10

AlekseyCalvin/FLUX2_dev_2bit_hqq

Image-to-Image • 9B • Updated Nov 27, 2025 • 14 • 5

nota-ai/Solar-Open-100B-NotaMoEQuant-Int4

Text Generation • 2B • Updated Jan 26 • 299 • 62

nota-ai/Solar-Open-100B-Nota-FP8

Text Generation • 103B • Updated Jan 26 • 170 • 46

3ndetz/LTX2-Rapid-Merges-GGUF

Image-Text-to-Video • 19B • Updated Feb 3 • 456 • 25

tzervas/qwen2.5-coder-32b-bitnet-1.58b

Text Generation • 9B • Updated Jan 29 • 947 • 6

ApacheOne/Qwen2.5-VL-7B-Instruct-abliterated-nvfp4

Updated Feb 24 • 49 • 6

vrfai/Qwen3-ASR-1.7B-fp8

Automatic Speech Recognition • 2B • Updated Jun 6 • 486 • 6

MoringLabs/Qwen3.5-122B-A10B-MLX-3.7bit-VL-v2

Image-Text-to-Text • 17B • Updated Apr 6 • 669 • 2

zhangsq-nju/Qwen3-0.6B-EdgeRazor-4bit

Text Generation • 0.6B • Updated Jun 11 • 18 • 7

zhangsq-nju/Qwen3-0.6B-EdgeRazor-2.79bit

Text Generation • 0.6B • Updated Jun 11 • 25 • 1

zhangsq-nju/Qwen3-0.6B-EdgeRazor-1.88bit

Text Generation • 0.6B • Updated Jun 11 • 18 • 1

zhangsq-nju/Qwen3-0.6B-EdgeRazor-1.58bit

Text Generation • 0.6B • Updated Jun 11 • 54 • 1

zhangsq-nju/Qwen3-1.7B-EdgeRazor-4bit

Text Generation • 2B • Updated Jun 11 • 13 • 1

zhangsq-nju/Qwen3-1.7B-EdgeRazor-2.79bit

Text Generation • 2B • Updated Jun 11 • 25 • 1

zhangsq-nju/Qwen3-1.7B-EdgeRazor-1.88bit

Text Generation • 2B • Updated Jun 11 • 45 • 2

zhangsq-nju/Qwen3-1.7B-EdgeRazor-1.58bit

Text Generation • 2B • Updated Jun 11 • 82 • 2

zhangsq-nju/MobileLLM-350M-EdgeRazor-4bit

Text Generation • 0.4B • Updated Jun 11 • 14 • 1

zhangsq-nju/MobileLLM-350M-EdgeRazor-2.79bit

Text Generation • 0.4B • Updated Jun 11 • 26 • 1

zhangsq-nju/MobileLLM-350M-EdgeRazor-1.88bit

Text Generation • 0.4B • Updated Jun 11 • 11 • 1