Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,044

Base only

Active filters: llama.cpp

google/codegemma-2b-GGUF

Text Generation • 3B • Updated Jun 27, 2024 • 159 • 36

vito95311/Qwen3-Omni-30B-A3B-Thinking-INT8FP16

Text Generation • 32B • Updated Sep 24, 2025 • 35 • 6

vito95311/Qwen3-Omni-30B-A3B-Thinking-GGUF-INT8FP16

Text Generation • 16B • Updated Sep 28, 2025 • 426 • 19

glogwa68/granite-4.0-h-tiny-DISTILL-OPUS-4.5-think-GGUF

Text Generation • 7B • Updated Dec 23, 2025 • 422 • 1

Melikshah/gpt-oss-20b-clinical-cot-gguf

Text Generation • 21B • Updated Jun 5 • 905 • 4

LiquidAI/LFM2.5-VL-1.6B-GGUF

Image-Text-to-Text • 1B • Updated Mar 30 • 74.3k • 95

solarkyle/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 20 • 151 • 5

Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Image-Text-to-Text • 27B • Updated 5 days ago • 172k • 675

MateoM4/qwen35-9b-medical-finetuned-v2-GGUF

9B • Updated Mar 11 • 66 • 1

michaelw9999/Nemotron-Cascade-2-30B-A3B-NVFP4-GGUF

Text Generation • 32B • Updated Apr 2 • 162 • 5

Ex0bit/Gemma4-PRISM-PRO-DQ

Image-Text-to-Text • 31B • Updated Apr 8 • 33 • 29

khazarai/Qwen3-4B-Qwen3.6-plus-Reasoning-Distilled-GGUF

Text Generation • 4B • Updated Apr 19 • 10.4k • 48

Abiray/Huihui-Qwopus3.5-4B-v3-abliterated-GGUF

4B • Updated Apr 7 • 320 • 5

DuoNeural/Gemma-4-26B-A4B-Abliterated

Text Generation • 26B • Updated Apr 29 • 303 • • 2

Ex0bit/Gemma4-26B-A4B-PRISM-PRO-DQ-GGUF

Image-Text-to-Text • 25B • Updated Apr 11 • 18.7k • 77

karthik0098/debate-debater-1.7b

Text Generation • 2B • Updated Apr 15 • 21 • 1

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1-GGUF

Image-Text-to-Text • 9B • Updated 5 days ago • 31.2k • 107

Jackrong/Qwopus3.5-27B-v3.5-GGUF

Image-Text-to-Text • 27B • Updated 5 days ago • 2.92k • 44

WithinUsAI/Opus4.7-GODs.Ghost.Codex-4B.GGuF

Text Generation • 4B • Updated 25 days ago • 8.33k • 97

hesamation/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Text Generation • 35B • Updated Apr 19 • 33.9k • 285

lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-IQ4_XS-GGUF

Text Generation • 35B • Updated Apr 20 • 1.82k • 32

thejemish/crop-disease-finder-gemma4-e2b-GGUF

5B • Updated Apr 20 • 88 • 1

Jackrong/Qwen3.6-27B-GGUF

Image-Text-to-Text • 27B • Updated 5 days ago • 2.12k • 57

3fou34jfioqjf3q0pf/rp-model_E2B_v5.1

5B • Updated Apr 22 • 47 • 2

lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-Q5_K_M-GGUF

Text Generation • 35B • Updated Apr 23 • 1.49k • 16

cHunter789/Qwen3.6-27B-i1-IQ4_XS-GGUF

Text Generation • 27B • Updated May 2 • 2.31k • 31

Ardenzard/Qwen3.6-27B-DFlash-GGUF

Text Generation • 2B • Updated Apr 28 • 642 • 11

sokann/Qwen3.6-27B-GGUF-4.256bpw

Updated Apr 30 • 272 • 15

jinaai/jina-embeddings-v5-omni-small-text-matching-GGUF

Feature Extraction • 0.6B • Updated May 12 • 512 • 4

teamblobfish/DeepSeek-V4-Flash-GGUF

Text Generation • 284B • Updated May 19 • 28.1k • 27