Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

55

Base only

Active filters: fp8-kv-cache

AEON-7/Gemma-4-E4B-it-Uncensored-NVFP4

Text Generation • 6B • Updated Oct 6 • 2.65k • 5

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4-FP8

Text Generation • 8B • Updated Oct 6 • 2.93k • 2

namgyu-youn/EXAONE-4.0-1.2B-LLMC-AWQ-W4

1B • Updated Feb 18 • 4

rhoninseiei/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-ModelOpt-NVFP4

Image-Text-to-Text • 17B • Updated Mar 21 • 18 • 1

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 26B • Updated Oct 6 • 8.28k • 26

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 17B • Updated Oct 6 • 2.81k • 15

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 17B • Updated Oct 6 • 2.79k • 4

AEON-7/DFlash-Qwen3.5-27B-Uncensored-NVFP4

Text Generation • 15B • Updated Oct 6 • 153 • 2

AEON-7/supergemma4-26b-abliterated-multimodal-nvfp4

Text Generation • 14B • Updated Oct 6 • 2.65k • 6

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-NVFP4

Text Generation • 6B • Updated Oct 6 • 2.62k • 1

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 6B • Updated Oct 6 • 243 • 3

AEON-7/gemma-4-31B-it-speculator.eagle3-NVFP4

Text Generation • 2B • Updated Oct 6 • 144 • 5

AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4

Image-Text-to-Text • 35B • Updated Oct 6 • 90.7k • 74

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 18B • Updated Oct 6 • 134 • 9

murilonwt/granite-4.1-8b-NVFP4

Text Generation • 5B • Updated May 19

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4

Text Generation • 8B • Updated Oct 6 • 2.79k • 1

amanwalksdownthestreet/Hermes-4-70B-MXFP8-KV8

Text Generation • 73B • Updated Jul 3 • 14

spellbound-eng/hy3-spellbound-simpo-step151-nvfp4-c8

170B • Updated Jul 9

Ishowbackup/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 18B • Updated Aug 13 • 99

SinclairSchneider/Apertus-v1.5-8B-W4A16-KV8-de

Text Generation • 9B • Updated Aug 19 • 84

SinclairSchneider/Apertus-v1.5-70B-FP8-KV8

Text Generation • 72B • Updated Aug 21 • 38

SinclairSchneider/Apertus-v1.5-70B-W4A16-KV8

Text Generation • 13B • Updated Aug 21 • 35

SinclairSchneider/Mistral-Medium-3.5-128B-W4A16-KV8

Text Generation • 22B • Updated Aug 21 • 305

abhishekchohan/Qwen3.8-27B-GPTQ-INT4-FP8KV

Image-Text-to-Text • 28B • Updated Oct 9 • 1.17k • 3

abhishekchohan/Qwen3.8-27B-AWQ-INT4-FP8KV

Image-Text-to-Text • 28B • Updated Aug 27 • 10.7k • 2

minima-ai/mnma_qwen3.8_27b_nvfp4

Text Generation • 27B • Updated 7 days ago • 499 • 12

emee-ai/mnma_qwen3.8_27b_nvfp4

Text Generation • 27B • Updated Sep 5 • 60

diffbot/MiMo-V2.6-Flash-MOPD-FP8KV-W4A8-2x-RTX-PRO-6000

Any-to-Any • Updated 21 days ago • 14

intel-ai/gemma-4-26B-A4B-MXFP8-FP8KV-CT-AutoRound

Image-Text-to-Text • 26B • Updated 18 days ago • 154

intel-ai/gemma-4-31B-MXFP8-FP8KV-CT-AutoRound

Image-Text-to-Text • 31B • Updated 19 days ago • 94