Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

56

Base only

Active filters: rdna4

tcclaviger/Qwen3.8-Flash-Next-MXFP4-FP8

Image-Text-to-Text • 188B • Updated 6 days ago • 381 • 11

julianmb/Qwen-3.8-27B-ROCmFP4-FAST-GGUF

Text Generation • 27B • Updated 12 days ago • 34.1k • 29

mb4063/Qwythos-27B-v1-ROCmFP4

Image-Text-to-Text • 27B • Updated 19 days ago • 704 • 3

JohnTdi/Qwen3-14B-INT4-Mixed-GPTQ

Text Generation • Updated Mar 11

JohnTdi/Qwen3-14B-INT4-Pure-GPTQ

Text Generation • Updated Mar 11

JohnTdi/Qwen3.5-Unsloth-GGUF-R9700-Benchmark

27B • Updated Mar 27 • 42 • 1

djdeniro/Qwen3.5-35B-A3B-MXFP4

Image-Text-to-Text • 20B • Updated Apr 10 • 5 • 1

djdeniro/Qwen3.5-397B-A17B-MXFP4

Image-Text-to-Text • 215B • Updated Apr 11 • 8 • 2

mattbucci/gemma-4-31B-it-AutoRound-AWQ

31B • Updated May 11 • 2.28k

mattbucci/Devstral-24B-AWQ

24B • Updated Apr 29 • 11

mattbucci/Qwen3.5-27B-AWQ

Text Generation • 27B • Updated Apr 29 • 22 • 1

mattbucci/Qwen3-Coder-30B-A3B-AWQ

31B • Updated May 26 • 44

mattbucci/gemma-4-26B-AWQ

26B • Updated May 31 • 5.83k • 1

pahajokiconsulting/Qwen3.6-35B-A3B-MXFP4

Image-Text-to-Text • 20B • Updated Apr 17 • 611 • 7

mattbucci/Qwen3.6-35B-A3B-AWQ-CT

35B • Updated Apr 26 • 89 • 2

mattbucci/Qwen3.6-27B-AWQ-CT

27B • Updated Apr 26 • 216 • 1

mattbucci/Qwen3.6-27B-AWQ

27B • Updated May 1 • 2.72k • 5

mattbucci/Qwen3-Coder-REAP-25B-A3B-AWQ

25B • Updated Apr 29 • 1.77k • 1

mattbucci/Qwen3.6-REAM-A3B-AWQ

Image-Text-to-Text • 27B • Updated May 29 • 60

mattbucci/Qwen3-Coder-30B-A3B-REAM-AWQ

23B • Updated May 9 • 17

mattbucci/gemma-4-31B-AWQ

31B • Updated May 31 • 209

LJTSG/webgpu-for-amd-ai-pcs

Updated Jun 3 • 1

djdeniro/MiniMax-M2.7-MXFP416

Text Generation • 130B • Updated Jun 9 • 42

Capicua25x/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill-MXFP4

Text Generation • 35B • Updated Jun 17 • 14

Capicua25x/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill-MXFP4-Vision

Image-Text-to-Text • 35B • Updated Jun 17 • 35

Launch80/Qwen3.6_27B-RFP458

Text Generation • 17B • Updated Jun 25 • 6 • 2

maczzinatui/Ornith-1.0-9b-ROCmFPX-STRIX_LEAN-GGUF

9B • Updated Jun 29 • 40

maczzinatui/Qwen3.6-14B-A3B-vibetuned-ROCmFPX-STRIX_LEAN-GGUF

14B • Updated Jun 29 • 1.91k • 1

maczzinatui/GLM-4.7-Flash-REAP-23B-A3B-ROCmFPX-STRIX_LEAN-GGUF

23B • Updated Jun 29 • 49 • 1

maczzinatui/Ornstein-3.5-9B-V2-ROCmFPX-STRIX_LEAN-GGUF

9B • Updated Jun 29 • 16