Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,662

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated about 3 hours ago • 201k • • 662

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated about 3 hours ago • 1.05M • 380

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated 3 days ago • 17.1k • 111

Cactus-Compute/needle

30.4M • Updated 4 days ago • 874 • 254

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated 3 days ago • 14.6k • 93

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated May 26 • 386k • 968

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 19k • 751

openbmb/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated May 25 • 64.3k • 203

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 3.91k • 33

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 25.8k • 117

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 54.9k • 883

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 3.25k • 25

Abdalrahman/needle-rs-safetensors

Text Generation • Updated May 18 • 23 • 6

prism-ml/bonsai-image-ternary-4B-mlx-2bit

Text-to-Image • Updated Jun 1 • 2.09k • 82

AutoArk-AI/Audio8-ASR-0.1B-iOS-ANE

Automatic Speech Recognition • Updated 3 days ago • 96 • 7

litert-community/MedGemma-1.5-4B-IT

Text Generation • Updated 6 days ago • 360 • 4

theabbie/needle-pi-coding-agent

Text Generation • Updated 5 days ago • 244 • 4

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 9.53k • 79

openbmb/MiniCPM5-1B-Base

Text Generation • 1B • Updated May 25 • 9.37k • 10

Reza2kn/Shenava-Koochik-v1.0

Automatic Speech Recognition • Updated 22 days ago • 232 • 10

prism-ml/Bonsai-8B-mlx-1bit

Text Generation • 0.4B • Updated Apr 18 • 12.6k • 224

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 9.98k • 52

prism-ml/Ternary-Bonsai-8B-mlx-2bit

Text Generation • 0.6B • Updated Apr 18 • 14k • 116

openbmb/MiniCPM5-1B-MLX

Text Generation • 0.2B • Updated May 25 • 5.81k • 25

Abiray/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated May 28 • 5.3k • 43

younissk/nanoBeard-frigate-360M-GGUF

Text Generation • 0.4B • Updated Jun 1 • 978 • 4

omi-health/omi-med-stt-v1

Automatic Speech Recognition • Updated Jun 9 • 1.07k • 6

oddadmix/Nabra-82M-v0.1

Text-to-Speech • Updated 14 days ago • 359 • 7

audarai/Audar-ASR-V1-Flash

Automatic Speech Recognition • 0.8B • Updated 8 days ago • 1.48k • 4

audarai/Audar-TTS-V1-Flash

Text-to-Speech • 0.6B • Updated 10 days ago • 279 • 4