Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

300

Base only

Active filters: nncf

wesjos/embeddinggemma-2-openvino-int8

Feature Extraction • Updated 24 days ago • 61 • 2

Morteza89/qwen3.8-27b-fable-5-coding-distilled-int4-ov

Image-Text-to-Text • Updated 11 days ago • 44 • 2

echarlaix/distilgpt2-openvino-4bit

Text Generation • Updated Dec 12, 2024 • 79

echarlaix/distilbert-base-uncased-distilled-squad-openvino-8bit

Question Answering • Updated Jul 31, 2024 • 41

emmacall/Phi-3-mini-4k-instruct-openvino-4bit

Text Generation • Updated Aug 15, 2024 • 29

riacheruvu/Qwen2-7B-Instruct-openvino-4bit

Text Generation • Updated Aug 8, 2024 • 9

riacheruvu/Qwen2-7B-Instruct-openvino-8bit

Text Generation • Updated Aug 8, 2024 • 17

fiorezhang/Qwen2-7B-Instruct-openvino-4bit

Text Generation • Updated Aug 14, 2024 • 7

malcolmchan/Phi-3-mini-4k-instruct-openvino-8bit

Text Generation • Updated Aug 14, 2024 • 15

emmacall/Phi-3-medium-4k-instruct-openvino-4bit

Text Generation • Updated Aug 15, 2024 • 17

elucidator8918/Lynx-8B-Instruct-4bit

Text Generation • Updated Aug 16, 2024 • 20

AlexKoff88/Phi-3-mini-4k-instruct-openvino-4bit

Text Generation • Updated Sep 3, 2024 • 16

AlexKoff88/Phi-3-mini-4k-instruct-openvino-8bit

Text Generation • Updated Sep 3, 2024 • 19

yujiepan/llama-2-tiny-3layers-random-openvino-8bit

Text Generation • Updated Sep 4, 2024 • 27

yujiepan/mixtral-8xtiny-random-openvino-8bit

Text Generation • Updated Sep 4, 2024 • 92 • 1

FM-1976/stablelm-zephyr-3b-openvino-4bit

Updated Feb 24, 2025 • 9

riacheruvu/phi-2-openvino-8bit

Text Generation • Updated Oct 7, 2024 • 18

chgk13/Qwen2-0.5B-openvino-8bit

Text Generation • Updated Oct 14, 2024 • 15

AlexKoff88/TinyLlama-1.1B-Chat-v1.0-openvino-4bit

Updated Oct 17, 2024 • 20

AlexKoff88/opt-125m-openvino-4bit

Text Generation • Updated Oct 17, 2024 • 14

AlexKoff88/Phi-3.5-mini-instruct-openvino-fp16

Text Generation • Updated Nov 7, 2024 • 33

AlexKoff88/Phi-3.5-mini-instruct-openvino-4bit

Text Generation • Updated Nov 7, 2024 • 43

AlexKoff88/Phi-3.5-mini-instruct-openvino-8bit

Text Generation • Updated Nov 7, 2024 • 34

AIFunOver/Phi-3.5-mini-instruct-openvino-fp16

Text Generation • Updated Nov 7, 2024 • 36

AIFunOver/Phi-3.5-mini-instruct-openvino-4bit

Text Generation • Updated Nov 7, 2024 • 33

AIFunOver/SmolLM2-1.7B-Instruct-openvino-8bit

Text Generation • Updated Nov 7, 2024 • 35

AIFunOver/SmolLM2-1.7B-Instruct-openvino-fp16

Text Generation • Updated Nov 7, 2024 • 32

AIFunOver/SmolLM2-1.7B-Instruct-openvino-4bit

Text Generation • Updated Nov 7, 2024 • 43

AIFunOver/SmolLM2-360M-Instruct-openvino-8bit

Text Generation • Updated Nov 7, 2024 • 58

AIFunOver/SmolLM2-360M-Instruct-openvino-fp16

Text Generation • Updated Nov 7, 2024 • 37