Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,251

Base only

Active filters: dpo

empero-ai/Qwythos-27B-v1

Image-Text-to-Text • 28B • Updated Jul 29 • 5.74k • 165

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 14.1k • • 289

RISys-Lab/RedSage-Qwen3-8B-DPO

Text Generation • 8B • Updated Feb 9 • 884 • • 12

aquilesfd/neo-3-1B-A90M-Instruct

Text Generation • Updated Apr 17 • 9

MultiSense/CustomerLM

Text Generation • 8B • Updated about 12 hours ago • 1.2k • 1

zipaltrivedi/dotnet-coder-14b

Text Generation • 15B • Updated Apr 19 • 3.29k • • 10

OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-GGUF

Image-Text-to-Text • 125B • Updated Jun 16 • 2.43k • 15

OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated

Image-Text-to-Text • 123B • Updated Jun 16 • 239 • 17

AREEBAFATIMA12/SmolLM-135M-SFT-DPO

0.1B • Updated May 30 • 1 • 1

IHP-Lab/Qwen2-Audio_PCLM_DPO

Audio-Text-to-Text • 8B • Updated Jun 3 • 246 • 3

sandeeprdy1729/TIMPS-Coder-7B

Text Generation • 8B • Updated Jul 17 • 111 • 1

vishwr/claim_drafter-merged

Text Generation • Updated Jul 20 • 1

autonom-ai/Qwen2.5-3B-Survival-RU-GGUF

Text Generation • 3B • Updated 29 days ago • 286 • 2

mb4063/Qwythos-27B-v1-ROCmFP4

Image-Text-to-Text • 27B • Updated 17 days ago • 704 • 3

muradil211/AetherSearch

Text Generation • 3B • Updated 5 days ago • 152 • 1

psssd-cat/HaloGuard1-Gen-0.8B-dpo-lora-v3

Text Generation • Updated 14 days ago • 17 • 1

Jonyses/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-GGUF

Image-Text-to-Text • 125B • Updated 11 days ago • 430 • 2

JiangLing-js/Qwen3.8-27B-Chinese-Xuanhuan-Novel-Writer-DPO

Text Generation • Updated 3 days ago • 39 • 2

JellyFush/qwen-medical-dpo-2-2

Updated 8 days ago • 1

muradil211/AetherSearch_DPO

Text Generation • 3B • Updated 1 day ago • 724 • 1

ISB369/shellminator-qwen05b-dpo-selfplay

Text Generation • 0.5B • Updated 1 day ago • 819 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 56 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 49 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 12

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 41 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 13 • 9

argilla/notus-7b-v1-lora

Text Generation • 7B • Updated Dec 4, 2023 • 8 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 57 • 124