Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,386

Base only

Active filters: dpo

UnstableLlama/Love-Aligned-31B

Text Generation • 31B • Updated 6 days ago • 553 • 4

JiangLing-js/Qwen3.8-27B-Chinese-Xuanhuan-Novel-Writer-DPO

Text Generation • Updated 22 days ago • 94 • 6

sz14/cRia-LM-75M-Instruct

Text Generation • 75.7M • Updated 2 days ago • 1.38k • 3

ranjanrajib/DPO-trained-Qwen2.5-Python-Coder-7B

Text Generation • 8B • Updated 4 days ago • 340 • 2

wxzhang/dpo-selective-redteaming

Text Generation • 7B • Updated May 19, 2024 • 23 • 1

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 14.9k • • 291

QuantFactory/NeuralDaredevil-8B-abliterated-GGUF

Text Generation • 8B • Updated May 29, 2024 • 2.8k • 99

sapienzanlp/Minerva-7B-instruct-v1.0-GGUF

Text Generation • 7B • Updated Dec 7, 2024 • 356 • 6

RISys-Lab/RedSage-Qwen3-8B-DPO

Text Generation • 8B • Updated Feb 9 • 815 • • 14

aquilesfd/neo-3-3B-A400M-Thinking

Text Generation • Updated Feb 13 • 7

RightNowAI/RightNow-Arabic-0.5B-Turbo

Text Generation • 0.5B • Updated Apr 10 • 1.02k • 6

TinmanLabSL/gemma3-4b-companion

Text Generation • Updated Apr 22 • 4

XiangJinYu/Qwen3.5-9B-Humanize-DPO-Round2

Text Generation • Updated May 14 • 41 • 6

NU-World-Model-Embodied-AI/phyworld

Video-to-Video • Updated Aug 7 • 3

changcheng967/Aegis-Qwen3-1.7B-SFT

Text Generation • 2B • Updated Jun 1 • 1

changcheng967/Aegis-Qwen3-1.7B-SFT-DPO

Text Generation • 2B • Updated Jun 2 • 2

MRockatansky/Gemma-4-31B-Storymaxxed3

Text Generation • 31B • Updated Jun 26 • 53 • • 3

HannahTeam/Hannah-AI-Companion

Text Generation • Updated Jun 10 • 1

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated Jul 29 • 1.56k • 79

tomaris/Tomaris-dpo-v1

Text Generation • Updated Jul 14 • 14 • 1

mradermacher/Qwythos-27B-v1-GGUF

Image-Text-to-Text • 27B • Updated Jul 31 • 1.56k • 5

mb4063/Qwythos-27B-v1-ROCmFP4

Image-Text-to-Text • 27B • Updated Aug 15 • 53 • 4

ThakiCloud/Qwen3.8-27B-Human-KO-Safety

Text Generation • 28B • Updated 7 days ago • 1.85k • 2

UnstableLlama/Love-Aligned-31B-exl3-6.00bpw

Text Generation • 13B • Updated 7 days ago • 205 • 1

UnstableLlama/Love-Aligned-31B-LoRA

Text Generation • Updated 7 days ago • 1

mradermacher/Love-Aligned-31B-GGUF

31B • Updated 6 days ago • 897 • 1

mradermacher/Love-Aligned-31B-i1-GGUF

31B • Updated 6 days ago • 3.93k • 1

Akahsizrr/AIAAH-1-RL-DPO-iter1

3B • Updated 6 days ago • 75 • 1

breakdown881/vilaw-llm-dpo-v2

Text Generation • Updated 4 days ago • 8 • 1

Shockem/Qwen3.8-27b-Terse-Coder-LoRA

0.1B • Updated about 22 hours ago • 151 • 1