ORPO: Monolithic Preference Optimization without Reference Model
Paper
• 2403.07691 • Published
• 72
Zephyr ORPO
Models and datasets to align LLMs with Odds Ratio Preference Optimisation (ORPO). Recipes here: https://github.com/huggingface/alignment-handbook