orpo
Model optimizer
A framework for optimizing large language models without requiring a reference model.
Official repository for ORPO
426 stars
6 watching
40 forks
Language: Python
last commit: almost 2 years ago orpo A framework for optimizing large language models without requiring a reference model.
Official repository for ORPO