🔮 Fix unused precomputed ref log probs in DPO#2431

Merged

qgallouedec merged 1 commit intohuggingface:mainfrom dakru012:fix_precompute_ref_log_probs

Dec 3, 2024

+16-3

Commits on Dec 3, 2024

Extend PreferenceCollator to handle precomputed ref log probs
dakru012
committed