Add Riemannian-preconditioned LoRA optimizer - #3382

Merged

BenjaminBossan merged 5 commits into

huggingface:mainfrom

smellslikeml:feat/riemannian-preconditioned-lora

Aug 3, 2026

Commits on Jul 27, 2026

Add Riemannian-preconditioned LoRA optimizer

smellslikeml
and
remyx-ai[bot]
committed
2c436f3
Address review feedback (docstrings, precise matching, tests, MetaMath experiment)

smellslikeml
and
fangzhaozhang
committed
d1a9b24
Address round-2 review; align reg default with the reference implementation

committed
e18e45e

Commits on Jul 30, 2026

Fix closure-ordering + guard LBFGS in create_riemannian_optimizer
smellslikeml
committed
58648c6

Commits on Jul 31, 2026

Reject closures at step time instead of wrapping them
smellslikeml
committed
f90cc44