Repository navigation

Add the Aida optimizer - #551

Open

shaneraphel wants to merge 5 commits into

jettify:masterfrom

shaneraphel:add-aida-optimizer

Commits on Sep 25, 2026

Support Conv1d and Conv3d weights in Adahessian trace
shaneraphel
committed
b3d73a6
Raise Shampoo preconditioners to -1/(2k) per the paper
shaneraphel
committed
f0b8a43
Make Adafactor relative-step constants configurable
shaneraphel
committed
1cf34c3
Add the Sophia optimizer
shaneraphel
committed
0572c5c
Add the Aida optimizer
shaneraphel
committed
c0becd6