Repository navigation

Make Adafactor relative-step constants configurable - #549

Open

shaneraphel wants to merge 3 commits into

jettify:masterfrom

shaneraphel:adafactor-configurable-step

Commits on Sep 25, 2026
- Support Conv1d and Conv3d weights in Adahessian trace
  shaneraphel
  committed
  b3d73a6
- Raise Shampoo preconditioners to -1/(2k) per the paper
  shaneraphel
  committed
  f0b8a43
- Make Adafactor relative-step constants configurable
  shaneraphel
  committed
  1cf34c3