Skip to content

Support configurable parameter, gradient, and optimizer sharding in experimental FSDP v2 - #6137

Open
Autumn1998 wants to merge 11 commits into
NVIDIA:mainfrom
Autumn1998:main-zero-1-2
Open

Support configurable parameter, gradient, and optimizer sharding in experimental FSDP v2#6137
Autumn1998 wants to merge 11 commits into
NVIDIA:mainfrom
Autumn1998:main-zero-1-2

Commits