Add construction-scoped MFSDP fully shard options#6127

wujingyue wants to merge 1 commit into

NVIDIA:mainNVIDIA/Megatron-LM:mainfrom

wujingyue:fully-shard-optionswujingyue/Megatron-LM:fully-shard-optionsCopy head branch name to clipboard