Skip to content

feat(multicore): add HyperMegaMhc forward and backward - #925

Merged
davidhe91 merged 1 commit into
mindspore-ai:masterfrom
Probiotics5333:hyper_mega_mhc
Oct 15, 2026
Merged

davidhe91 merged 1 commit into
mindspore-ai:masterfrom
Probiotics5333:hyper_mega_mhc

Conversation

@Probiotics5333

@Probiotics5333 Probiotics5333 commented Sep 21, 2026 •

Copy link
Copy Markdown
Contributor

Paired: GitHub #925 ↔ GitCode !1614

/kind feature

What does this PR do / why do we need it:

  • Adds the token-tiled HyperMegaMhc forward pipeline with overlapped AIC Projection and AIV InputMix/RMSNorm scheduling.
  • Adds the four-task HyperMegaMhcGrad backward pipeline without the Post n=4 scalar specialization.
  • Integrates pinned CANN primitive patches into the isolated multicore build without modifying the system CANN installation.
  • Keeps semantic/CANN precision references and excludes the fair-Golden validation-only custom operator.

Testing:

  • python .agent/skills/autogit/scripts/autogit.py check
  • Ascend 910B full multicore build
  • Forward and backward precision benchmarks: passed
  • Targeted UT: 14 passed, 324 subtests passed

@CLAassistant

CLAassistant commented Sep 21, 2026 •

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 正在生成合并请求摘要,请稍候…

1 similar comment
@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 正在生成合并请求摘要,请稍候…

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 AI 代码检视正在进行中,请稍候…

1 similar comment
@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 AI 代码检视正在进行中,请稍候…

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

CLA Signature Guide

@mindspore-ci-bot , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
c20bd626 Merge pull request #915 from dav... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

1 similar comment
@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

CLA Signature Guide

@mindspore-ci-bot , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
c20bd626 Merge pull request #915 from dav... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 正在生成合并请求摘要,请稍候…

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

@mindspore-ci-bot, 当前/check-pr未通过,原因如下:

以下Pull Request描述检查项未通过:
部分检查项缺失 请重新使用模板
模板中'Test Plan and Test Result' 信息为空,请补充对应信息。

以下issue检查项未通过:
Pull Request未关联issue

请修改好上述检查错误后,重新使用/check-pr触发检查。

1 similar comment
@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

@mindspore-ci-bot, 当前/check-pr未通过,原因如下:

以下Pull Request描述检查项未通过:
部分检查项缺失 请重新使用模板
模板中'Test Plan and Test Result' 信息为空,请补充对应信息。

以下issue检查项未通过:
Pull Request未关联issue

请修改好上述检查错误后,重新使用/check-pr触发检查。

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 正在生成合并请求摘要,请稍候…

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 AI 代码检视正在进行中,请稍候…

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 AI 代码检视正在进行中,请稍候…

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

CLA Signature Guide

@mindspore-ci-bot , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
c20bd626 Merge pull request #915 from dav... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

@mindspore-ci-bot, 当前/check-pr未通过,原因如下:

以下Pull Request描述检查项未通过:
部分检查项缺失 请重新使用模板
模板中'Test Plan and Test Result' 信息为空,请补充对应信息。

以下issue检查项未通过:
Pull Request未关联issue

请修改好上述检查错误后,重新使用/check-pr触发检查。

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

CLA Signature Guide

@mindspore-ci-bot , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
c20bd626 Merge pull request #915 from dav... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

@mindspore-ci-bot, 当前/check-pr未通过,原因如下:

以下Pull Request描述检查项未通过:
部分检查项缺失 请重新使用模板
模板中'Test Plan and Test Result' 信息为空,请补充对应信息。

以下issue检查项未通过:
Pull Request未关联issue

请修改好上述检查错误后,重新使用/check-pr触发检查。

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 正在生成合并请求摘要,请稍候…

1 similar comment
@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 正在生成合并请求摘要,请稍候…

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 AI 代码检视正在进行中,请稍候…

1 similar comment
@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

🤖 AI 代码检视正在进行中,请稍候…

@mindspore-ci-bot

Copy link
Copy Markdown
Contributor

head_sha: d57c5521d8a68ffed391c828532d70f97938f80a

CLA Signature Guide

@mindspore-ci-bot , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit Reason
c20bd626 Merge pull request #915 from dav... the email used in the commit is not linked to a signed CLA!
please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

@Probiotics5333

Copy link
Copy Markdown
Contributor Author

/check-pr

@Probiotics5333

Copy link
Copy Markdown
Contributor Author

/check-pr

@Probiotics5333

Copy link
Copy Markdown
Contributor Author

/retest

@mindspore-ai-bot

Copy link
Copy Markdown

🔵 The pipeline #747 is running. Please wait a moment... (Link)

@mindspore-ai-bot

Copy link
Copy Markdown
Project Name Build_Stage Build Result Details(Full/Incremental) Detail
Coverage Line Coverage ❌ FAILURE 63%/0% Link

@mindspore-ai-bot

Copy link
Copy Markdown
Platform Type Module Excution Time Time Limit
_torch - - -
- activation_memory 141.61188s 120.0s
- multicore 88.32263s 120.0s
- auto_models 104.116s 150.0s
- shard 164.915s 300.0s
- pipeline_parallel 494.677s 600.0s
- optimizer 220.667s 300.0s
- accuracy 72.734s 120.0s
- context_parallel 71.655s 120.0s
- swap_optimizer 72.421s 120.0s
- fully_shard 265.471s 600.0s
- clip_grad 69.508s 120.0s
- distributed_checkpoint 67.595s 120.0s
- tensor_parallel 197.654s 300.0s
- dtensor 70.922s 120.0s
- init_weights 65.179s 118.75s
- expert_parallel 62.039s 120.0s
- process_group 56.126s 90.0s
- llama3_examples 56.11s 120.0s

@mindspore-ai-bot

Copy link
Copy Markdown
Project Name Build_Stage Build Result Details
Hyper-parallel_Github_Gate - ❌ FAILURE 747
Check_Pylint FAILURE 740
coverage FAILURE 654
UT_TEST FAILURE 649
UT_TEST FAILURE 654
coverage FAILURE 649

@mindspore-ai-bot

Copy link
Copy Markdown

@Probiotics5333, your gate pipeline failed at the code check stage. You can configure some code check tools locally following the (pre-push quick guide), to enable automatic checking when you push your code every time. Tools included are: Check_CMakelint, Check_Codespell, Check_Cpplint, Check_Lizard, Check_Pylint, Check_ClangFormat, Check_ShellCheck.

davidhe91
davidhe91 previously approved these changes Oct 14, 2026
yaoyifanx
yaoyifanx previously approved these changes Oct 14, 2026
liuchongming74
liuchongming74 previously approved these changes Oct 14, 2026

@liuchongming74 liuchongming74 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@Probiotics5333

Copy link
Copy Markdown
Contributor Author

/check-pr

@Probiotics5333

Copy link
Copy Markdown
Contributor Author

/retest

@mindspore-ai-bot

Copy link
Copy Markdown

🔵 The pipeline #758 is running. Please wait a moment... (Link)

@mindspore-ai-bot

Copy link
Copy Markdown
Project Name Build_Stage Build Result Details(Full/Incremental) Detail
Coverage Line Coverage ✅ SUCCESS 63%/0% Link

@mindspore-ai-bot

Copy link
Copy Markdown
Platform Type Module Excution Time Time Limit
_torch - - -
- activation_memory 110.47163s 120.0s
- shard 152.295s 300.0s
- auto_models 89.387s 150.0s
- pipeline_parallel 491.445s 600.0s
- swap_optimizer 71.645s 120.0s
- multicore 77.87937s 120.0s
- optimizer 203.712s 300.0s
- fully_shard 262.973s 600.0s
- accuracy 67.367s 120.0s
- tensor_parallel 188.281s 300.0s
- init_weights 61.101s 118.75s
- distributed_checkpoint 63.245s 120.0s
- context_parallel 68.102s 120.0s
- clip_grad 65.081s 120.0s
- dtensor 62.149s 120.0s
- expert_parallel 66.888s 120.0s
- process_group 60.742s 90.0s
- llama3_examples 61.633s 120.0s

@mindspore-ai-bot

Copy link
Copy Markdown
Project Name Build_Stage Build Result Details
Hyper-parallel_Github_Gate - ✅ SUCCESS 758

@liuchongming74 liuchongming74 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants