Skip to content

feat: add x_attention_v2 operator - #46

Open
hot-water-fish wants to merge 1 commit into
xLLM-AI:mainfrom
hot-water-fish:feat/x-attention-v2
Open

feat: add x_attention_v2 operator#46
hot-water-fish wants to merge 1 commit into
xLLM-AI:mainfrom
hot-water-fish:feat/x-attention-v2

Conversation

@hot-water-fish

Copy link
Copy Markdown
  • Add x_attention_v2 operator (copied from x_attention, renamed identifiers)

  • Register XAttentionV2 in build_aclnn.sh for ascend950 only

  • Add Python bindings: x_attention_v2_impl_npu and x_attention_v2_npu

  • Add test_x_attention_v2.py with 18 parametrized test cases

…scend950 only)

- Add x_attention_v2 operator (copied from x_attention, renamed identifiers)

- Register XAttentionV2 in build_aclnn.sh for ascend950 only

- Add Python bindings: x_attention_v2_impl_npu and x_attention_v2_npu

- Add test_x_attention_v2.py with 18 parametrized test cases
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant