Lower grouped GEMM on sm_80 and above (#25017)

c73d218

Select commit

Loading

Failed to load commit list.

Uh oh!

There was an error while loading. Please reload this page.

Meta CLA

Meta CLA Check

Check Labels on: pull_request_target 2

Check labels

Labeler on: pull_request_target 3

label

Lint on: pull_request 11

Get changed files / get-changed-files

link-check / lint-urls

link-check / lint-xrefs

link-check / lint-file-size

lintrunner-mypy

lintrunner

Build documentation on: pull_request 7

Resolve CI docker image / resolve

build (buck2) / Build doc

upload-gh-pages

Test CUDA Builds on: pull_request 84

Get changed files / get-changed-files

CI run decision / decide

Validate benchmark dispatch inputs

test-executorch-cuda-build-13.0 / linux-job

test-executorch-cuda-build-13.4 / linux-job

test-models-cuda / linux-job

export-cuda-multi-arch-a100 / linux-job

unittest-cuda (kernel) / linux-job

unittest-cuda (system) / linux-job

unittest-cuda-muse-glimmer-batching / linux-job

unittest-cuda-quantized-gemm (int4) / linux-job

unittest-cuda-quantized-gemm (large-int5-int6-int8-graph-timing) / linux-job

unittest-cuda-runtime / linux-job

test-muse-glimmer-cuda-e2e-kquant-17gb-dflash-image-batching / linux-job

test-muse-glimmer-cuda-e2e-kquant-dynamic-solo-text / linux-job

test-muse-glimmer-cuda-e2e-kquant-dynamic-dflash-image / linux-job

test-model-cuda-e2e-${{ matrix.model.name }}-${{ matrix.quant }}

check-all-cuda-builds

merge-and-test-cuda-multi-arch-a10g / linux-job

upload-benchmark-results

test-cuda-merged-pte-a100 / linux-job

Test QNN Windows MSVC build on: pull_request 2

build-qnn-windows-x64 / windows-job

build-qnn-windows-arm64

Test ROCm AOTI on: pull_request 5

Get changed files / get-changed-files

CI run decision / decide

AOTI CI run decision

Voxtral CI run decision

unittest-rocm-gfx950-rocm${{ matrix.rocm-version }}

test-voxtral-realtime-rocm-gfx950-rocm${{ matrix.rocm-version }}

test-voxtral-realtime-rocm-gfx1100-rocm${{ matrix.rocm-version }}

periodic on: pull_request 33

Resolve CI docker image / resolve

gather-models

test-models-linux (buck2, mv3, portable, mt-l-x86iavx512-8-64, 90) / linux-job

test-models-linux (buck2, mv3, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64, 90) / linux-job

test-models-linux (cmake, mv3, portable, mt-l-x86iavx512-8-64, 90) / linux-job

test-models-linux (cmake, mv3, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64, 90) / linux-job

test-models-linux (cmake, vit, portable, mt-l-x86iavx512-8-64, 90) / linux-job

test-models-linux (cmake, vit, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64, 90) / linux-job

Test CPU Backend on: pull_request 12

test-cpu / Resolve CI docker image / resolve

test-cpu / test-backend-macos

test-cpu / test-backend-linux (cpu_fp32, models) / linux-job

test-cpu / test-backend-linux (cpu_fp32, operators) / linux-job

test-cpu / package-golden-artifacts

Labeler on: pull_request_target 1

label

Cadence Build & Test on: pull_request

Resolve CI docker image

cpu-build

hifi-build

vision-build

hifi1s-build

hifi5s-build

cpu-test

hifi-op-test

hifi1s-op-test

hifi5s-op-test

Test WebGPU Backend on: pull_request 12

test-webgpu / Resolve CI docker image / resolve

test-webgpu / test-backend-macos

test-webgpu / test-backend-linux (webgpu, models) / linux-job

test-webgpu / test-backend-linux (webgpu, operators) / linux-job

test-webgpu / package-golden-artifacts

Test Cortex-M Backend on: pull_request 1

Get changed files / get-changed-files

test-cortex-m

Test QNN Backend on: pull_request 12

test-qnn / Resolve CI docker image / resolve

test-qnn / test-backend-macos

test-qnn / test-backend-linux (qnn, models) / linux-job

test-qnn / test-backend-linux (qnn, operators) / linux-job

test-qnn / package-golden-artifacts

pull on: pull_request 8

Resolve CI docker image / resolve

Get changed files / get-changed-files

CI run decision / decide

android / build-android

android / run-emulator

unittest / Resolve CI docker image / resolve

unittest / macos / macos-job

unittest / windows / windows-job

unittest / linux / linux-job

unittest-buck / Resolve CI docker image / resolve

unittest-buck / macos / macos-job

unittest-buck / windows

unittest-buck / linux / linux-job

test-setup-linux-gcc / linux-job

test-models-linux-basic (mv3, portable, cmake, mt-l-x86iavx512-8-64, executorch-ubuntu-22.04-clan... / linux-job

test-models-linux-basic (mv3, portable, cmake, mt-l-arm64g4-16-62, executorch-ubuntu-22.04-gcc11-... / linux-job

test-models-linux-basic (mv3, portable, buck2, mt-l-x86iavx512-8-64, executorch-ubuntu-22.04-clan... / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, mt-l-x86iavx512-8-64, execu... / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, mt-l-arm64g4-16-62, executo... / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, mt-l-x86iavx512-8-64, execu... / linux-job

test-models-linux-basic (vit, portable, cmake, mt-l-x86iavx512-8-64, executorch-ubuntu-22.04-clan... / linux-job

test-models-linux-basic (vit, portable, cmake, mt-l-arm64g4-16-62, executorch-ubuntu-22.04-gcc11-... / linux-job

test-models-linux-basic (vit, portable, buck2, mt-l-x86iavx512-8-64, executorch-ubuntu-22.04-clan... / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, mt-l-x86iavx512-8-64, execu... / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, mt-l-arm64g4-16-62, executo... / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, mt-l-x86iavx512-8-64, execu... / linux-job

test-models-linux (linear, portable, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (linear, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (add, portable, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (add, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (add_mul, portable, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (add_mul, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (ic3, portable, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (ic3, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (mv2, portable, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (mv2, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (resnet18, portable, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (resnet18, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (resnet50, portable, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (resnet50, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (mobilebert, portable, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (mobilebert, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (emformer_transcribe, portable, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, mt-l-x86iavx512-8-64) / linux-job

test-models-linux (ic4, portable, mt-l-x86iavx512-16-128) / linux-job

test-models-linux (ic4, xnnpack-quantization-delegation, mt-l-x86iavx512-16-128) / linux-job

test-models-linux (emformer_join, portable, mt-l-x86iavx512-16-128) / linux-job

test-models-linux (emformer_join, xnnpack-quantization-delegation, mt-l-x86iavx512-16-128) / linux-job

test-models-linux (phi_4_mini, portable, mt-l-x86iavx512-16-128) / linux-job

test-models-linux (llama3_2_vision_encoder, portable, mt-l-x86iavx512-16-128) / linux-job

test-models-linux (w2l, portable, mt-l-x86iavx512-16-128) / linux-job

test-parakeet-xnnpack-linux / linux-job

test-voxtral-realtime-xnnpack-linux / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+qe, mt-l-x86iavx512-8-64, executorch-ubuntu-22.04-c... / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+qe, mt-l-arm64g4-16-62, executorch-ubuntu-22.04-gcc... / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, mt-l-x86iavx512-8-64, executorch-ubunt... / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, mt-l-arm64g4-16-62, executorch-ubuntu-... / linux-job

test-llama-runner-linux (fp32, xnnpack+quantize_kv, mt-l-x86iavx512-8-64, executorch-ubuntu-22.04... / linux-job

test-llama-runner-linux (fp32, xnnpack+quantize_kv, mt-l-arm64g4-16-62, executorch-ubuntu-22.04-g... / linux-job

test-llama-runner-linux (bf16, custom, mt-l-x86iavx512-8-64, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux-android / linux-job

test-custom-ops-linux / linux-job

test-selective-build-linux / linux-job

test-multimodal-linux

test-moshi-linux / linux-job

test-quantized-aot-lib-linux / linux-job

test-binary-size-linux-gcc / linux-job

test-binary-size-linux / linux-job

test-arm-cortex-m-size-test (bare_metal) / linux-job

test-arm-cortex-m-size-test (zephyr-preset) / linux-job

test-mediatek-models-linux

test-qnn-wheel-packages-linux

test-arduino-library

test-minimal-wheel-linux

test-pybindings-no-aten

test-mcu-cortex-m-backend

unittest-editable

test-qnn-buck-build-linux

test-arm-backend-docgen

test-arm-backend-no-driver

test-arm-backend-vkml

test-arm-backend-public-api-backward-compatibility

test-llama-runner-qnn-linux

test-static-llama-qnn-linux

test-sqnr-static-llm-qnn-linux

test-qnn-models-linux

test-qnn-direct-build-linux

test-qnn-testsuite-linux

test-qnn-passes-linux

test-qnn-delegate-linux

test-phi-3-mini-runner-linux

test-qnn-python-imports-linux

test-eval_llama-wikitext-linux

test-llama_runner_eager-linux

test-lora-linux

test-lora-multimethod-linux

test-openvino-linux

test-build-wasm-linux

unittest-wasm-bindings

unittest-nxp-neutron

test-vulkan-models-linux

test-vulkan-operators-linux

nxp-build-test

nxp-mcuxpresso-test

llm-server

test-coreml-bc-macos (${{ matrix.runner }})

Build Windows CUDA Wheels on: pull_request 9

generate-matrix / generate

Resolve CI docker image / resolve

filter-matrix

pytorch/executorch / build-wheel-py3_11-cuda13_2

pytorch/executorch / upload / upload-wheel-py3_11-cuda13_2

cuda-trains

export-cuda-windows-wheel-program-${{ matrix.cuda-version }}

bundle-cuda-windows-wheel-e2e-${{ matrix.cuda-version }}

test-cuda-windows-wheel-e2e-${{ matrix.cuda-version }}

Test XNNPACK Backend on: pull_request 12

test-xnnpack / Resolve CI docker image / resolve

test-xnnpack / test-backend-macos

test-xnnpack / test-backend-linux (xnnpack, models) / linux-job

test-xnnpack / test-backend-linux (xnnpack, operators) / linux-job

test-xnnpack / package-golden-artifacts

Build Presets on: pull_request 51

Resolve CI docker image / resolve

apple (macos) / build

apple (ios) / build

apple (ios-simulator) / build

apple (pybind) / build

apple (profiling) / build

apple (llm) / build

windows (pybind) / build

windows (windows) / build

zephyr (zephyr) / build

linux (linux, mt-l-x86iavx512-8-64, executorch-ubuntu-22.04-clang12) / build

linux (linux, mt-l-arm64g4-16-62, executorch-ubuntu-22.04-gcc11-aarch64) / build

linux (pybind, mt-l-x86iavx512-8-64, executorch-ubuntu-22.04-clang12) / build

linux (pybind, mt-l-arm64g4-16-62, executorch-ubuntu-22.04-gcc11-aarch64) / build

linux (llm, mt-l-x86iavx512-8-64, executorch-ubuntu-22.04-clang12) / build

linux (llm, mt-l-arm64g4-16-62, executorch-ubuntu-22.04-gcc11-aarch64) / build

Build Linux CUDA Wheels on: pull_request 6

generate-matrix / generate

filter-matrix

pytorch/executorch / build-manywheel-py3_11-cuda13_2

pytorch/executorch / upload / upload-manywheel-py3_11-cuda13_2

Build Aarch64 Linux CUDA Wheels on: pull_request 6

generate-matrix / generate

filter-matrix

pytorch/executorch / build-wheel-py3_11-cuda-aarch6413_2-aarch64

pytorch/executorch / upload / upload-wheel-py3_11-cuda-aarch6413_2-aarch64

Test CUDA Windows Export and E2E on: pull_request 6

Resolve CI docker image / resolve

Get changed files / get-changed-files

CI run decision / decide

export-model-cuda-windows-artifact

unittest-cuda-runtime-windows / windows-job

test-model-cuda-windows-e2e

delete-model-cuda-windows-artifacts

Test NXP Backend on: pull_request 1

Get changed files / get-changed-files

test-nxp

Test ARM Backend on: pull_request 24

test-arm / Resolve CI docker image / resolve

test-arm / test-backend-macos

test-arm / test-backend-linux (arm_tosa_fp, models) / linux-job

test-arm / test-backend-linux (arm_tosa_fp, operators) / linux-job

test-arm / package-golden-artifacts

test-arm-vgf / Resolve CI docker image / resolve

test-arm-vgf / test-backend-macos

test-arm-vgf / test-backend-linux (arm_vgf_fp, models) / linux-job

test-arm-vgf / test-backend-linux (arm_vgf_fp, operators) / linux-job

test-arm-vgf / package-golden-artifacts

Test Vulkan Backend on: pull_request 12

test-vulkan / Resolve CI docker image / resolve

test-vulkan / test-backend-macos

test-vulkan / test-backend-linux (vulkan, models) / linux-job

test-vulkan / test-backend-linux (vulkan, operators) / linux-job

test-vulkan / package-golden-artifacts

Test CoreML Backend on: pull_request 1

Get changed files / get-changed-files

test-coreml

Meta CodeSync

Meta Import Checks

Meta Internal-Only Changes Check

Facebook GitHub Tools

Facebook Internal - Builds & Tests

Facebook Internal - Linter

PyTorch Bot

Dr.CI

Meta CodeSync / Meta Internal-Only Changes Check succeeded Nov 13, 2026 in 0s

This Pull Request and its Phabricator Diff are identical

View more details on Meta CodeSync

Loading

Re-running checks...