Skip to content

Latest commit

 

History

History
13 lines (11 loc) · 2.88 KB

File metadata and controls

13 lines (11 loc) · 2.88 KB

Query: By Problem / Symptom

Auto-generated. Do not edit manually.

Symptom Pattern Page Candidate Techniques Sources
low-sm-utilization, tail-effect, load-imbalance Low SM Utilization Persistent Kernels with Cluster Launch Control, Tile Scheduling Strategies, Cluster Launch Control (CLC) 3 sources
memory-bound, low-compute-utilization, high-memory-throughput Memory Bandwidth Bound Wide Vectorized Loads and Cache Policies, Shared Memory Swizzling, Software Pipelining and Multi-Stage Buffering 3 sources
load-imbalance, tail-effect, low-sm-utilization MoE Expert Load Imbalance Tile Scheduling Strategies, Persistent Kernels with Cluster Launch Control, Kernel fusion 3 sources
compute-bound, low-tensor-core-utilization, pipeline-stalls Not Reaching Peak FLOPS Two-CTA Cooperative MMA, Software Pipelining and Multi-Stage Buffering, Warp Specialization on Hopper and Blackwell, Epilogue fusion, Software-Emulated Exponential 3 sources
pipeline-stalls, compute-bound, low-tensor-core-utilization Pipeline Stalls Software Pipelining and Multi-Stage Buffering, Warp Specialization on Hopper and Blackwell, Double/Multi-Buffering Patterns, Ping-Pong Scheduling 3 sources
register-pressure, low-occupancy, register-spilling Register Pressure — Low Occupancy Tensor Memory (TMEM), Warp Specialization on Hopper and Blackwell, Register Accumulators to TMEM 2 sources
tail-effect, low-sm-utilization, wave-quantization Tail Effect — Last Wave Underutilization Persistent Kernels with Cluster Launch Control, Cluster Launch Control (CLC), Tile Scheduling Strategies 2 sources