GPU kernels
Kernels on a gaming GPU · part 2
The Shape That Actually Matters
Square GEMM is the benchmark everyone runs; decode is M=1 streaming weights out of HBM. Four frozen rounds, three wrong predictions, and a one-percent win that came from occupancy relief rather than fewer bytes.
Read