▤ Category

GPU kernels

Posts in this category: 3

← Alle berichten
GPU kernels 8 min

Same Bits on the CPU and the GPU

Std.math exp disagreed between the CPU and the GPU on 19,437 of 40,017 inputs. A shared exp written with explicit fma matched on all 40,017, at 3.6 times the cost in an exp-bound kernel. One attention layer then matched bit for bit, and a float Freivalds certificate caught every planted fault.

GPU kernels 6 min

The Shape That Actually Matters

Square GEMM is the benchmark everyone runs; decode is M=1 streaming weights out of HBM. Four frozen rounds, three wrong predictions, and a one-percent win that came from occupancy relief rather than fewer bytes.

Kernels on a gaming GPU · part 2