Posts with this tag: 3
Square GEMM is the benchmark everyone runs; decode is M=1 streaming weights out of HBM. Four frozen rounds, three wrong predictions, and a one-percent win that came from occupancy relief rather than fewer bytes.
ReadA hand-written GEMM that looked twice as fast as the vendor library, and a no-speculation control arm that was quietly speculating: both produced clean, tight, repeatable numbers. The bug was never the math. It was a parameter that was set and never took effect.
ReadA pipelined fp16 WMMA GEMM beats hipBLASLt at ten square sizes on RDNA3, but only once tile shape stops being fixed. Plus a retracted 2x claim and why clock warm-up was worth more than any kernel change.
Read
