Posts with this tag: 2
v_wmma_i32_16x16x16_iu8 issues at 1.007x the rate of the bf16 WMMA instruction on gfx1100, both at 133 T-ops/s. An int8 MMQ prefill kernel built on the expected 2x lost to the project's own bf16 kernel, 0.91x at n=1024, and the lane closed negative.
ReadA chunked prefill path for a 35B MoE passes identity on 23 of 23 prompts and runs 3.7 to 7.9 times faster than replaying the decode kernel one token at a time. Two variants that would have been faster still, WMMA attention and a dense SSM scan, reorder floating-point sums and stay off by default because they fail the same identity check.
Read
