✎Blog

Blog

Note dagli progetti di AMARBARO — risultati misurati, il protocollo sotto il quale sono stati misurati, e le previsioni che si sono rivelate errate.

Più recenti Models and quality 3 min di lettura

Krea 2 Wins the Background

Krea 2 won the background task 2 to 1 because it followed the empty-space instruction. Z-Image stayed sharper and faster, so the choice depends on the job.

Serie

Image models in a real pipeline

1 parti, in ordine di lettura
  1. 01 Krea 2 Wins the Background
Serie

Gates that lie

5 parti, in ordine di lettura
  1. 01 A Gate the Candidate Can Write
  2. 02 Your Reference Fails Its Own Reference
  3. 03 The Tool Gate Must Own the First Move
  4. 04 Compare Bytes, Not Ids
  5. 05 A Reboot Is Not a Health Check
Serie

Token reduction

1 parti, in ordine di lettura
  1. 01 The Cache Is Not the Only Token Budget
Serie

Mojo on a phone

1 parti, in ordine di lettura
  1. 01 An Arm64 Engine, Bit-Exact on Two Phones, and One Steady on One
Serie

A 35B MoE on one consumer card

3 parti, in ordine di lettura
  1. 01 Experts in Host RAM
  2. 02 Forty-Two to One Hundred Eleven
  3. 03 Prefill as a Batch
Serie

Kernels on a gaming GPU

5 parti, in ordine di lettura
  1. 01 Beating hipBLASLt on a Gaming GPU
  2. 02 The Shape That Actually Matters
  3. 03 Spread Does Not Detect an Inert Parameter
  4. 04 Beating llama.cpp at Decode, Without Speculating
  5. 05 A Stolen LDS Slot Produces Wrong Tokens, Not an Error

Single posts

Practice

Keeping the Failures In

BARO_SPEC defaults to on. Setting it on the MoE model changes nothing, because the actual gate in the code is BARO_SPEC and a model flag that is always false for that architecture, and the document says so in the same line rather than in a footnote.

Read

Everything, newest first

22 posts
  1. Krea 2 Wins the Background Models and quality 3 min
  2. The Tool Gate Must Own the First Move Measurement 3 min
  3. The Cache Is Not the Only Token Budget Practice 2 min
  4. A Reboot Is Not a Health Check Practice 3 min
  5. Your Reference Fails Its Own Reference Measurement 6 min
  6. The GPU Is a Queue Practice 7 min
  7. Publishing Without Publishing Yourself Practice 8 min
  8. An Arm64 Engine, Bit-Exact on Two Phones, and One Steady on One Edge and mobile 8 min
  9. Keeping the Failures In Practice 7 min
  10. int8 WMMA Is Not Faster GPU kernels 5 min
  11. Compare Bytes, Not Ids Measurement 7 min
  12. A Model File That Carries Its Own Kernels Systems design 9 min
  13. Prefill as a Batch GPU kernels 9 min
  14. Experts in Host RAM Systems design 7 min
  15. Forty-Two to One Hundred Eleven GPU kernels 6 min
  16. The IPC Primitive Is a Latent Tensor Systems design 9 min
  17. A Gate the Candidate Can Write Measurement 7 min
  18. Beating llama.cpp at Decode, Without Speculating GPU kernels 5 min
  19. A Stolen LDS Slot Produces Wrong Tokens, Not an Error GPU kernels 8 min
  20. The Shape That Actually Matters GPU kernels 6 min
  21. Spread Does Not Detect an Inert Parameter Measurement 7 min
  22. Beating hipBLASLt on a Gaming GPU GPU kernels 8 min