✎Blog

Blog

Notizen aus den Projekten von AMARBARO — gemessene Ergebnisse, das Protokoll, unter dem sie gemessen wurden, und die Vorhersagen, die sich als falsch herausstellten.

Neueste Models and quality 3 Min. Lesezeit

Krea 2 Wins the Background

Krea 2 won the background task 2 to 1 because it followed the empty-space instruction. Z-Image stayed sharper and faster, so the choice depends on the job.

Serie

Image models in a real pipeline

1 Teile, in Leseordnung
  1. 01 Krea 2 Wins the Background
Serie

Gates that lie

5 Teile, in Leseordnung
  1. 01 A Gate the Candidate Can Write
  2. 02 Your Reference Fails Its Own Reference
  3. 03 The Tool Gate Must Own the First Move
  4. 04 Compare Bytes, Not Ids
  5. 05 A Reboot Is Not a Health Check
Serie

Token reduction

1 Teile, in Leseordnung
  1. 01 The Cache Is Not the Only Token Budget
Serie

Mojo on a phone

1 Teile, in Leseordnung
  1. 01 An Arm64 Engine, Bit-Exact on Two Phones, and One Steady on One
Serie

A 35B MoE on one consumer card

3 Teile, in Leseordnung
  1. 01 Experts in Host RAM
  2. 02 Forty-Two to One Hundred Eleven
  3. 03 Prefill as a Batch
Serie

Kernels on a gaming GPU

5 Teile, in Leseordnung
  1. 01 Beating hipBLASLt on a Gaming GPU
  2. 02 The Shape That Actually Matters
  3. 03 Spread Does Not Detect an Inert Parameter
  4. 04 Beating llama.cpp at Decode, Without Speculating
  5. 05 A Stolen LDS Slot Produces Wrong Tokens, Not an Error

Single posts

Practice

Keeping the Failures In

BARO_SPEC defaults to on. Setting it on the MoE model changes nothing, because the actual gate in the code is BARO_SPEC and a model flag that is always false for that architecture, and the document says so in the same line rather than in a footnote.

Read

Everything, newest first

22 posts
  1. Krea 2 Wins the Background Models and quality 3 Min.
  2. The Tool Gate Must Own the First Move Measurement 3 Min.
  3. The Cache Is Not the Only Token Budget Practice 2 Min.
  4. A Reboot Is Not a Health Check Practice 3 Min.
  5. Your Reference Fails Its Own Reference Measurement 6 Min.
  6. The GPU Is a Queue Practice 7 Min.
  7. Publishing Without Publishing Yourself Practice 8 Min.
  8. An Arm64 Engine, Bit-Exact on Two Phones, and One Steady on One Edge and mobile 8 Min.
  9. Keeping the Failures In Practice 7 Min.
  10. int8 WMMA Is Not Faster GPU kernels 5 Min.
  11. Compare Bytes, Not Ids Measurement 7 Min.
  12. A Model File That Carries Its Own Kernels Systems design 9 Min.
  13. Prefill as a Batch GPU kernels 9 Min.
  14. Experts in Host RAM Systems design 7 Min.
  15. Forty-Two to One Hundred Eleven GPU kernels 6 Min.
  16. The IPC Primitive Is a Latent Tensor Systems design 9 Min.
  17. A Gate the Candidate Can Write Measurement 7 Min.
  18. Beating llama.cpp at Decode, Without Speculating GPU kernels 5 Min.
  19. A Stolen LDS Slot Produces Wrong Tokens, Not an Error GPU kernels 8 Min.
  20. The Shape That Actually Matters GPU kernels 6 Min.
  21. Spread Does Not Detect an Inert Parameter Measurement 7 Min.
  22. Beating hipBLASLt on a Gaming GPU GPU kernels 8 Min.