✎Blog

Blog

Notatki z projektów AMARBARO — zmierzone wyniki, protokół, w ramach którego były one mierzone, oraz prognozy, które się nie potwierdziły.

Najnowsze Models and quality 3 min czytania

Krea 2 Wins the Background

Krea 2 won the background task 2 to 1 because it followed the empty-space instruction. Z-Image stayed sharper and faster, so the choice depends on the job.

Seria

Image models in a real pipeline

1 części, w porządku czytania
  1. 01 Krea 2 Wins the Background
Seria

Gates that lie

5 części, w porządku czytania
  1. 01 A Gate the Candidate Can Write
  2. 02 Your Reference Fails Its Own Reference
  3. 03 The Tool Gate Must Own the First Move
  4. 04 Compare Bytes, Not Ids
  5. 05 A Reboot Is Not a Health Check
Seria

Token reduction

1 części, w porządku czytania
  1. 01 The Cache Is Not the Only Token Budget
Seria

Mojo on a phone

1 części, w porządku czytania
  1. 01 An Arm64 Engine, Bit-Exact on Two Phones, and One Steady on One
Seria

A 35B MoE on one consumer card

3 części, w porządku czytania
  1. 01 Experts in Host RAM
  2. 02 Forty-Two to One Hundred Eleven
  3. 03 Prefill as a Batch
Seria

Kernels on a gaming GPU

5 części, w porządku czytania
  1. 01 Beating hipBLASLt on a Gaming GPU
  2. 02 The Shape That Actually Matters
  3. 03 Spread Does Not Detect an Inert Parameter
  4. 04 Beating llama.cpp at Decode, Without Speculating
  5. 05 A Stolen LDS Slot Produces Wrong Tokens, Not an Error

Single posts

Practice

Keeping the Failures In

BARO_SPEC defaults to on. Setting it on the MoE model changes nothing, because the actual gate in the code is BARO_SPEC and a model flag that is always false for that architecture, and the document says so in the same line rather than in a footnote.

Read

Everything, newest first

22 posts
  1. Krea 2 Wins the Background Models and quality 3 min
  2. The Tool Gate Must Own the First Move Measurement 3 min
  3. The Cache Is Not the Only Token Budget Practice 2 min
  4. A Reboot Is Not a Health Check Practice 3 min
  5. Your Reference Fails Its Own Reference Measurement 6 min
  6. The GPU Is a Queue Practice 7 min
  7. Publishing Without Publishing Yourself Practice 8 min
  8. An Arm64 Engine, Bit-Exact on Two Phones, and One Steady on One Edge and mobile 8 min
  9. Keeping the Failures In Practice 7 min
  10. int8 WMMA Is Not Faster GPU kernels 5 min
  11. Compare Bytes, Not Ids Measurement 7 min
  12. A Model File That Carries Its Own Kernels Systems design 9 min
  13. Prefill as a Batch GPU kernels 9 min
  14. Experts in Host RAM Systems design 7 min
  15. Forty-Two to One Hundred Eleven GPU kernels 6 min
  16. The IPC Primitive Is a Latent Tensor Systems design 9 min
  17. A Gate the Candidate Can Write Measurement 7 min
  18. Beating llama.cpp at Decode, Without Speculating GPU kernels 5 min
  19. A Stolen LDS Slot Produces Wrong Tokens, Not an Error GPU kernels 8 min
  20. The Shape That Actually Matters GPU kernels 6 min
  21. Spread Does Not Detect an Inert Parameter Measurement 7 min
  22. Beating hipBLASLt on a Gaming GPU GPU kernels 8 min