Tagged with

Linear Attention's Revenge: How Kimi Delta Attention Smashes the KV Cache Bottleneck

Moonshot AI's hybrid architecture delivers 6x decoding speed with 75% less memory, making 1M-token contexts actually practical.