LeapQuant: Efficient Linear Attention with Accurate Recurrent State Quantization
arXiv:2609.38166v3 Announce Type: replace-cross Abstract: Recent LLMs increasingly adopt hybrid designs that replace standard attention with linear attention, such as Gated DeltaNet (GDN) and Kimi Delta Attention (KDA). Although they compress the context into a fixed-size recurrent state and substantially reduce the cost of long-context processing, repeatedly reading and updating that state remains a major inference bottleneck. Quantization offers a natural way to reduce this cost, but can signi
阅读原始来源来源记录
项目分析
暂无五维分析,可先查看上方来源资料。