Ax Lukas Haverbeck, Carmen Amo Alonso, Andres Felipe Posada-Moreno, Sebastian Trimpe, Marco Pavone 9d ago

The risk of KV cache compression

Theoretical analysis of KV cache compression in transformer inference showing when compression is impossible and deriving fundamental limits.

Ax Jiatong Li, Samuel Yeh, Sharon Li 9d ago

Multi-Head Recurrent Memory Agents

Multi-Head Recurrent Memory Agents diagnose reliability degradation in long-context LLMs, attributing failures to memory retention rather than capture.

Ax Ege Onur Taga, Yilin Zhuang, M. Emrullah Ildiz, Petros Mol, Abhimanyu Das, Karthik Duraisamy, Samet Oymak 9d ago

Evolutionary Feature Engineering for Structured Data

EFE framework uses LLM-based evolutionary optimization to discover preprocessing transformations for structured data as Python programs.