Ax Daniel Goldstein, Eugene Cheah 5/12/2026

Key-Value Means

Key-Value Means (KVM): O(N) attention mechanism supporting fixed or growing state for long-context transformers with subquadratic prefill performance.

Ax Yihang Zhang, Zimeng Huang, Ren Zhai, Yipeng Kang, Tonghan Wang 5/12/2026

NaiAD: Initiate Data-Driven Research for LLM Advertising

NaiAD dataset of 58,999 ad-embedded LLM responses with evaluation metrics for studying LLM-native advertising balancing user experience and platform revenue.

Ax Chengsong Huang, Haolin Liu, Tong Zheng, Runpeng Dai, Langlin Huang, Jinyuan Li, Zongxia Li, Zhepei Wei, Yu Meng, Jiaxin Huang 5/12/2026

G-Zero: Self-Play for Open-Ended Generation from Zero Data

Self-improvement framework for LLMs using intrinsic rewards without verifiers, enabling autonomous evolution on open-ended tasks.

Ax Puming Jiang, Meiyi Wang, Kelvin Lin, Ce Hao, Harold Soh 5/12/2026

Guided Streaming Stochastic Interpolant Policy

Guidance mechanism for stochastic interpolant robot policies enabling test-time steering without retraining for dynamic objectives.