Ax Yuxuan Wang, Haixu Wu, Jiaxiang Dong, Yong Liu, Chen Wang, Mingsheng Long, Jianmin Wang 5/5/2026

Deep Time Series Models: A Comprehensive Survey and Benchmark

Comprehensive survey and benchmark of deep time series models covering nonlinear patterns, trends, and recent breakthroughs in time series analysis.

Ax Alejandro Mata Ali, Aitor Moreno Fdez. de Leceta, Jorge L\'opez Rubio 5/5/2026

Anomaly Detection from a Tensor Train Perspective

Tensor network algorithms for anomaly detection using tensor train compression to preserve normal data structure and delete anomalies.

Ax Andreas Bjerregaard, S{\o}ren Hauberg, Anders Krogh 5/5/2026

Riemannian Generative Decoder

Riemannian generative decoder for learning non-Euclidean data representations without brittle encoder-based density estimation.

Ax Cheng Jing, Uvini Balasuriya Mudiyanselage, Woojin Cho, Minju Jo, Anthony Gruber, Kookjin Lee 5/5/2026

Meta-learning Structure-Preserving Dynamics

Meta-learning approach for structure-preserving dynamics discovery applicable across system configurations without retraining.

Ax Lo\"ic Cabannes, Maximilian Beck, Gergely Szilvasy, Matthijs Douze, Maria Lomeli, Jade Copet, Pierre-Emmanuel Mazar\'e, Gabriel Synnaeve, Herv\'e J\'egou 5/5/2026

Short window attention enables long-term memorization

Analysis of sliding window and global attention interaction showing short window length enables effective long-term memorization.

Ax Artyom Sorokin, Nazar Buzun, Alexander Anokhin, Oleg Inozemcev, Egor Vedernikov, Petr Anokhin, Mikhail Burtsev, Trushkov Alexey, Yin Wenshuai, Evgeny Burnaev 5/5/2026

Q-RAG: Long Context Multi-step Retrieval via Value-based Embedder Training

Multi-step retrieval method for RAG systems using value-based embedder training to handle complex questions requiring iterative search.

Ax Zhenchao Tang, Fang Wang, Haohuai He, Jiale Zhou, Tianxu Lv, Jun Zhu, Shouzhi Chen, Minghao Yang, Yu Wang, Jiayang Wu, Yidong Song, Yaokun Li, Jiehui Huang, Bing He, Jianhua Yao 5/5/2026

Aligning LLMs with Biomedical Knowledge using Balanced Fine-Tuning

Balanced fine-tuning approach aligning LLMs with biomedical knowledge by addressing unique uncertainty structures in dense causal chains and rare entities.

Ax Satwik Bhattamishra, Kulin Shah, Michael Hahn, Varun Kanade 5/5/2026

Provably Learning Attention with Queries

Theoretical study of learning Transformer attention mechanisms with black-box query access, proving learnability of single-head attention regressors.