Ax M. Reza Ebrahimi, Micha\"el Defferrard, Sunny Panchal, Roland Memisevic 2/23/2026

On the "Induction Bias" in Sequence Models

Large-scale empirical study of transformer state tracking limitations in distribution, examining induction bias and generalization beyond length extrapolation.

Ax Kristopher W. Reese, Taylor Kulp-McDowall, Michael Majurski, Tim Blattner, Derek Juba, Peter Bajcsy, Antonio Cardone, Philippe Dessauw, Alden Dima, Anthony J. Kearsley, Melinda Kleczynski, Joel Vasanth, Walid Keyrouz, Chace Ashcraft, Neil Fendley, Ted Staley, Trevor Stout, Josh Carney, Greg Canal, Will Redman, Aurora Schmidt, Cameron Hickert, William Paul, Jared Markowitz, Nathan Drenkow, David Shriver, Marissa Connor, Keltin Grimes, Marco Christiani, Hayden Moore, Jordan Widjaja, Kasimir Gabert, Uma Balakrishnan, Satyanadh Gundimada, John Jacobellis, Sandya Lakkur, Vitus Leung, Jon Roose, Casey Battaglino, Farinaz Koushanfar, Greg Fields, Xihe Gu, Yaman Jandali, Xinqiao Zhang, Akash Vartak, Tim Oates, Ben Erichson, Michael Mahoney, Rauf Izmailov, Xiangyu Zhang, Guangyu Shen, Siyuan Cheng, Shiqing Ma, XiaoFeng Wang, Haixu Tang, Di Tang, Xiaoyi Chen, Zihao Wang, Rui Zhu, Susmit Jha, Xiao Lin, Manoj Acharya, Wenchao Li, Chao Chen 2/23/2026

Trojans in Artificial Intelligence (TrojAI) Final Report

IARPA TrojAI program final report on detecting and mitigating backdoor trojans in AI models.

Ax Vincent Grari, Ciprian Tomoiaga, Sylvain Lamprier, Tatsunori Hashimoto, Marcin Detyniecki 2/23/2026

Agentic Adversarial QA for Improving Domain-Specific LLMs

Method using LLM agents to generate high-quality synthetic adversarial QA data for fine-tuning domain-specific language models.

Ax Yuankai Luo, Woping Chen, Tong Liang, Baiqiao Wang, Zhenguo Li 2/23/2026

SimVLA: A Simple VLA Baseline for Robotic Manipulation

Simplified Vision-Language-Action baseline for robotic manipulation disentangling architectural innovations from training recipe contributions.

Ax Yi Xu, Chengzu Li, Han Zhou, Xingchen Wan, Caiqi Zhang, Anna Korhonen, Ivan Vuli\'c 2/23/2026

Visual Planning: Let's Think Only with Images

Approach for using visual modalities instead of text for reasoning in multimodal LLMs, especially for vision-centric tasks.

Ax Daniil Medyakov, Sergey Stanko, Gleb Molodtsov, Philip Zmushko, Grigoriy Evseev, Egor Petrov, Aleksandr Beznosikov 2/23/2026

Sign-SGD via Parameter-Free Optimization

Parameter-free optimization for Sign-SGD addressing stepsize selection for memory-efficient LLM training and gradient compression in distributed learning.