Ax Nicolas Michel, Maorong Wang, Jiangpeng He, Toshihiko Yamasaki 5/7/2026

Continual Distillation of Teachers from Different Domains

Continual Distillation paradigm where students learn sequentially from teacher models without access to training data using external unlabeled data for knowledge transfer.

Ax Guoqiang Zhang, Kenta Niwa, W. Bastiaan Kleijn 5/7/2026

Lookahead Drifting Model

Lookahead drifting model extending drifting model paradigm for image generation with improved optimization trajectory and convergence.

Ax Khouloud Saadi, Di Wang 5/7/2026

Validity-Calibrated Reasoning Distillation

arXiv: Validity-Calibrated Reasoning Distillation transfers multi-step reasoning from large to smaller LLMs using global correctness constraints.

Ax Nicholas J. Cooper, Fran\c{c}ois G. Meyer, Michael L. Roberts, Carlos Zapata-Carratal\'a, Lijun Chen, Danna Gurari 5/7/2026

On the Architectural Complexity of Neural Networks

Theoretical framework for analyzing and constructing deep neural networks with explicit tensor operation structure modeling.