Ax Yucheng Sheng, Jiacheng Wang, Le Liang, Hao Ye, Shi Jin 16d ago

A Graph Foundation Model for Wireless Resource Allocation

Graph foundation model for wireless network resource allocation using deep learning to solve optimization problems more efficiently than classical iterative algorithms.

Ax Oleg Platonov, Liudmila Prokhorenkova 16d ago

Cluster Attention for Graph Machine Learning

Cluster Attention mechanism for graph transformers improving receptive field while preserving graph-structure inductive biases.

Ax Henry C. Conklin, Tom Hosking, Tan Yi-Chern, Julian Gold, Jonathan D. Cohen, Thomas L. Griffiths, Max Bartolo, Seraphina Goldfarb-Tarrant 16d ago

Learning is Forgetting: LLM Training As Lossy Compression

LLM training as lossy compression framework explaining how LLMs learn by retaining task-relevant information from training data.