Expressive Power of Implicit Models: Rich Equilibria and Test-Time Scaling
Analysis of implicit models with infinite-depth weight-tied networks that match explicit models while reducing memory consumption.
Analysis of implicit models with infinite-depth weight-tied networks that match explicit models while reducing memory consumption.
Empirical study comparing message passing neural networks and graph transformers for atomistic property prediction.
Theoretical analysis of how attention head count influences transformer approximation properties and expressive power.
Adaptive rollout and routing method for data-driven weather forecasting with improved spatiotemporal modeling.
Learning-to-optimize Transformer framework for scalable beamforming in multi-user wireless systems.
Automated algorithm design using machine learning to optimize hyperparameter auto-tuning for high-performance applications.
Continual Transformers architecture for real-time low-latency inference on streaming data with reduced redundant computation.
Survey of deep unfolding techniques combining classical optimization algorithms with neural networks for signal processing.
Research on normalization-free transformer architectures using Dynamic Tanh as alternative to standard normalization layers.
Learning-theoretic approach to extracting interpretable features from superposition in complex ML models.
Split learning system using hybrid-order optimization to reduce memory overhead for collaborative LLM training on edge devices.
Architecture separating energy-based world models from language generation in LLMs to improve understanding vs. fluency tradeoff.
Addresses machine unlearning for sparse LLMs to remove memorized sensitive information while maintaining model sparsification benefits for efficient deployment.
ECHO-2 is distributed RL framework for LLM post-training via reinforcement learning, optimizing cost-efficiency of rollout generation across distributed resources.
VJE introduces reconstruction-free latent-variable framework for self-supervised learning using symmetric conditional ELBO on paired embeddings.
LP-FNO uses Fourier Neural Operators as surrogate model for laser welding simulations, enabling faster parametric solution learning for industrial process optimization.
DGPO: RL-guided graph diffusion model for neural architecture search using reinforcement learning steering.
Study using finetuned LLMs for topic-conditional sentiment extraction to forecast aluminum commodity prices.
Survey of privacy-preserving ML techniques for IoT including federated learning and differential privacy approaches.
Decentralized bi-level RL algorithm for environment design with sample-efficient hypergradient estimation.
MDM-Prime-v2: Improvements to masked diffusion language models through binary encoding and index shuffling.
FIPO: RL algorithm improving token-level credit assignment for reasoning in LLMs beyond outcome-based rewards.
Safety-aware offline RL method using budget-conditioned reachability analysis for constrained decision-making.
SkillRouter: System for routing LLM agent requests to relevant skills from large skill libraries at inference time.
ITQ3_S: 3-bit LLM quantization method using interleaved ternary quantization and rotation-domain smoothing for efficient inference.
Interpretability method for reinforcement learning using principal prototype analysis on manifolds.
Vision transformer optimization for image segmentation with adaptive computation per input image.
LLM-driven conversational recommender system for leisure event discovery with user-centric evaluation in SME context.
Image segmentation approach using divisive normalization for autonomous driving under diverse environmental conditions.
Framework for tightening convex relaxations of trained neural networks with convex and S-shaped activations for optimization incorporation.
Real-time operator takeover paradigm allowing seamless human intervention and correction during visuomotor diffusion policy execution.
German-language LLM pre-training dataset curated via heuristic filtering, model-based selection, and synthetic data generation.
Meta-learning framework using LLMs to automatically design selection operators for evolutionary symbolic regression algorithms.
AVA-Bench systematically evaluates atomic visual abilities of vision foundation models independent of LLM instruction tuning.
SlowFast Sampling optimizes inference efficiency in diffusion-based language models through dynamic, flexible token generation strategies.
Streaming transformer architecture inspired by autoregressive LLMs for real-time 3D geometry perception and reconstruction from video.
NES is an instruction-free code editing framework that learns from historical editing trajectories to suggest next edits with low latency.
Test-time adaptation method using domain augmentation and model ensembles to handle weather-related domain shifts in autonomous driving.
Knowledge distillation and self-supervised learning approach for continual learning with class-incremental learning and external unlabeled data.
Interpretability framework for understanding how components of particle swarm optimization algorithms affect performance.
Benchmark evaluating how large vision-language models handle object recognition in contextually incongruent scenes and manage uncertainty.
ProxyAttn method using representative attention heads to enable efficient sparse attention in LLMs for long-text processing with minimal performance degradation.
Multi-Stream Generative Policy framework for robot learning that combines multiple object-centric policies at inference to improve sample efficiency and generalization.
Neuro-symbolic AI overview connecting neural networks with symbolic reasoning to satisfy constraints, addressing reliable trustworthy AI development.
Efficient local causal discovery method for identifying adjustment sets without learning the full causal graph.
One-shot adaptation framework improving vision-language-action model generalization to novel camera viewpoints through spatial representation recalibration.
Evaluation of LLM performance on Indian language maternal healthcare triage, comparing native scripts versus romanized text in real-world deployment.
Guidance strategy for diffusion transformers using internal model dynamics to improve image generation quality without external classifiers.
Analysis of 25k chain-of-thought trajectories showing neural scaling triggers domain-specific phase transitions in reasoning rather than uniform capability improvements across 8B-70B parameter models.
V0 is a generalist value model for policy gradient methods that scales efficiently with LLM training, replacing large critic models in actor-critic methods like PPO.