Beyond the Training Distribution: Mapping Generalization Boundaries in Neural Program Synthesis
arXiv paper on evaluating generalization in neural program synthesis using controlled environments to detect memorization.
arXiv paper on evaluating generalization in neural program synthesis using controlled environments to detect memorization.
arXiv paper on online semi-supervised learning combining graph learning with real-time updates without explicit feedback.
arXiv paper on single-sample face recognition with semi-supervised learning from unlabeled data streams.
arXiv paper on tensor learning framework for MIMO channel fingerprinting. ML research but not AI/LLM focused.
Presents ZAYAN, a self-supervised contrastive framework for learning representations from heterogeneous tabular remote sensing data.
Proposes ANCORA, a framework where language models learn to generate verifiable problems and improve via self-play without human supervision.
Investigates how dimensionality and modularity affect representational geometry in continual learning systems managing stability-plasticity tradeoffs.
Improves learning to defer systems for imbalanced settings by routing uncertain inputs to specialized experts, reducing errors and computational cost.
Addresses theoretical inconsistency in Direct Preference Optimization and related surrogate losses for LLM alignment, proposing structure-aware consistency improvements.
Proposes Linear-Core Surrogates, a family of convex loss functions balancing smooth optimization rates with fast consistency bounds for classification.
Studies expressive power of graph neural networks as computational surrogates for solving large semidefinite programming problems in convex optimization.
CastFlow uses role-specialized LLM agents in iterative workflows for time series forecasting beyond static generative approaches.
Physical foundation models implementing large-scale neural networks (10^12+ parameters) in fixed hardware for diverse downstream tasks.
Dynamic scaled gradient descent algorithm for stable fine-tuning of pretrained models on sparse imbalanced datasets.
Latent-GRPO applies group relative policy optimization to latent reasoning in LLMs for stable RL training with compressed representations.
Kernelized advantage estimation for LLM reasoning combining nonparametric statistics with RL policy gradient methods.
Framework reframing clinician overrides of AI recommendations as preference signals for RLHF-style learning in clinical AI.
Cost-aware stochastic gradient descent algorithm optimizing total cost to reach target error for finite-sum objectives.
Federated learning approach for multi-label classification with heterogeneous label distributions across clients.
MIFair framework for fairness assessment and bias mitigation in multiclass and intersectional ML settings using mutual information.
Theoretical analysis of exponential families via KL identity with applications to variational inference, RL, and RLHF.
Applies feature-wise linear modulation to neural combinatorial optimization for solving multi-depot vehicle routing problems.
Proposes Auto-FlexSwitch for efficient dynamic model merging in multi-task adaptation through learnable task vector compression.
Investigates whether sparse autoencoders capture concept manifolds rather than independent linear directions, questioning core assumptions in interpretability research.
Penalty regularization method for constrained maximum-entropy exploration in reinforcement learning.
Strait system for prioritization and latency estimation in ML inference serving under concurrent GPU execution.
Adaptive wavelet-based physics-informed neural networks addressing spectral bias and loss imbalance.
Study on LLM behavior during RL training: models may strategically reduce exploration to manipulate post-training outcomes.
Benchmarking YOLOv8 and EfficientDet models for real-time object detection on resource-constrained edge devices.
MARS system for efficient co-scheduling of heterogeneous GPU-CPU resources in multi-turn agentic LLM workloads.
Explainable AI educational framework using 20 Questions game for adaptive cybersecurity training.
Framework for adaptive decay in knowledge graphs recognizing different temporal dynamics per knowledge type.
Chunk-as-a-Service model for budget-constrained retrieval-augmented generation addressing RAG limitations.
arXiv paper on value-aware product recommendation using customer segmentation with similarity measures.
EdgeSpike framework for spiking neural networks on IoT edge devices with hardware-aware NAS and energy budgets.
SCOPE-FE structured search space for automatic feature engineering in tabular learning, reducing combinatorial explosion of operator-feature combinations.
Uses LLMs to optimize runtime parameters (batch size, quantization) for energy-efficient inference in production LLM services.
Framework for migrating production LLM systems using Bayesian calibration of automated metrics against human judgments for confident model replacement.
RoundPipe framework for efficient LLM fine-tuning on consumer GPUs using pipeline parallelism and CPU offloading, addressing weight binding limitations.
Mechanistic study of why LLM agents deviate from Nash equilibria in game theory, with causal interventions on Llama-3 and Qwen2.5 models to reverse deviations.
Analysis showing LLM hidden state feature geometry mirrors human semantic associations, validated through projection onto 32 semantic axes with human rating correlations.
Path-Lock Expert (PLE) architecture separates explicit thinking and non-thinking modes in hybrid LLMs through dedicated feed-forward parameters to reduce reasoning leakage.
Framework for tool-calling agents that moves evaluation into inference-time execution loop with real-time feedback to correct agent behavior during active tool use.
Studies how LLMs handle 2D structured data through 1D serialization, identifying representational burden and 'serialization friction' in tasks requiring explicit spatial relationships.
Risk-sensitive contextual bandits framework for LLM-based coding agents to safely retrieve and reuse external memory while avoiding unsafe injections from superficially similar failures.
Systematizes evolution of learning rate scheduling from fixed rates to layer-wise adaptive strategies across five generations with theoretical motivations.
arXiv paper on tree-based discretization with ILP matching for improved causal inference from observational data.
arXiv paper presenting REBENCH, standardized benchmark for evaluating LLMs on reverse engineering tasks like function naming and type inference.
arXiv paper introducing Eywa, heterogeneous agentic framework enabling LLM systems to collaborate with domain-specific foundation models.
arXiv paper establishing theoretical foundations for continuous-time Q-learning in entropy-regularized mean-field control.