Denser $\neq$ Better: Limits of On-Policy Self-Distillation for Continual Post-Training
Analysis of self-distillation for continual post-training showing trade-offs between in-domain specialization and knowledge preservation.
Analysis of self-distillation for continual post-training showing trade-offs between in-domain specialization and knowledge preservation.
Discrete diffusion model for language generation combining autoregressive and diffusion decoding with flexible token ordering.
Event-driven hypergraph network for predicting next activity in object-centric business process logs.
Adaptive prune-and-grow framework for parameter-efficient fine-tuning of Mixture-of-Experts models using LoRA.
Deep learning approach for assessing cognitive load from single-channel EEG data during online education.
Parameter-efficient sparse autoencoders for interpreting neural network activations using expander graphs.
Research on whether LLMs generalize in molecular discovery tasks beyond local neighborhoods of sequence representations.
Study of coordinated manipulation attacks on crowdsourced fact-checking systems used by social media platforms.
Multi-role rubric generation for LLM evaluation addressing dimensional blind spots in preference-based reward modeling.
Adaptive group-based counterfactual explanations for multivariate time-series classifiers in rehabilitation movement analysis.
Decomposer: LLM post-training framework for symbolic music decompilation recovering executable music programs from MIDI.
Gaussian Histogram Loss for learning support distributions in distributional reinforcement learning value functions.
Theoretical study of ridge-regularized log-density-ratio estimation in Gaussian location models with spectral methods.
Rank-Then-Act: Reward-free policy learning from expert videos using vision-language models and ordinal scoring.
SABER: Brain network analysis framework integrating LLM semantics with multi-scale hypergraphs for disease diagnosis.
Population-based evolutionary training for semi-supervised GANs formulated as multi-objective optimization problem.
Mechanistic interpretability study of transformer self-repair mechanisms during ablation using conditional co-ablation analysis.
Hybrid quantum-classical neural network for sentiment analysis on COVID-19 tweets using TF-IDF vectorization.
Offline evaluation methods for algorithm comparison offering safer alternative to A/B testing with improved accuracy analysis.
Time series foundation models for low-voltage load forecasting with uncertainty estimation and application-oriented evaluation metrics.
Controlled comparison of nine lightweight CNN architectures across CIFAR-10/100 and Tiny ImageNet under resource constraints.
Liquid neural networks for turbofan degradation modeling with interpretable latent state dynamics on C-MAPSS benchmark.
Survey of anomaly detection methods for time series across cybersecurity, finance, healthcare, and IoT domains.
Online learning algorithm for linear dynamical systems with memory efficiency and sublinear regret guarantees.
Analysis of dataset split failures in spatiotemporally correlated domains, proposing stratified partitioning and curriculum robust optimization.
SA-HGNN: Graph neural network for EEG-based depression recognition using hyperbolic geometry to capture brain network hierarchies.
kNNGuard: Training-free guardrail for LLMs using activation space and k-NN to detect unsafe/adversarial prompts without fine-tuning.
Improved Fourier Neural Operator for modeling Rayleigh-Bénard convection with compact model predicting time increments instead of full solutions.
Bayesian active ranking method using LLM judges to identify top-k candidates while accounting for systematic biases and position effects.
Rolling Split Conformal Prediction applied to pre-incident traction loss detection in automotive systems using per-driver models.
ART: continuous-time control framework using actor-critic learning to optimize timestep allocation in score-based diffusion sampling.
Systematic study probing chemical language models for molecular substructure encoding across pre-trained and fine-tuned variants.
Deep neural network and ensemble methods for early Alzheimer's disease prediction from biomarkers.
Neural graph encoding method for analyzing neural network weight spaces capturing sequential layer-by-layer inference processing.
DALorRA: Bayesian sparse low-rank adaptation method for uncertainty quantification in fine-tuned LLMs to improve trustworthy deployment.
Privacy-preserving distributed coded computing framework addressing privacy leakage and malicious manipulation in federated and decentralized learning.
Optimization framework (DSGNAR) using second-order methods to improve ill-conditioned training of physics-informed neural networks.
Online resource allocation algorithm with continuous random consumption and degeneracy analysis for sequential request acceptance problems.
Self-explainable operator learning framework using functional linear models for interpretable modeling of complex physical systems.
HERMES provides hierarchical multi-granularity labeling system for organizing pre-training data mixtures across different semantic axes.
Study of generalization in offline reinforcement learning showing structure of pessimism matters more than degree for contextual MDPs.
Framework for training visual generative models using distribution-wise rewards to prevent reward hacking and improve image diversity.
Neural quantum states optimization using reinforcement learning perspective for approximating quantum many-body wavefunctions.
Efficient transformer architecture with self-gating attention reducing computational complexity for time series forecasting applications.
DecompRL uses reinforcement learning to teach LLMs modular code generation for solving hard problems by decomposing into solvable subcomponents.
Active few-shot learning method for LLMs that identifies valuable unlabeled samples for annotation to reduce human labeling costs and improve domain-specific adaptation.
Federated learning with quantum enhancement for multi-agent activity recognition in distributed robotic systems addressing non-IID heterogeneous sensor data.
Transformer-based time series forecasting model designed to handle rare extreme events in hydrologic data.
Theoretical analysis of distributed self-supervised learning robustness under non-IID data heterogeneity in decentralized settings.
Neuron-aware data selection method for annotation-free LLM self-distillation in specialized domains without human-labeled supervision.