CausalMix: Data Mixture as Causal Inference for Language Model Training
arXiv paper on CausalMix for optimizing data mixture weights in LLM training using causal inference without retraining.
arXiv paper on CausalMix for optimizing data mixture weights in LLM training using causal inference without retraining.
arXiv paper on SynLaD latent diffusion framework for generating synthesizable drug molecules with pharmacophore constraints.
arXiv paper proposing Muon optimizer as implicit residual connection during neural network training, explaining its effectiveness.
arXiv paper presenting ZO-Act for efficient zeroth-order fine-tuning of large language models using activation-informed low-rank subspaces.
arXiv paper on GAIA, a geometry-adaptive neural operator learning method for PDEs including boundary value and inverse problems.
arXiv paper proposing IMPF for reward alignment in generative models with sequential feedback-driven exploration.
ER-JEPA lightweight self-supervised learning framework using hierarchical joint-embedding predictive architecture for ECG signal analysis.
Learned 3D Gaussian representation for efficient compression of structured and unstructured volume data with reduced memory footprint.
Decision-aware training framework for generative models in forecasting that optimizes for downstream decision maker costs instead of standard scoring rules.
Quasi-Monte Carlo test-time scaling method for language models reducing redundancy in parallel sampling while improving inference efficiency.
RLVR framework combining verifiable rewards and human demonstrations for LM training, addressing diversity collapse from objective-only optimization.
Neural Certificate Pricing applies unsupervised learning to combinatorial optimization by leveraging asymmetry between search and verification complexity.
Empirical comparison of quantum machine learning models versus classical machine learning approaches across benchmarks.
TiRex-2 extends univariate time series foundation model to multivariate forecasting using recurrent xLSTM with streaming capability.
Language-critique framework for imitation learning from suboptimal demonstrations using natural language feedback instead of scalar signals.
Study showing single transformer layer training matches full-parameter RL fine-tuning for LLMs, revealing unequal layer-wise contribution during RL post-training.
Identifies vocabulary gap in modern encoders for sparse retrieval and proposes approach to bridge gap between dense and sparse retrieval.
Kinematic classifier for urban vehicle deceleration behaviors using K-means clustering on Argoverse 2 trajectory data.
Spatio-temporal Gaussian process model for wind turbine power curves incorporating terrain covariates.
Framework using steering vectors and latent space analysis to control and calibrate language model behavior for trustworthy deployment.
Theoretical characterization of active learning budget regimes as shifts in dominant generalization mechanisms.
Black-box attack recovering private vision-tokenizer configurations of vision-language models through side-channel analysis.
Multi-robot collaborative perception system balancing communication bandwidth and perception accuracy for autonomous systems.
Theoretical framework analyzing adversarial training dynamics for single-index models on Gaussian mixtures using SGD in high dimensions.
SLIM-RL proposes risk-budgeted random-masking reinforcement learning for diffusion LLMs, eliminating trajectory slicing overhead from prior TraceRL method.
Analysis of sample complexity for estimating watermark proportions in documents under Gumbel-max LLM watermarking mechanism.
Multimodal machine learning for real-time classification of transient astronomical objects from Zwicky Transient Facility survey.
Computer vision neural networks for radioisotope identification from gamma-ray spectrograms in urban environments.
Self-organized learning in oscillatory neural networks with memristive couplings for associative memory and optimization.
Rosetta: Composable multimodal pretraining approach addressing gradient conflicts when integrating new modalities without catastrophic forgetting.
DiscoLoop: Method for internalizing multi-hop reasoning in LLMs within single forward pass using discrete embeddings and continuous states.
Systematization of knowledge on attack and defense landscape for mobile on-device AI systems.
Structured evaluation showing text-to-image diffusion safety alignment methods create illusion of high utility through coarse metrics.
EEG-conditioned facial action unit editing using dual-stream manifold alignment.
Mechanistic investigation of authority bias in LLMs showing how models prioritize source credibility over factual consistency.
Information-regularized attention mechanism to improve visual grounding and reduce hallucination in vision-language models.
StochasT: Visual instruction tuning method addressing visual attention decay in multi-turn vision-language model conversations.
Deep neural networks and ensemble methods to predict mortality outcomes and identify biomarkers in acute myocardial infarction.
Analysis of bird diversity in Sri Lanka using spatial and environmental data.
Theoretical study of MCMC scaling properties using Metropolis-Hastings symmetry.
Causal auditing framework to detect whether deleted facts persist in limited memory language models through parametric memory or retrieval artifacts.
RL framework enabling interactive real-time control of agent behavior during gameplay through coachability mechanisms instead of learning single optimal policy.
Lightweight backbone-agnostic segmentation benchmark adapter enabling fair comparison of transformer backbones independent of decoder and pretraining.
Intrusion detection framework using synthetic network traffic and explainable AI to produce court-defensible, traceable forensic outputs.
Recursive Vision Transformer approach using soft mixture-of-recursions to build deeper models with better parameter efficiency and performance.
Evaluation of pretrained music embeddings for cross-performance jazz standard recognition, comparing CNNs against foundation model embeddings.
Self-supervised learning framework for Vision Transformers that preserves informative left-right correspondences in bilateral data like medical images.
Method for explaining financial LLM decisions using Shapley values combined with domain expertise, addressing regulatory explainability requirements.
Video-text alignment model using asymmetric dual projections to handle temporal misalignment and semantic heterogeneity in long videos.
Graph-native RL system for materials discovery generating scientifically valid hypotheses through multi-step reasoning with traceable intermediate steps.