MuonSSM: Orthogonalizing State Space Models for Sequence Modeling
Introduces MuonSSM framework stabilizing state space models for long-sequence modeling by conditioning update geometry rather than recurrent weights.
Introduces MuonSSM framework stabilizing state space models for long-sequence modeling by conditioning update geometry rather than recurrent weights.
Proposes lightweight approach for clustered federated learning using random network distillation to discover client collaborations without coupling cluster assignment to training.
Studies Muon optimizer dynamics on matrix factorization problems, showing it avoids slow saddle-to-saddle transitions compared to gradient descent.
Theoretical framework linking information theory and topology to explain generalization in overparameterized deep networks, addressing theory-practice gap.
Proposes ITSPACE algorithm for optimal transport updates on covariance matrices using Bures-Wasserstein distance for domain adaptation.
Theoretical analysis of convergence properties in continual learning with deep networks, characterizing sequential projections onto task margin sets.
TraceLab characterizes real-world coding agent workloads and LLM serving patterns across multiple models for systems optimization.
Study analyzing attractor state emergence in multi-turn LLM conversations, showing topic-independent stable behaviors in debate interactions.
SWE-Interact testbed evaluating coding agents on multi-turn interactive tasks with progressive user requirements instead of complete upfront specifications.
Cross-sample Consistency Regularization method addressing feature splitting and absorption problems in Sparse Autoencoders for LLM interpretation.
Study showing conservative offline training paradoxically amplifies reward hacking in reasoning models during online adaptation with DPO.
Analysis showing one-step gradient delay doesn't hinder asynchronous pipeline parallelism for large-scale LLM pretraining with PipeDream-2BW.
ReFreeKV method for KV cache compression in LLM inference without requiring pre-determined domain-specific thresholds.
TextClusterLab framework for reliable evaluation of text clustering algorithms addressing dataset quality and semantic boundary challenges.
PixelRAG method for retrieval-augmented generation using website screenshots in pixel space instead of parsed text for improved context.
Argues AI agent safety is epistemic property dependent on system correctability during learning, not just current behavior snapshots.
Theoretical framework studying language generation in the limit and hallucinations as unavoidable consequence of learning.
Approach enriching company embeddings with DBpedia semantic knowledge for B2B lead recommendation systems.
Theoretical analysis of capacity limits in dense retrieval using Voronoi geometry for product search with fixed embedding dimensions.
Unsupervised method for detecting complex driving scenarios using Joint Embedding Predictive Architecture without labels.
RADIANT-PET framework combining segmentation models with LLM adjudication for improved lesion segmentation in PET/CT medical imaging.
GPU-accelerated computational method for reassembling fallen stone blocks into original architectural configurations using inverse dynamics.
RadarTwin framework for generating synthetic mmWave radar training data using 3D reconstruction and vision-language models for mobile perception.
Research proposing meta-learning as principle for human-like visual representations in neural networks to support open-ended task flexibility.
Method to reduce hallucinations in Vision-Language Models using preference alignment constructed from vision-driven synthesis rather than intervention-based approaches.
Systematic review of reinforcement learning techniques for C/C++ vulnerability detection and static analysis following PRISMA guidelines.
Zero-shot deep image prior framework for fluorescence microscopy denoising and deconvolution without paired training data.
Theoretical analysis of Fisher Information Matrix perturbations under quantization and distribution shift in parametric models.
LoRA fine-tuning of LLMs for dementia detection using multi-modal speech features with automatic speech recognition transcripts.
Research on how world models organize physical information in latent representations using diagnostic protocols for passive object-state prediction.
Theoretical analysis of spectral phase transitions in neural network weight matrices during SGD training.
Flow matching method for synthesizing paired mammogram views enforcing anatomical consistency.
Turn-averaged sparse autoencoders for interpretable feature extraction in language models with long context.
DataComp benchmark for evaluating vision-language model dataset curation strategies with 160 open datasets.
Study of sparse attention mechanisms using Fibonacci-spaced offsets in language models with depth-based scheduling.
Speech-driven 3D facial animation method with keypoint-based style control and dialogue localization.
Conformal prediction method providing class-conditional and macro-level coverage guarantees for classification.
Energy-aware learning approach for neuromorphic computing in closed-loop deep brain stimulation systems.
Reproducibility study of FACTER framework for fairness and coverage in LLM-based recommendation systems.
Digital twin framework for connected vehicle collision warning with Sybil attack detection.
Diffusion-based image editing pipeline for rhinoplasty visualization using FLUX.1 inpainting.
Theoretical analysis of parameter settings in bat algorithm metaheuristic using variance evolution.
Online sparse regression algorithm using adaptive iterative hard thresholding for high-dimensional quantile regression.
Label smoothing technique for improving calibration of deep neural network classifiers.
Study of quantum machine learning circuits for predicting epitope-receptor binding on NISQ devices.
Transformer-based active learning approach for efficient vaccine epitope selection using molecular docking simulations.
Time series foundation model for macroeconomic forecasting addressing temporal contamination and revision bias issues.
Simulation framework for developing and testing causal AI methods on neuroimaging data for disease mechanism understanding.
LLM-based system for explaining patterns in multi-aspect tensor data without requiring labels or metadata.
AI agent that autonomously discovers mathematical theorems in formal axiomatic systems without human priors, advancing machine reasoning capabilities.