Binary Rewards and Reinforcement Learning: Fundamental Challenges
Analysis of diversity collapse in RLVR training with binary rewards and fundamental structural limitations.
Analysis of diversity collapse in RLVR training with binary rewards and fundamental structural limitations.
Statistically-lossless quantization framework for LLMs balancing compression with inference acceleration.
Deep reinforcement learning controllers for CO2 geological storage with history-based adaptation under partial observability.
Framework for unbiased answer-level fine-tuning using distributional alignment games with Bregman divergence.
Reinforcement learning with verifiable rewards using Boltzmann projection and weighted SFT for policy optimization.
Study of preference poisoning attacks against offline RLHF/DPO training pipelines for language models.
Neuroplastic continual learning architecture integrating 11 mechanisms including task-driven neurogenesis and EWC regularization.
Recurrent deep RL with memory-augmented policies for optimizing chemotherapy dosing under partial observability.
Novel gradient-based acquisition criterion for pool-based active learning derived from generalization bounds.
Method to stabilize Direct Preference Optimization in LLMs by addressing gradient squeezing effects in human feedback alignment.
Research on improving multimodal LLM latent reasoning by addressing optimization pathology in visual latent space contributions to predictions.
Multimodal language model for molecular property prediction that grounds explanations in molecular structure using Morgan fingerprints.
Offline safe reinforcement learning method using diffusion-based planners with cost-conditioned generation for adaptive safety constraints during deployment.
Layer-wise monitoring approach for transformer training using low-bit quantization to verify optimization quality without performance degradation.
SHAP-based analysis decomposing RL algorithm and hyperparameter contributions to generalization across robotic environments.
SpecKV: adaptive speculative decoding for LLM inference with compression-aware dynamic gamma selection outperforming fixed speculation.
RAG-based autonomous QA agent using LLMs with retrieval grounding to generate reliable Selenium test scripts from documentation.
Philosophical analysis of topological limitations in multimodal AI architectures regarding modal separability and creative tasks.
Synthetic data generation approach diagnosing vision model failures through controlled, independent scene factor variation.
2026 roadmap reviewing AI/ML deployment in smart manufacturing, covering challenges in data integration and industrial systems.
Analysis of emergent misalignment in fine-tuned LLMs via feature superposition geometry, explaining harmful behavior induction.
H-Probes: linear probes extracting hierarchical structures from LLM latent representations to understand geometric reasoning.
Open Earth System Foundation Model (ESFM) built on Swin UNet for heterogeneous climate/weather data integration and forecasting.
Foundation model-guided domain adaptation for EEG decoding without source data access, improving cross-subject generalization.
Latent space probing framework for detecting adult content in video generative models by analyzing internal representations.
OceanPile: large-scale multimodal dataset for ocean research addressing data fragmentation and weak labeling challenges for foundation models.
Investigation of explainability in linear-min-max neural networks which can be interpreted as k-medoids and trained with subgradient descent.
LatentDiff: scalable framework for semantic dataset comparison using sparse autoencoders and density ratio estimation in latent space.
Generalized Category Discovery frameworks adapting foundation models for unlabeled data with domain and semantic shifts.
TRIP-Evaluate: open multimodal benchmark for assessing LLMs and MLLMs on transportation tasks including regulation QA and autonomous driving.
Reinforcement learning agentic framework using PPO and LLM for automated test case generation in complex software systems.
CLEAR framework evaluating how noise and ambiguity in decision-space presentation affect LLM reliability on medical reasoning tasks.
Multi-agent reinforcement learning for tactical deconfliction among heterogeneous fleets of unmanned aerial systems in dense airspace.
LLM Ghostbusters: Adaptive unlearning technique to suppress hallucinations in code generation, addressing supply-chain vulnerabilities from fictional packages.
Framework for evaluating counterfactual prompting in LLMs by accounting for meaning-preserving baseline modifications to isolate causal factors.
SURGE: Production GPU encoding system for generating embeddings across 800M texts in 40K partitions with optimized inter-process communication.
Analysis of safety vulnerabilities in LLM-based multi-agent systems where malicious agents exploit communication to propagate misinformation.
Data curation framework using ranked retrieval to improve multimodal embedding spaces by addressing modality bias and noisy paired supervision.
CADFit: Hybrid optimization method to generate parametric CAD programs from meshes using neural networks and design constraints.
FeedbackLLM: Multi-agent LLM system for automated test case generation using evolving prompts and coverage feedback to reduce hallucinations.
Systematic investigation of vision encoder-LLM alignment in Vision-Language Models using Gromov-Wasserstein distance for principled model selection.
Segment-Aligned Policy Optimization (SAPO) for LLM reinforcement learning that aligns credit assignment with reasoning step structure in multi-modal tasks.
Vision-language models with active reasoning via sequential Bayesian decision-making. VLM improvement through adaptive visual perception.
Multi-agent debate for on-policy distillation in agentic tasks. Teacher-student learning framework with agent trajectory optimization.
Framework for analyzing concept representations in neural networks via linear subspaces. Interpretability research applicable to model understanding.
Using RL to improve MLLMs on imbalanced regression tasks via distributional awareness. LLM training methodology addressing long-tailed distributions.
Framework for composing and auditing LoRA adapters from open pools for tasks. Parameter-efficient fine-tuning and model composition.
LLM coding agents with persistent memory, RAG, and RL feedback for software engineering. Architecture for agent memory and tool use.
Brain-inspired spiking neural network with time-delayed coordination for learning. Neuroscience-focused theoretical work on oscillatory dynamics.
Causal discovery method with per-edge trust scores for heterogeneously reliable external priors from diverse sources.