OptEMA: Adaptive Exponential Moving Average for Stochastic Optimization with Zero-Noise Optimality
Optimization algorithm extending exponential moving average with adaptive rates and zero-noise optimality guarantees.
Optimization algorithm extending exponential moving average with adaptive rates and zero-noise optimality guarantees.
Formal grammar framework preventing data leakage in ML workflows through structural constraints and assessment gates.
Reinforcement learning method for post-training reasoning models using hindsight feedback in sparse reward environments.
Security considerations and recommendations for AI agents from Perplexity based on operating agentic systems in production environments.
Framework for measuring LLM robustness to prompt variations, typos, and alternative phrasings in real-world inputs.
Predictive maintenance framework for connected vehicles integrating sensor and environmental data with ML models.
Distributed learning algorithm combining Byzantine robustness with communication compression for collaborative ML systems.
Research on sparse Mixture-of-Experts architectures proposing expert path perspective to understand token routing patterns across layers.
LLM-ODE: uses LLMs to discover governing equations of dynamical systems from data, improving on genetic programming approaches.
ALMAB-DC: sequential experimental design framework combining active learning, multi-armed bandits and distributed computing for black-box optimization.
Federated learning approach combining Byzantine robustness and differential privacy for distributed training.
Framework using LLMs to automatically design auxiliary reward programs for cooperative multi-agent reinforcement learning systems.
Compares LLM agents against classical hyperparameter optimization algorithms using autoresearch testbed for tuning small language models.
Theoretical analysis of online convex optimization with two-point bandit feedback achieving tight regret bounds.
ATLAS-RTC: runtime control system for LLM agents enforcing structured output via token-level monitoring, biasing, masking and rollback.
HISA: hierarchical indexing system for efficient sparse attention in LLMs, reducing indexer bottleneck in token-level sparse mechanisms.
Introduces HyperP, hypersphere parameterization for LLM scaling with improved stability and hyperparameter transfer.
Proposes time-varying momentum schedule derived from critically damped harmonic oscillator for neural network training optimization.
arXiv paper analyzing integer multiplication as hard problem for neural networks. Theoretical analysis challenging assumptions about long-range dependencies in neural computation.
arXiv paper on realistic market impact modeling for RL trading agents. Gymnasium-compatible environments with nonlinear transaction costs for algorithmic trading research.
arXiv paper on personalized federated fine-tuning of language models. Federated learning approach for task-centric LLM adaptation on private distributed data.
arXiv paper on Byzantine-resilient distributed optimization with probabilistic edge dropout. Convergence analysis for distributed learning with adversarial agents.
arXiv paper on memory-efficient LLM pre-training via truncated SVD factorization. Method reduces memory footprint for training large language models on consumer hardware.
arXiv paper on O(1) complexity label prediction for neural networks with millions of classes. Optimization technique for efficient classification in high-dimensional spaces.
arXiv paper on human-AI cooperation via fatigue-aware deferral systems. ML method modeling human fatigue to optimize when AI should defer to humans.
arXiv paper introducing Multiscreen attention mechanism for language models. Alternative to softmax attention enabling absolute relevance scoring in transformers.
arXiv paper on reinforcement learning post-training for reasoning models. Open-weight model training using verifiable rewards across diverse reasoning domains.
arXiv paper on opponent modeling in game-theoretic reinforcement learning using tree-search and generative models. Research on scalable multi-agent RL methods.
Multi-agent reinforcement learning framework for HIV prevention policy optimization across U.S. regions.
Black-box visual prompting method for parameter-efficient transfer learning of foundation models without full parameter access.
SPRIG: Genetic algorithm for optimizing system prompts in LLMs to improve task performance.
XAI-based method combining explainability with concept drift detection for monitoring model performance degradation.
World models using disentangled representations to transfer semantic knowledge from distracting videos for RL agents.
FSD framework combining vision-language models with robotic action models for zero-shot manipulation in novel scenarios.
Gaussian mixture models as computationally efficient proxy for LLM+RAG systems combining multiple models.
Technique to recover LLM training on decentralized/spot nodes from partial model loss without full checkpoints.
Method for LLMs to reliably cite source documents seen during training without external retrievers at inference time.
Modification of Whisper ASR model to enable low-latency streaming transcription through architectural and training changes.
Vision-language model for robotic manipulation using embodiment-agnostic pointing representation to address generalization in embodied AI.
System co-design for efficient on-device LLM inference on NPU hardware, optimizing attention operations for privacy-preserving deployment.
Google developer tool using deep learning to automatically fix copy/paste code, predicting required edits from formatting to cross-language translation.
Knowledge editing method for LLMs enabling sequential updates through null-space alignment, improving robustness in continual model editing scenarios.
Scientific machine learning approach using implicit neural representations for 3D gravity inversion, modeling subsurface density as continuous field.
Image hashing method using foundation models for efficient large-scale retrieval with compact binary codes instead of high-dimensional embeddings.
Study of RAG limitations in healthcare domain, showing how retrieval-augmented generation fails when source documents contain contradictory or outdated information.
Sphinx synthetic environment for visual perception and reasoning with procedurally generated puzzles covering 25 task types, enabling precise evaluation and large-scale dataset construction.
Analysis showing optical context compression via vision tokens is functionally equivalent to lossy autoencoding, questioning effectiveness of DeepSeek-OCR's compression pipeline.
Human-in-the-loop approach for visual classification through iterative concept deliberation, addressing subjective vision tasks in content moderation and curation.
DDFT protocol measures epistemic robustness of language models under stress conditions, distinguishing knowledge gaps from verification mechanism failures beyond static benchmarks.
Mechanistic interpretability study of how Diffusion Transformers generate correct spatial relations in text-to-image generation.