SCATR: Simple Calibrated Test-Time Ranking
SCATR method for test-time scaling in LLMs using efficient ranking scorers as alternative to expensive process reward models.
SCATR method for test-time scaling in LLMs using efficient ranking scorers as alternative to expensive process reward models.
REZE framework for domain-adaptive text embeddings using contrastive pre-finetuning with representation regularization to prevent task-induced bias.
Category-adaptive safety alignment method for LLMs that addresses safety across different harm categories rather than uniform safety scoring.
Research paper analyzing geometric structure of Q-value iteration for faster policy identification in dynamic programming and Markov decision processes.
Research paper on DuQuant++ fine-grained rotation method improving MXFP4 quantization for efficient LLM inference on NVIDIA hardware.
Latent reasoning policy optimization for LLMs with stochastic sampling via Gumbel-Softmax for improved reasoning diversity.
Study of diversity collapse in multi-agent LLM systems during open-ended idea generation.
Modular representation compression method for adapting LLMs into industrial recommendation systems efficiently.
Benchmark evaluating compositional biases in multimodal LLMs used as automatic judges.
Framework for identifying compositional skill gaps in LLMs through scaffolded task variations.
Selective State Space Attention architecture combining transformer attention with state-space models for long-context sequences.
Method leveraging compiler outputs to improve formal theorem proving with LLMs at reduced test-time compute.
Data-efficient RL approach for LLM self-improvement using easy samples and cognitive learning theory.
Intrinsic reward mechanism for world model training based on cumulative prediction error improvement.
Discrete Tilt Matching method for fine-tuning masked diffusion LLMs using likelihood-free RL objectives.
Study evaluating robustness of Sparse Autoencoders integrated into LLM inference for interpretability against jailbreak attacks.
Technical paper on Semi-Markov CRFs for efficient streaming structured sequence inference without materializing large tensors.
Research on optimizing Mixture-of-Experts LLM inference on Apple Neural Engine hardware, addressing routing and operator compatibility challenges.
HELM framework for vision-language-action models addressing memory, verification, and recovery gaps in long-horizon robot manipulation tasks.
Analysis of dataset distillation showing soft labels mask underperformance versus random baselines; proposes hard-label evaluation for reliable coreset comparison.
Geodesic Tangent Space Aggregation PCA extends PCA to curved manifolds integrating curvature awareness for semi-supervised representation learning.
Denoising recursion models improve looped transformer reasoning on complex problems by learning long refinement trajectories from noise to structured solutions.
Proximal decoupling approach for continual learning addressing task switching without catastrophic forgetting through explicit separation of learning and retention signals.
AC-SINDy extends sparse identification of nonlinear dynamics using arithmetic circuits for compositional feature construction instead of explicit feature libraries.
Analysis of harmful intent as geometrically recoverable feature in LLM residual streams across multiple model families and alignment variants.
Collaborative contextual Bayesian optimization extending BO to context-specific optimal design problems requiring mapping from context space to solutions.
Fine-tuning study of small 7B reasoning models on theoretical physics with analysis of domain-specific reasoning ability development in LLMs.
Joint semantic-structure embedding approach for table annotation capturing column semantics and inter-column relationships for downstream NLP applications.
Deep learning surrogate model for CFD flow-field prediction using staged local rollout with shared lightweight predictors instead of global single-pass models.
Analysis of knowledge distillation failures in LLMs identifying distillation traps (tail noise, off-policy instability, teacher-student gap) and calibration methods.
Self-improving language models for tabular data that learn from generated samples via iterative group alignment and RL-based training to improve statistical properties.
LoRA-based structural regularization for critic learning in off-policy RL. Parameter-efficient scaling technique for RL training.
Neuro-symbolic framework for autoformalization using operator trees and LLMs. Hierarchical approach to formal math translation.
RL-guided distribution matching distillation for few-step generation. Research on combining RL with diffusion distillation.
Diffusion policy approach using Sobolev training to accelerate trajectory optimization. ML research on policy learning efficiency.
Federated fine-tuning method for LLMs balancing IP protection, privacy, and performance on heterogeneous data. Novel training approach.
Research on activation steering for LLM alignment using linear optimal control. Novel inference-time alignment technique with theoretical grounding.
FG²-GDN enhances gated delta networks with fine-grained channel-wise control and learnable decay rates for long-context linear attention.
Safe RLHF framework using constrained MDPs and policy gradient primal-dual methods for safe LLM alignment from human feedback.
Uses synthetic graph priors to train GNNs for universal generalization across diverse graphs without retraining per-graph.
Proposes intentional updates for stable streaming reinforcement learning by solving for step sizes matching intended outcome changes.
Addresses continual machine unlearning with mechanisms preventing knowledge erosion and forgetting reversal across multiple unlearning rounds.
Identifies shared attention heads in LLMs that detect false statements but agree with sycophantic user pressure, enabling behavior control.
RLABC is open-source Python framework automating RL environment creation from Elegant beamline configurations for accelerator optimization.
Nexusformer replaces linear Q/K/V projections with nonlinear attention expansion enabling stable transformer scaling without retraining from scratch.
SAW-INT4 provides practical 4-bit KV-cache quantization for LLM serving respecting system constraints like paged memory and fused attention.
LBLLM framework achieves W(1+1)A4 quantization in LLMs through three-stage distillation for resource-constrained deployment.
Analyzes logical expressiveness of topological neural networks compared to graph neural networks using Weisfeiler-Leman hierarchy.
TEMPO scales test-time training for large reasoning models by addressing reward signal drift with external calibration mechanisms.
RDP LoRA uses geometric analysis of hidden state trajectories to identify optimal layers for parameter-efficient fine-tuning in LLMs, improving upon standard LoRA methods.