Explainable Token-level Noise Filtering for LLM Fine-tuning Datasets
Token-level noise filtering method for LLM fine-tuning datasets, addressing mismatch between sentence-level annotation and token optimization.
Token-level noise filtering method for LLM fine-tuning datasets, addressing mismatch between sentence-level annotation and token optimization.
LongAudio-RAG hybrid framework for QA over multi-hour audio with temporal grounding and minimal hallucination.
CogitoRAG framework simulates human cognitive memory for retrieval-augmented generation, using semantic diffusion to preserve integrity.
Condition-gated reasoning system for biomedical QA that handles patient-specific conditional logic in clinical decision-making.
Analyzes deployment tradeoffs in conformal predictors beyond coverage, examining commit vs defer vs error exposure operational metrics.
CrystaL enables latent chain-of-thought reasoning in multimodal LLMs without predefined supervision, improving vision-language integration.
ModernBERT-based multilingual encoder family (150M-300M params) pretrained on 35 languages with domain and dimensional adaptation.
Continual multi-task training framework for universal audio representation across speech, environmental sounds, and music.
CeRA improves low-rank adaptation for LLM fine-tuning by adding manifold expansion via gating and dropout, addressing linear limitations.
Combines behavioral and textual relevance signals using LLMs to improve app store search ranking at scale.
First systematic 4-bit quantization-aware training study for attention mechanisms enabling end-to-end FP4 computation on emerging GPUs.
PEPA: embodied AI agent framework with personality-driven persistent autonomy enabling self-sustaining goals without external task specification.
Conformal prediction framework providing finite-sample coverage guarantees for LLM-based medical entity extraction across clinical domains.
Architectural model for trustworthy AI-assisted software via human-certified module repositories ensuring reliability of AI-assembled systems.
iGVLM: framework enabling dynamic instruction-guided vision encoding in LVLMs for task-specific visual understanding.
MASS: meta-learning framework enabling LLMs to self-adapt at test time by generating synthetic training data for improved downstream performance.
Neuro-symbolic approach combining LLMs with deterministic fact ledgers and hallucination detection for financial reasoning without arithmetic errors.
Research on merging task-specific models into consolidated ones, analyzing parameter competition and domain generalization effects.
vLLM Hook v0 plugin enabling programmable access to LLM model internals for test-time alignment and inference optimization in vLLM serving engine.
Interpretability study on attention sinks in LLMs, explaining why models allocate disproportionate attention to specific tokens including first token bias.
FuzzingRL approach using reinforcement learning for fuzz testing Vision Language Models to automatically generate failure-inducing queries.
Switchable Activation Networks that dynamically select activation functions for computational efficiency in LLMs and vision-action models during inference.
Method to align LLM confidence scores with correctness using output token probabilities for reliable error detection and hallucination identification.
LegoNet compression technique for neural networks using block weight clustering to reduce memory footprint for embedded device deployment.
CapTrack benchmark for evaluating multi-faceted forgetting in LLM post-training beyond parametric knowledge loss, addressing domain adaptation challenges.
Research showing majority-voting and ensemble inference methods fail to improve LLM truthfulness without external verification, unlike in math/code domains.
OptiRoulette meta-optimizer that dynamically selects update rules during training via warmup locking and random sampling. Torch-compatible drop-in component achieving 5.3x faster convergence.
RACER system for efficient multi-model LLM routing formulated as risk-aware optimization problem. Extends base routers to minimize cost-performance trade-off.
Novel language model combining autoregressive and diffusion-based generation through latent trajectory modeling with evolving balance parameter.
Framework for token-efficient reinforcement learning in LLMs. Proposes NAT to reduce computational cost of backpropagation over long chain-of-thought trajectories during training.
Research on vulnerabilities in Process Reward Models used in LLM reasoning pipelines. Introduces diagnostic framework to quantify adversarial exploitability and fluency-logic dissociation.
Empirical comparison of ARIMA, LSTM, BiLSTM, and Transformer for short-term power load forecasting.
Survey of Group Relative Policy Optimization for aligning generative models with human preferences.
Grouter: decoupled routing method for accelerating Mixture-of-Experts training with structural priors.
Leakage-safe graph feature extraction for fraud detection in temporal transaction networks.
Graph property inference in small language models: effects of representation on structured reasoning.
SmartBench: evaluation benchmark for LLMs in smart home environments with anomalous device detection.
HEARTS: benchmark for evaluating LLM reasoning on diverse health time series tasks and modalities.
SR-TTT: test-time training for LLMs with infinite context via fast weights, improving long-context reasoning.
Trust-aware federated learning framework for bone healing classification in distributed medical environments.
Ensemble learning framework for financial risk detection in ERP systems with leakage-safe evaluation.
ATLAS: reinforcement finetuning framework for scaling agent capabilities with large toolspaces using small language models.
Synthetic EHR generation pipeline with clinical consistency validation for privacy-preserving health data sharing.
ProtAlign: contrastive learning framework for protein sequence-structure alignment using language models.
Hybrid approach combining time series foundation models with regression models for electricity price forecasting capturing temporal and cross-variate patterns.
Safe Transformer: Modular approach adding explicit safety bit as interpretable information bottleneck for controllable alignment in language models.
Orion: First open system enabling direct LLM training and inference on Apple Neural Engine (ANE) with compiler pipeline and on-device training support.
Reinforcement learning approach for safe neural navigation in variable-density crowds that generalizes beyond training conditions.
Super-resolution transformer optimization using FlashAttention with rank-factorized implicit neural bias to reduce computational burden.
Efficient decentralized framework for training diffusion models with heterogeneous objectives across isolated experts with reduced computational requirements.