Topic
model optimization
SafeSpec: New Framework Boosts LLM Safety Without Sacrificing Inference Speed
Researchers propose SafeSpec, a safety-aware speculative inference framework that attaches a latent safety head to jointly evaluate semantic validity and safety in a single forward pass. On Qwen3-32B, it reduces attack success rates by 15% while preserving a 2.06x inference speedup on benign workloads, addressing the fundamental incompatibility between existing safety methods and speculative decoding.
DCP-Prune: New Token Pruning Method Preserves AI Model Performance at Ultra-Low Budgets
Researchers propose DCP-Prune, a two-stage token pruning framework that maintains model accuracy even under ultra-low token budgets. The method retains 92.1% of upper-bound average performance on LLaVA-1.5-7B with just 16 visual tokens, addressing distribution shift issues that plague aggressive pruning.
G-Loss: New Graph-Guided Loss Function Boosts Language Model Fine-Tuning Accuracy
Researchers introduce G-Loss, a graph-guided loss function that leverages global semantic relationships to fine-tune language models more effectively than traditional loss functions, showing improved accuracy and faster convergence on five benchmark datasets.