iGEN
Visit IGEN World Explore IGEN Expo
EXPLORE UPGRADE PLANS
BREAKING
Amazfit Cheetah 2 Ultra: The Most Expensive Smartwatch Yet—Is It Worth the Price? New Automated Jailbreak Attack UNIATTACK Achieves High Success Rate Against Multi-Layered LLM Defenses UXBench: Measuring the Actionability of LLM-Generated UX Critiques LaWAM: Latent World Action Model Enables Efficient, Dynamics-Aware Robot Control with Low Latency Sub-Quadratic Vision Transformers Cut Self-Attention Cost for Faster Image Captioning NordVPN's Private Server Add-On Gives Enterprises Isolated Hardware and Static IP for Secure Remote Access India Soyabean Acreage Seen Rising Up to 10% on High Prices, Weak Monsoon Outlook FlowMPC: New Framework Combines Flow Matching and World Models to Improve Robot Manipulation DYNA Framework Uses Temporal Knowledge Graphs to Reduce LLM Forgetting Without Retraining RAMS: Resource-Adaptive Model Switching for Embedded Edge Perception Under Load Amazfit Cheetah 2 Ultra: The Most Expensive Smartwatch Yet—Is It Worth the Price? New Automated Jailbreak Attack UNIATTACK Achieves High Success Rate Against Multi-Layered LLM Defenses UXBench: Measuring the Actionability of LLM-Generated UX Critiques LaWAM: Latent World Action Model Enables Efficient, Dynamics-Aware Robot Control with Low Latency Sub-Quadratic Vision Transformers Cut Self-Attention Cost for Faster Image Captioning NordVPN's Private Server Add-On Gives Enterprises Isolated Hardware and Static IP for Secure Remote Access India Soyabean Acreage Seen Rising Up to 10% on High Prices, Weak Monsoon Outlook FlowMPC: New Framework Combines Flow Matching and World Models to Improve Robot Manipulation DYNA Framework Uses Temporal Knowledge Graphs to Reduce LLM Forgetting Without Retraining RAMS: Resource-Adaptive Model Switching for Embedded Edge Perception Under Load
Home ›› Topics ›› fine-tuning

Topic

fine-tuning

2 stories
PreLort: Prefix-Nested LoRA Enables Federated Fine-Tuning Across Heterogeneous Hardware Ranks Technology
Artificial Intelligence #federated learning#low-rank adaptation

PreLort: Prefix-Nested LoRA Enables Federated Fine-Tuning Across Heterogeneous Hardware Ranks

A new method called PreLort addresses the challenge of aggregating federated LoRA adapters with different ranks due to heterogeneous hardware. By organizing adapter dimensions into a prefix hierarchy and introducing segment-wise aggregation and prefix-nested training, PreLort consistently outperforms existing heterogeneous federated LoRA methods in accuracy and ROUGE-L while achieving lower perplexity.

Jun 16, 2026 1 source
New Self-Enhanced Fine-Tuning Method Boosts Text-to-SQL Reasoning and Generalization Technology
Artificial Intelligence #text-to-sql#reasoning

New Self-Enhanced Fine-Tuning Method Boosts Text-to-SQL Reasoning and Generalization

Researchers propose CoTE-SQL, a self-enhanced fine-tuning method that improves text-to-SQL generation by integrating reasoning traces, structured chain-of-thought prompting, and execution error correction. The approach achieves state-of-the-art results on Bird and Spider benchmarks, particularly on complex queries.

Jun 16, 2026 1 source