iGEN
Visit IGEN World Explore IGEN Expo
EXPLORE UPGRADE PLANS
BREAKING
Commodore Callback 8020 Brings Digital Detox With Modern Apps and Retro Design PreLort: Prefix-Nested LoRA Enables Federated Fine-Tuning Across Heterogeneous Hardware Ranks Research Shows 'Retrieve, Don't Retrain' Approach Cuts AI Model Adaptation Costs Multi-Modal Attention Model Achieves 94.9% Accuracy in Automated Disaster Damage Classification Using Satellite Imagery AdaSTORM Breakthrough Scales LLM Reasoning to Thousand-Node Dynamic Graphs, Paves Way for Supply Chain AI Finance survived the quantum threat by preparing early. Mythos won't make it so easy Salesforce Acquires Customer Service AI Firm Fin for $3.6 Billion Teacher-Student Domain Adaptation Boosts Ensemble Audio-Visual Deepfake Detection by Up to 18% Sensor-Conditioned Representation Learning Uses Scene-Relevant Observation Quotients to Improve Latent Geometry OmniTraffic Pipeline Enables Controlled Training of Spatio-Temporal Traffic AI for Logistics Commodore Callback 8020 Brings Digital Detox With Modern Apps and Retro Design PreLort: Prefix-Nested LoRA Enables Federated Fine-Tuning Across Heterogeneous Hardware Ranks Research Shows 'Retrieve, Don't Retrain' Approach Cuts AI Model Adaptation Costs Multi-Modal Attention Model Achieves 94.9% Accuracy in Automated Disaster Damage Classification Using Satellite Imagery AdaSTORM Breakthrough Scales LLM Reasoning to Thousand-Node Dynamic Graphs, Paves Way for Supply Chain AI Finance survived the quantum threat by preparing early. Mythos won't make it so easy Salesforce Acquires Customer Service AI Firm Fin for $3.6 Billion Teacher-Student Domain Adaptation Boosts Ensemble Audio-Visual Deepfake Detection by Up to 18% Sensor-Conditioned Representation Learning Uses Scene-Relevant Observation Quotients to Improve Latent Geometry OmniTraffic Pipeline Enables Controlled Training of Spatio-Temporal Traffic AI for Logistics
Home ›› Topics ›› pretraining

Topic

pretraining

3 stories
EyeMVP AI Model Enhances Retinal Screening by Learning OCT Insights from Fundus Photos Technology
Artificial Intelligence #artificial intelligence#computer vision

EyeMVP AI Model Enhances Retinal Screening by Learning OCT Insights from Fundus Photos

Researchers developed EyeMVP, a cross-modal retinal foundation model that enriches color fundus photography (CFP) with depth-resolved information from optical coherence tomography (OCT). Pretrained on 674,893 paired images from 112,642 patients across eight Chinese hospitals, EyeMVP outperforms leading models on 16 downstream tasks including macular edema detection (AUROC 0.948 vs 0.852) and myopic macular schisis (0.825).

Jun 16, 2026 1 source
Data Augmentations Offer Path to Efficient Language Model Pretraining Under Data Constraints Technology
Artificial Intelligence #data augmentation#language model

Data Augmentations Offer Path to Efficient Language Model Pretraining Under Data Constraints

As AI labs face a data ceiling where compute capacity outpaces new high-quality text, researchers propose data augmentations to enable productive multi-epoch training on fixed corpora. Three categories—token-level noise, sequence permutations, and target offset prediction—are shown to delay overfitting and lower validation loss compared to standard autoregressive pretraining. Random token replacement achieved the best minimum loss among individual methods, with combined augmentations further improving results.

Jun 16, 2026 1 source
X-Tokenizer: Semantic Action Tokenizer Boosts Robot Control by 13.5% Over FAST Technology
Artificial Intelligence #x-tokenizer#multimodal

X-Tokenizer: Semantic Action Tokenizer Boosts Robot Control by 13.5% Over FAST

Researchers propose X-Tokenizer, a new action tokenizer that treats tokenization as semantic interface learning rather than mere compression. Using a lightweight encoder-Semantic Residual Quantization (SRQ)-decoder architecture, it improves multimodal grounding by 13.5% and long-horizon task performance by 8.25 points over existing methods like FAST.

Jun 16, 2026 1 source