Visit IGEN World Explore IGEN Expo

EXPLORE UPGRADE PLANS

BREAKING

Commodore Callback 8020: A Digital Detox Phone With Modern Android Apps PreLort: Prefix-Nested LoRA Enables Federated Fine-Tuning Across Heterogeneous Hardware Ranks Research Shows 'Retrieve, Don't Retrain' Approach Cuts AI Model Adaptation Costs Multi-Modal Attention Model Achieves 94.9% Accuracy in Automated Disaster Damage Classification Using Satellite Imagery AdaSTORM Breakthrough Scales LLM Reasoning to Thousand-Node Dynamic Graphs, Paves Way for Supply Chain AI Finance survived the quantum threat by preparing early. Mythos won't make it so easy Salesforce Acquires Customer Service AI Firm Fin for $3.6 Billion Teacher-Student Domain Adaptation Boosts Ensemble Audio-Visual Deepfake Detection by Up to 18% Sensor-Conditioned Representation Learning Uses Scene-Relevant Observation Quotients to Improve Latent Geometry OmniTraffic Pipeline Enables Controlled Training of Spatio-Temporal Traffic AI for Logistics Commodore Callback 8020: A Digital Detox Phone With Modern Android Apps PreLort: Prefix-Nested LoRA Enables Federated Fine-Tuning Across Heterogeneous Hardware Ranks Research Shows 'Retrieve, Don't Retrain' Approach Cuts AI Model Adaptation Costs Multi-Modal Attention Model Achieves 94.9% Accuracy in Automated Disaster Damage Classification Using Satellite Imagery AdaSTORM Breakthrough Scales LLM Reasoning to Thousand-Node Dynamic Graphs, Paves Way for Supply Chain AI Finance survived the quantum threat by preparing early. Mythos won't make it so easy Salesforce Acquires Customer Service AI Firm Fin for $3.6 Billion Teacher-Student Domain Adaptation Boosts Ensemble Audio-Visual Deepfake Detection by Up to 18% Sensor-Conditioned Representation Learning Uses Scene-Relevant Observation Quotients to Improve Latent Geometry OmniTraffic Pipeline Enables Controlled Training of Spatio-Temporal Traffic AI for Logistics

Home ›› Topics ›› model evaluation

Topic

model evaluation

2 stories

VibeThinker-3B: Small Language Model Matches Giants in Verifiable Reasoning, According to arXiv Paper

Artificial Intelligence #vibethinker-3b#small language model

VibeThinker-3B: Small Language Model Matches Giants in Verifiable Reasoning, According to arXiv Paper

A new technical report on arXiv introduces VibeThinker-3B, a compact 3B-parameter language model that achieves verifiable reasoning scores comparable to models orders of magnitude larger, including DeepSeek V3.2, GLM-5, and Gemini 3 Pro. The model uses a Spectrum-to-Signal post-training paradigm and achieves 94.3 on AIME26 and 80.2% Pass@1 on LiveCodeBench v6.

Jun 16, 2026 1 source

New Method Resolves Drift Attribution Ambiguity in LLM Evaluation Pipelines

Artificial Intelligence #llm evaluation#drift detection

New Method Resolves Drift Attribution Ambiguity in LLM Evaluation Pipelines

A research paper introduces an anytime-valid attribution method for LLM evaluation pipelines that resolves the ambiguity between product drift and judge model changes. Using a fixed human-labeled anchor set and betting e-processes, the method achieved zero misattribution on silent version bumps and correctly attributed prompt changes in 110 of 120 runs, while the industry-default rolling z-test false-alarmed on 75% of drift-free streams.

Jun 16, 2026 1 source