Visit IGEN World Explore IGEN Expo

EXPLORE UPGRADE PLANS

BREAKING

P3B3 Benchmark Reveals Strong Brazilian Portuguese Bias in Large Language Models Controlled Dynamics Attractor Transformer: New Model Targets Graph Anomaly Detection with Biologically Plausible Attention Tamil Nadu OE Spinning Mills Threaten 50% Production Cut Over High Cotton Waste Prices BridgePolicy: New Diffusion Bridge Method Improves Visuomotor Policy Learning in Robotics New Theory Explains How Deep Transformers Achieve Adaptive Inference Using Function Vectors PVminerLLM2 Uses Preference Optimization to Improve Structured Patient Voice Extraction Beyond Models: Reflections on Engineering AI-enabled Systems in a Project-Based Course AutoDojo: Adaptive Attacks Expose Superficial Defenses and Structural Limits in LLM Agents Calibrated Variance Propagation Cuts Uncertainty Estimation Cost for Deep Learning Models Patel Engineering Joint Venture Secures ₹126 Crore Tasgaon Lift Irrigation Project in Maharashtra P3B3 Benchmark Reveals Strong Brazilian Portuguese Bias in Large Language Models Controlled Dynamics Attractor Transformer: New Model Targets Graph Anomaly Detection with Biologically Plausible Attention Tamil Nadu OE Spinning Mills Threaten 50% Production Cut Over High Cotton Waste Prices BridgePolicy: New Diffusion Bridge Method Improves Visuomotor Policy Learning in Robotics New Theory Explains How Deep Transformers Achieve Adaptive Inference Using Function Vectors PVminerLLM2 Uses Preference Optimization to Improve Structured Patient Voice Extraction Beyond Models: Reflections on Engineering AI-enabled Systems in a Project-Based Course AutoDojo: Adaptive Attacks Expose Superficial Defenses and Structural Limits in LLM Agents Calibrated Variance Propagation Cuts Uncertainty Estimation Cost for Deep Learning Models Patel Engineering Joint Venture Secures ₹126 Crore Tasgaon Lift Irrigation Project in Maharashtra

Home ›› Topics ›› hybrid

Topic

hybrid

2 stories

Parallel Hybrid Architecture Combines GSS and Attention for Efficient Long-Context Language Modeling

Artificial Intelligence #long-context#transformer

Parallel Hybrid Architecture Combines GSS and Attention for Efficient Long-Context Language Modeling

Researchers propose the Parallel Hybrid Architecture (PHA), combining Gated State Spaces, Grouped Query Attention, and Feed-Forward Networks in parallel branches fused by a learnable mixing mechanism. On WikiText-103, PHA achieves 16.51 PPL at 125M parameters, outperforming comparable models, and scales to 180M parameters with 16.42 PPL while delivering 24% higher throughput and up to 40% lower memory usage.

Jun 16, 2026 1 source

EdgeCitadel: Hybrid NATS-MQTT Orchestration Platform for Edge Multi-Agent Systems

Software #edge computing#nat

EdgeCitadel: Hybrid NATS-MQTT Orchestration Platform for Edge Multi-Agent Systems

EdgeCitadel is an edge multi-agent orchestration platform built around a single NATS 2.10 server with an MQTT adapter. It combines MQTT connectivity, JetStream-backed persistence, direct peer delegation, and a passive aggregator. A testbed spanning ARM64, x64, and Android clients demonstrates the hybrid architecture.

Jun 16, 2026 1 source