Topic
open-vocabulary
Lagrange: New Open-Vocabulary Sparse Framework Promises Robust Autonomous Driving in Open Worlds
A new framework called Lagrange, based on Masked Latent Fields and vision-language models, aims to enable autonomous vehicles to handle out-of-distribution scenarios and produce kinematically valid trajectories. Offline evaluations on nuScenes and CODA benchmarks show promising results for robust open-world driving.
QueryGaussian: Training-Free 3D Instance Retrieval Cuts GPU Memory by 70%, Speeds Inference 180x
QueryGaussian, a new training-free framework for open-vocabulary 3D instance retrieval, reduces GPU memory usage by more than 70% and accelerates inference by 180x compared to existing methods, enabling city-scale scenes on consumer-grade hardware.
CrossMaps: Real-Time Open-Vocabulary Semantic Mapping for Autonomous Rover Navigation
A new research paper presents CrossMaps, a real-time confidence-aware open-vocabulary semantic mapping pipeline that constructs language-queryable maps from RGB-D data for rover navigation. It integrates multi-scale CLIP embeddings with confidence-aware fusion and a dual-memory architecture, running on a Jetson Orin-powered UGV alongside SLAM.
ActiveSAM Speeds Open-Vocabulary Segmentation 5.5x, Boosts Accuracy for Noisy-Input Domains
ActiveSAM is a training-free inference framework that improves the speed-accuracy tradeoff of open-vocabulary semantic segmentation. It achieves up to 5.5x faster inference on large-vocabulary datasets while boosting average mIoU by 1.4 points over the state-of-the-art SegEarth-OV3. The method is robust to image corruption, making it suitable for noisy real-world deployments like autonomous driving.