MBZUAI researchers are presenting a new approach to open-world object detection at the AAAI conference. The method enables machines to distinguish between known and unknown objects in images, and then learn to classify the unknown objects. PhD student Sahal Shaji Mullappilly is the lead author of the study, titled "Semi-Supervised Open-World Detection". Why it matters: This research addresses a key limitation in current object detection systems, allowing for more adaptable and robust AI in real-world applications.
This paper introduces Adaptive Entropy-aware Optimization (AEO), a new framework to tackle Multimodal Open-set Test-time Adaptation (MM-OSTTA). AEO uses Unknown-aware Adaptive Entropy Optimization (UAE) and Adaptive Modality Prediction Discrepancy Optimization (AMP) to distinguish unknown class samples during online adaptation by amplifying the entropy difference between known and unknown samples. The study establishes a new benchmark derived from existing datasets with five modalities and evaluates AEO's performance across various domain shift scenarios, demonstrating its effectiveness in long-term and continual MM-OSTTA settings.
MBZUAI researchers tackled the challenge of AI-powered waste detection in messy, real-world recycling facilities. They fine-tuned modern object detection models on real industrial waste imagery and combined this with a semi-supervised learning pipeline. Fine-tuning more than doubled performance and their semi-supervised pipeline outperformed fully supervised baselines. Why it matters: This research offers a practical path for open research that can rival proprietary systems while reducing the need for costly manual labeling in waste management, a problem of global importance.