Natasa Przulj at the Barcelona Supercomputing Center is developing an AI framework that fuses multi-omic data to improve precision medicine. The framework uses graph-regularized non-negative matrix tri-factorization (NMTF) and network science algorithms for patient stratification, biomarker prediction, and drug repurposing. It is applied to diseases like cancer, Covid-19, and Parkinson's. Why it matters: This research can enable more personalized and effective treatments by leveraging complex biological data to understand disease mechanisms and tailor therapies.
Dezhen Song from Texas A&M University presented a talk on Co-Modality Active sensing and Perception (C-MAP) for robotics, covering sensor fusion for autonomous vehicles, augmented reality, and remote environmental monitoring. The talk highlighted lessons learned in sensor fusion using autonomous motorcycles and NASA Robonaut as examples. Recent works in robotic remote environment monitoring, especially focused on subsurface surface void and pipeline mapping were discussed. Why it matters: This research explores sensor fusion techniques to enhance robot perception, which could improve the robustness and capabilities of autonomous systems developed and deployed in the Middle East, particularly in challenging environments.
This paper introduces an interpretable pipeline that integrates mobility and social media data to analyze human behavior during crises. The framework was evaluated through two case studies, including a longitudinal analysis of UAE COVID-19 behavior from March 2020 to December 2021. The pipeline aligns heterogeneous daily signals, transforms them into binary behavioral states, applies Formal Concept Analysis (FCA) to extract co-occurrence structures, and mines association rules. Results demonstrate clear cross-domain behavioral structures in crises, yielding both scientifically credible and policy-actionable intelligence. Why it matters: This work provides a novel methodological approach for developing actionable crisis management strategies by fusing multimodal data, directly applicable to public health and emergency response in the UAE and the broader region.
Researchers at MBZUAI have introduced a novel approach to enhance Large Multimodal Models (LMMs) for autonomous driving by integrating 3D tracking information. This method uses a track encoder to embed spatial and temporal data, enriching visual queries and improving the LMM's understanding of driving scenarios. Experiments on DriveLM-nuScenes and DriveLM-CARLA benchmarks demonstrate significant improvements in perception, planning, and prediction tasks compared to baseline models.
MBZUAI hosted the Second Workshop on Collaborative Learning as part of the AI Quorum in Abu Dhabi, focusing on collaborative and federated learning for sustainable development. Researchers discussed applications in medicine, biology, ecological conservation, and humanitarian aid. Eric Xing highlighted the potential of large biology models, similar to LLMs, to revolutionize biological data analysis. Why it matters: This workshop underscores the UAE's commitment to advancing AI research in crucial sectors like healthcare and sustainability through collaborative learning approaches.
MIT researchers have developed a new AI system that uses satellite imagery and street-level photos to add details to digital maps. The AI model can identify features like building footprints, road networks, and vegetation cover with high accuracy. It then enriches existing maps by adding these features, improving their usability for navigation and urban planning. Why it matters: This technology can significantly enhance the quality and detail of digital maps, particularly in areas where up-to-date map data is lacking, enabling better AI-powered applications.
Researchers at MBZUAI introduce FissionFusion, a hierarchical model merging approach to improve medical image analysis performance. The method uses local and global aggregation of models based on hyperparameter configurations, along with a cyclical learning rate scheduler for efficient model generation. Experiments show FissionFusion outperforms standard model souping by approximately 6% on HAM10000 and CheXpert datasets and improves OOD performance.