A fake, AI-generated video clip of India's Finance Minister, Nirmala Sitharaman, promoting high financial returns has been identified and exposed. The misleading clip, which went viral, presented false information related to investment opportunities. This incident was reported by Gulf News, highlighting a regional awareness of such digital misinformation. Why it matters: This incident highlights the growing challenge of AI-generated deepfakes used for financial misinformation and fraud, emphasizing the need for robust detection and public awareness in the digital age.
Researchers from MBZUAI have introduced SPECS, a new reference-free evaluation metric for long image captions that modifies CLIP to emphasize specificity. SPECS aims to improve the correlation with human judgment while maintaining computational efficiency compared to LLM-based metrics. The proposed approach is intended for iterative use during image captioning model development, offering a practical alternative to existing methods.
MBZUAI researchers introduce UniMed-CLIP, a unified Vision-Language Model (VLM) for diverse medical imaging modalities, trained on the new large-scale, open-source UniMed dataset. UniMed comprises over 5.3 million image-text pairs across six modalities: X-ray, CT, MRI, Ultrasound, Pathology, and Fundus, created using LLMs to transform classification datasets into image-text formats. UniMed-CLIP significantly outperforms existing generalist VLMs and matches modality-specific medical VLMs in zero-shot evaluations, improving over BiomedCLIP by +12.61 on average across 21 datasets while using 3x less training data.
MBZUAI researchers introduce XrayGPT, a conversational medical vision-language model for analyzing chest radiographs and answering open-ended questions. The model aligns a medical visual encoder (MedClip) with a fine-tuned large language model (Vicuna) using a linear transformation. To enhance performance, the LLM was fine-tuned using 217k interactive summaries generated from radiology reports.
A new paper at ICCV 2025, co-authored by MBZUAI Ph.D. student Dmitry Demidov, introduces Dense-WebVid-CoVR, a 1.6-million sample benchmark for composed video retrieval (CoVR). The benchmark features longer, context-rich descriptions and modification texts, generated using Gemini Pro and GPT-4o, with manual verification. The paper also presents a unified fusion approach that jointly reasons across video and text inputs, improving performance on fine-grained edit details. Why it matters: This work advances video search capabilities by enabling more human-like queries, which is crucial for creative and analytic workflows that require nuanced video retrieval.
MBZUAI Ph.D. student Raza Imam and colleagues presented a new benchmark called MediMeta-C to test the robustness of medical vision-language models (MVLMs) under real-world image corruptions. They found that top-performing MVLMs on clean data often fail under mild corruption, with fundoscopy models particularly vulnerable. To address this, they developed RobustMedCLIP (RMC), a lightweight defense using few-shot LoRA tuning to improve model robustness. Why it matters: This research highlights the critical need for robustness testing in medical AI to ensure reliability in clinical settings, particularly in resource-constrained environments where image quality may be compromised.
MBZUAI and Corniche Hospital researchers have developed FetalCLIP, a foundation model for analyzing fetal ultrasound images to detect congenital conditions. FetalCLIP outperformed other foundation models on ultrasound analysis tasks. The AI model aims to improve the early diagnosis of ailments like congenital heart defects. Why it matters: This innovation has the potential to dramatically improve health outcomes for millions of children annually by providing physicians with better insights into fetal health.
MBZUAI researchers developed FetalCLIP, an AI model trained on 210,000 ultrasound images for fast and reliable interpretation of fetal scans. MBZUAI's President Eric Xing contributed to the General Expression Transformer (GET), an AI foundation model acting as a biological simulator to predict gene behavior. MBZUAI and Carleton University created MedPromptX for quicker disease diagnosis and treatment plans using multimodal AI. Why it matters: These AI advancements from MBZUAI have the potential to revolutionize healthcare in the region and globally, from prenatal care to drug discovery and personalized medicine.