Researchers at MBZUAI have developed Auto-DUB, a system using deep learning, NLP, and CV to improve audio-visual dubbing, particularly for educational videos. The three-step process generates subtitles, creates an audio representation, and synchronizes the audio with lip movements. The system aims to overcome language barriers in e-learning by providing accurate translations and lip-synced audio. Why it matters: This research addresses a critical need in online education by making content more accessible to non-native English speakers, potentially expanding access to global educational resources in the Arab world.
ElevenLabs, a voice AI research and product company, presented at MBZUAI's Incubation and Entrepreneurship Center (IEC) on the adoption of audio AI in the Middle East. Hussein Makki, general manager for the Middle East at ElevenLabs, highlighted the potential of voice-native AI across sectors like telecommunications, banking, and education. ElevenLabs focuses on making content accessible and engaging across languages and voices through its text-to-speech models. Why it matters: This signals growing interest and investment in voice AI applications within the region, potentially transforming customer service and content accessibility in Arabic.
Researchers at NYU Abu Dhabi have developed an AI system capable of translating spoken language into sign language. This innovative technology aims to enhance communication accessibility for individuals who are deaf or hard-of-hearing. The system leverages advancements in artificial intelligence, likely combining natural language processing for speech understanding and computer vision for sign generation. Why it matters: This development has the potential to significantly improve inclusion and communication for deaf communities within the Middle East and globally, bridging critical communication gaps.
MBZUAI researchers introduce LLMVoX, a 30M-parameter, LLM-agnostic, autoregressive streaming text-to-speech (TTS) system that generates high-quality speech with low latency. The system preserves the capabilities of the base LLM and achieves a lower Word Error Rate compared to speech-enabled LLMs. LLMVoX supports seamless, infinite-length dialogues and generalizes to new languages with dataset adaptation, including Arabic.
Sheikh Mohammed bin Rashid Al Maktoum has reviewed a strategic plan for the integration of artificial intelligence into government operations. The plan aims to transform half of all UAE government services to be AI-powered. This ambitious initiative is targeted for completion within the next two years. Why it matters: This reflects the UAE leadership's strong commitment to rapid AI adoption in public services, setting a benchmark for digital transformation and potentially stimulating significant investment and innovation in the country's AI sector.
The UAE government has issued a warning to the public regarding the dangers of misleading AI-generated videos, particularly those used to spread rumors and false information. Authorities emphasized the importance of verifying the credibility of video content before sharing it on social media. The warning highlights potential legal consequences for individuals involved in creating or disseminating such content. Why it matters: This proactive stance reflects growing concerns in the UAE about the misuse of AI-driven technologies and its commitment to combatting disinformation.