Skip to content
GCC AI Research

Topics ›

Arabic AI

801–850 articles · Page 17 RSS ↗

An Accurate Arabic Root-Based Lemmatizer for Information Retrieval Purposes

arXiv · · NLP Arabic AI

This paper introduces a new non-statistical Arabic lemmatizer algorithm designed for information retrieval systems. The lemmatizer leverages Arabic language knowledge resources to generate accurate lemma forms and relevant features. The algorithm achieves a maximum accuracy of 94.8% and 89.15% on first seen documents, outperforming the Stanford Arabic model's 76.7% on the same dataset. Why it matters: Accurate Arabic lemmatization is crucial for improving the performance of Arabic information retrieval systems, which can enhance access to Arabic language content.

A Cross-cultural Corpus of Annotated Verbal and Nonverbal Behaviors in Receptionist Encounters

arXiv · · NLP Arabic AI

Researchers created a cross-cultural corpus of annotated verbal and nonverbal behaviors in receptionist interactions. The corpus includes native speakers of American English and Arabic role-playing scenarios at university reception desks in Doha, Qatar, and Pittsburgh, USA. The manually annotated nonverbal behaviors include gaze direction, hand gestures, torso positions, and facial expressions. Why it matters: This resource can be valuable for the human-robot interaction community, especially for building culturally aware AI systems.

Web-Based Expert System for Civil Service Regulations: RCSES

arXiv · · Research Arabic AI

The paper introduces a web-based expert system called RCSES for civil service regulations in Saudi Arabia. The system covers 17 regulations and utilizes XML for knowledge representation and ASP.net for rule-based inference. RCSES was validated by domain experts and technical users, and compared favorably to other web-based expert systems.

G42, UAE Team Emirates-XRG and MET Unveil Season Two of Helmetverse

G42 · · Product Partnership

G42, in collaboration with UAE Team Emirates-XRG and MET Helmets, unveiled a special-edition AI-designed helmet, created with AI artist Gizem Akdağ, which debuted at Stage 5 of the Tour de France. This event marks the upcoming launch of the second edition of Helmetverse on July 13, a global design platform inviting cycling fans to create their own AI-generated helmet designs. The winning design from the Helmetverse competition, which generated nearly 20,000 designs in its first edition, will be manufactured by MET Helmets and worn by UAE Team Emirates-XRG at the UAE Tour in February 2027. Why it matters: This initiative showcases G42's commitment to making AI accessible for creative and public engagement applications, highlighting the intersection of sports, technology, and fan interaction from a prominent UAE-based AI company.

Alumni Spotlight: How Abdelrahman Shaker learned to redefine impact in AI

MBZUAI · · Research CV

MBZUAI alumnus Abdelrahman Shaker reflects on his evolving definition of impact in AI research, now valuing real-world usefulness over publication count. His work on efficient models like SwiftFormer (ICCV'23) and EdgeNext saw unexpected adoption, with millions of downloads and integration into real-world applications. Shaker chose MBZUAI for its faculty alignment, resulting in 10 publications and over 2,500 citations by graduation. Why it matters: This highlights the increasing focus on practical applications and real-world impact within the AI research community in the GCC region, as opposed to purely academic metrics.

Making human-machine conversation more lifelike than ever at GITEX

MBZUAI · · LLM Research

MBZUAI researchers demonstrated a low-latency, multilingual multimodal AI system at GITEX that integrates speech, text, and visual capabilities for more lifelike human-machine conversation. The demo, led by Dr. Hisham Cholakkal, includes a mobile app where users can point their camera at an object and ask questions, receiving spoken answers in multiple languages. They are also integrating the model into a robot dog that can respond to voice commands. Why it matters: This work addresses key challenges in deploying LLMs to real-world applications in the Middle East, such as multilingual support and real-time responsiveness.

MBZUAI report on AI for the global south launches at India AI Impact Summit

MBZUAI · · Research Policy

MBZUAI launched a report titled "AI for the Global South: 12 Critical Research Questions for the Next Decade" at the India AI Impact Summit. The report identifies 12 urgent research priorities related to AI's accessibility and benefits for developing countries. It grew out of MBZUAI’s AI for the Global South (AI4GS) workshop in December 2023, co-organized with IIT Delhi Abu Dhabi and sponsored by Microsoft. Why it matters: The report addresses the underrepresentation of local data, languages, and institutions from the Global South in modern AI systems, aiming to guide AI development towards inclusive and locally grounded systems.

CBUAE issues gold and silver commemorative coins to mark the 5th anniversary of Mohamed bin Zayed University of Artificial Intelligence

MBZUAI · · Policy Ethics

The Central Bank of the UAE (CBUAE) has issued gold and silver commemorative coins to mark the fifth anniversary of Mohamed bin Zayed University of Artificial Intelligence (MBZUAI). The gold coin features the Knowledge Centre of MBZUAI, the years “2020” and “2025”, and the inscription “Power from Knowledge to Serve”. The issuance comprises 10 gold coins and 500 silver coins, each weighing 50 grams, and have been delivered to MBZUAI. Why it matters: The issuance reflects the UAE's commitment to highlighting national initiatives in education and recognizing MBZUAI's role in building a knowledge- and innovation-driven economy.

Eric Xing explores the ‘next phase of intelligence’ at Davos

MBZUAI · · LLM Policy

MBZUAI President Eric Xing argued at the World Economic Forum in Davos that AI's next phase requires redesigning AI for real-world understanding and uncertainty, rather than just scaling models. He highlighted MBZUAI's unique position in building foundation models from scratch, emphasizing the importance of understanding their nuances, safety, and risks. Xing expressed skepticism about claims of general intelligence in current AI systems, pointing out their fragility and limited form of intelligence. Why it matters: Xing's participation highlights the growing role of Middle Eastern AI institutions like MBZUAI in shaping the global conversation around the future of AI.

When AI learns to listen: how researchers are decoding baby cries to help new parents

MBZUAI · · Healthcare Research

MBZUAI researchers developed LetBabyTalk, an AI-powered multilingual parenting app that analyzes baby cries to identify needs like hunger or sleepiness. The app is trained on over 1,000 baby cries and uses supervised machine learning with input from experienced parents and educators. Cradle AI, the startup behind the app, aims to bridge the gap between advanced AI research and real-world solutions, focusing on family care and education. Why it matters: This project demonstrates the potential of AI to address everyday challenges and improve the lives of families in the region and globally, while also showcasing MBZUAI's focus on AI for social good.

The future of audio AI: adoption use cases powering the Middle East

MBZUAI · · NLP LLM

ElevenLabs, a voice AI research and product company, presented at MBZUAI's Incubation and Entrepreneurship Center (IEC) on the adoption of audio AI in the Middle East. Hussein Makki, general manager for the Middle East at ElevenLabs, highlighted the potential of voice-native AI across sectors like telecommunications, banking, and education. ElevenLabs focuses on making content accessible and engaging across languages and voices through its text-to-speech models. Why it matters: This signals growing interest and investment in voice AI applications within the region, potentially transforming customer service and content accessibility in Arabic.

Improving through argument: a symbolic approach to fake-news detection

MBZUAI · · NLP LLM

MBZUAI researchers developed a symbolic adversarial learning framework (SALF) for fake news detection using LLM-powered agents. SALF employs a generator and a detector in a debate-like setup, judged by another LLM, to improve the agents' ability to create and identify fake news. Testing showed that the SALF generator degraded the performance of existing fake news detectors by 53.4% on Chinese and 34.2% on English datasets. Why it matters: This research offers a novel approach to combating the evolving threat of LLM-generated disinformation, a critical issue for maintaining reliable information ecosystems in the region and globally.

The rise of agentic AI: homegrown Lawa.AI gains momentum

MBZUAI · · LLM Research

MBZUAI Provost Timothy Baldwin predicts that 2025 will be a breakout year for agentic AI, with 33% of enterprise software applications including agentic AI capabilities by 2028. MBZUAI doctoral students Wafa Alghallabi and Omkar Thawaker have launched Lawa.AI, an AI agent being tested on the university's website to provide faster answers and deeper understanding. Lawa.AI evolved from a research project in multimodal efficiency and LLMs and aims to bridge the gap between people and information in higher education and government. Why it matters: This highlights the UAE's focus on translating AI research into practical applications and the growing importance of agentic AI in various sectors.

MBZUAI launches K2 Think Hackathon to turn ideas into real world impact

MBZUAI · · Research Partnership

MBZUAI has launched the K2 Think Hackathon, an international challenge focused on building applications powered by the K2 Think open-source system for advanced reasoning. The hackathon has two stages: a global open call for proposals and an in-person build challenge in Abu Dhabi for the top 10 teams. The winning team's idea will be integrated into the K2 Think app. Why it matters: This hackathon fosters innovation in AI reasoning and provides a platform for developers to create impactful solutions using a system developed in partnership with G42.

K2 Think Hackathon: could your idea turn into impact in 48 hours?

MBZUAI · · LLM Partnership

MBZUAI is hosting the K2 Think Hackathon, challenging participants to develop applications using the K2 Think reasoning model developed with G42. The hackathon involves a global idea call followed by a 48-hour build challenge in Abu Dhabi for the top 10 teams. The winning feature will be integrated into the K2 Think application. Why it matters: This hackathon provides a valuable opportunity to test and shape a cutting-edge AI model, potentially leading to innovative applications in various sectors like finance and education within the UAE and beyond.

Q&A with Eric Xing: global collaborations & ethical AI

MBZUAI · · Policy Ethics

MBZUAI President Eric Xing addressed questions about the university's global collaborations, ethical standards, and relationship to Chinese interests. He emphasized the UAE's focus on technological advancement and economic diversification through AI, highlighting MBZUAI's role in advancing this vision. Xing affirmed the university's autonomy, its commitment to Western academic values, and his lack of engagement with the Chinese government on university matters. Why it matters: The interview provides insights into the UAE's approach to AI development, emphasizing responsible global engagement and dispelling concerns about undue influence from specific countries.

Detecting the undetectable: Transforming policing with AI

MBZUAI · · CV Research

Salem AlMarri, the first Emirati Ph.D. graduate from MBZUAI, developed a video anomaly detection (VAD) system for his thesis. The VAD system can detect subtle anomalies in video, such as suspicious interactions, to help police prevent crimes and save lives. AlMarri's work was carried out under the guidance of Karthik Nandakumar, Affiliated Associate Professor of Computer Vision at MBZUAI. Why it matters: This research showcases the potential of AI in enhancing public safety and security in the UAE, demonstrating practical applications of computer vision in law enforcement.

MBZUAI graduate’s journey from Eritrea to empowerment

MBZUAI · · LLM Research

MBZUAI graduate Daniel Gebre from Eritrea has developed iShrink, a compression pipeline that reduces the size of LLMs to run offline on mobile phones and edge devices. Gebre's master's thesis focused on enabling access to cutting-edge AI without requiring internet access, motivated by his experience in under-resourced regions. His journey to MBZUAI began with a Merit Scholarship awarded by the UAE Ministry of Education, leading him to pursue a Master of Science in Machine Learning. Why it matters: This research has the potential to democratize access to AI in areas with limited internet connectivity, particularly in regions like Gebre's homeland, Eritrea.

How dialectal pretraining improves Arabic automatic speech recognition

MBZUAI · · NLP Arabic AI

MBZUAI researchers presented a study at ACL 2024 on improving Arabic ASR by pre-training on dialectal Arabic. They trained three versions of the ArTST model: one on MSA, one on MSA and dialectal data, and one on MSA, dialectal, and multilingual data. Results showed that pre-training on dialectal Arabic improves ASR performance across MSA and various dialects. Why it matters: This research addresses a key challenge in Arabic NLP, given the diversity and lack of standardization in dialects, which could lead to more accurate speech recognition systems.

Overcoming the ‘reversal curse’ in LLMs with ReCall

MBZUAI · · LLM Research

MBZUAI researchers identified 'self-referencing causal cycles' in LLM training data that can mitigate the 'reversal curse,' where LLMs struggle with information presented in reverse order. The study, to be presented at ACL, explains that the transformer architecture's unidirectional token generation causes this issue. By leveraging the repetitive nature of information in training texts, the team developed an efficient solution to improve LLM performance. Why it matters: Overcoming the reversal curse can significantly enhance LLM accuracy and reliability, especially in tasks requiring bidirectional reasoning and understanding of context.

Making LLM accuracy a matter of fact

MBZUAI · · NLP LLM

MBZUAI NLP master's graduate Hasan Iqbal developed OpenFactCheck, a framework for fact-checking and evaluating the factual accuracy of large language models. The framework consists of three modules: ResponseEvaluator, LLMEvaluator, and CheckerEvaluator. OpenFactCheck was published at EMNLP 2024 and accepted at NAACL 2025 and COLING 2025, with Iqbal playing an active role at COLING in Abu Dhabi. Why it matters: The development of automated fact-checking frameworks is crucial for ensuring the reliability and trustworthiness of information generated by increasingly prevalent LLMs, especially in the Arabic-speaking world.

AI researcher tackles stuttering diagnosis in the developing world

MBZUAI · · NLP Healthcare

MBZUAI doctoral student Hawau Toyin is applying AI to the identification, correction, and evaluation of stuttering, particularly in developing countries where it often goes undiagnosed. She is collaborating with the SpeechCare Center UAE and her advisor Dr. Hanan Aldarmaki to develop AI tools for faster and more accessible diagnosis and treatment. The research focuses on data collection from around the world to build an effective AI system that can analyze the various forms of stuttering. Why it matters: This research addresses a critical healthcare gap by leveraging AI to improve diagnosis and treatment of speech disorders in underserved regions.

How MBZUAI’s first NLP Ph.D. graduate is bringing bias to light

MBZUAI · · NLP Research

Muhammad Arslan Manzoor became MBZUAI's first NLP Ph.D. graduate, focusing his research on media bias under Professor Preslav Nakov. His thesis, 'MGM,' explored using audience overlap graphs to predict the factuality and bias of news media, an approach that differs from traditional textual analysis. Manzoor's work aims to improve the efficiency of media profiling in real-time by leveraging relationships captured in media graphs. Why it matters: This research offers innovative methods for identifying bias in news, which is crucial for promoting informed social discourse and combating disinformation in the region.

Improving diagnosis of neurodegenerative diseases

MBZUAI · · Healthcare Research

MBZUAI valedictorian Salma Hassan developed a multimodal graph learning approach for early dementia diagnosis and prognosis. Her master's thesis focused on differential diagnosis to identify specific dementia subtypes and predicting cognitive decline in preclinical patients. The AI model leverages brain imaging, genetics, and clinical records to improve diagnostic accuracy. Why it matters: This research can improve early detection and resource allocation for dementia management, especially in developing countries.

Bringing ideas to life with a new writing tool for Arabic language learners

MBZUAI · · NLP Arabic AI

NYU Abu Dhabi and MBZUAI researchers have developed ARWI, a free web application to help Arabic language learners improve their writing skills in Modern Standard Arabic. ARWI provides essay prompts aligned with CEFR skill levels, features an Arabic text editor, and gives personalized feedback. The tool won the Diversity Award at the Workshop on Intelligent and Interactive Writing Assistants (In2Writing). Why it matters: This tool can help preserve the quality and personal voice of Arabic writing amid the rise of LLMs.

Can crowdsourced fact-checking curb misinformation on social media?

MBZUAI · · NLP Ethics

MBZUAI Professor Preslav Nakov discusses Meta's shift to crowdsourced fact-checking via Community Notes, replacing third-party fact-checkers. Community Notes, originating from Twitter's Birdwatch, allows users to add context to potentially misleading posts, visible after community consensus. Research indicates this approach can reduce misinformation and lead to post retractions. Why it matters: The adoption of crowdsourcing for content moderation by major platforms like Meta could significantly impact online information quality for billions of users.

Testing LLMs safety in Arabic from two perspectives | NAACL

MBZUAI · · NLP LLM

Researchers at MBZUAI presented a new Arabic dataset at NAACL to measure LLM safety, building on a Chinese dataset called 'Do Not Answer'. The dataset includes nearly 5,800 questions with challenges and harmless requests containing sensitive terms to test for over-sensitivity. The team localized cultural concepts and added 3,000 questions specific to Arabic language and culture. Why it matters: This comprehensive benchmark, accounting for the diversity of Arabic dialects and cultures, advances the development of safer and more culturally aligned LLMs for Arabic speakers.

What LLMs get wrong about culture — and how to fix them: Two studies from NAACL

MBZUAI · · NLP LLM

MBZUAI researchers presented two studies at NAACL 2025 concerning how LLMs understand cultural differences, with one study winning the SAC award. One study, titled "Reading between the lines: Can LLMs identify cross-cultural communication gaps," assesses GPT-4o's ability to identify cultural references in Goodreads book reviews. The researchers created a benchmark dataset using annotations from 50 evaluators across different cultures to measure the LLM's ability to identify culture-specific items (CSIs). Why it matters: Improving LLMs' cross-cultural understanding is crucial for ensuring these models can be used effectively and equitably across diverse global contexts.

Identifying bias in generative music models: A new study presented at NAACL

MBZUAI · · Research NLP

MBZUAI researchers found that only 5.7% of music in existing datasets used to train generative music systems comes from non-Western genres. They discovered that 94% of the music represented Western music, while Africa, the Middle East, and South Asia accounted for only 0.3%, 0.4%, and 0.9% respectively. The team also tested whether parameter-efficient fine-tuning with adapters could improve generative music systems on underrepresented styles, presenting their findings at NAACL. Why it matters: This research highlights the critical need for more diverse datasets in AI music generation to better serve global musical traditions and audiences.

A graduate’s view on revealing invisible data

MBZUAI · · Healthcare Research

MBZUAI graduate Svetlana Maslenkova worked with Assistant Professor Mohammad Yaqub on a project focused on the earlier detection of kidney failure using tabular data. Maslenkova's master's thesis involved predicting Acute Kidney Injury (AKI) using Electronic Health Records (EHR), specifically the MIMIC-IV v2.0 database. She found that patient weight distribution was a factor in the severity of kidney failure. Why it matters: This research highlights the potential of AI and machine learning to improve healthcare outcomes through the analysis of often-overlooked tabular data in electronic health records.

Culturally Yours: A new tool for understanding cultural references in text

MBZUAI · · NLP Research

MBZUAI researchers have developed "Culturally Yours," a reading assistant that highlights and explains culturally-specific items on webpages to help users understand unfamiliar terms. The tool addresses the "cold-start problem" by asking users for demographic information to personalize the identification of potentially unfamiliar cultural references. It was presented at the 31st International Conference on Computational Linguistics in Abu Dhabi. Why it matters: This tool can help bridge linguistic and cultural gaps, particularly for underrepresented languages and cultures, and aid businesses in reaching diverse audiences.

Transformer Models: from Linguistic Probing to Outlier Weights

MBZUAI · · NLP LLM

Giovanni Puccetti from ISTI-CNR presented research on linguistic probing of language models like BERT and RoBERTa. The research investigates the ability of these models to encode linguistic properties, linking this ability to outlier parameters. Preliminary work on fine-tuning LLMs in Italian and detecting synthetic news generation was also presented. Why it matters: Understanding the inner workings and linguistic capabilities of LLMs is crucial for improving their reliability and adapting them to diverse languages like Arabic.

What Really Counts: Theoretical and Empirical Aspects of Counting Behaviour in Simple RNNs

MBZUAI · · NLP Research

Nadine El Naggar from City, University of London presented research on RNN learning of counting behavior, formalizing it as Dyck-1 acceptance. Empirically, RNN models struggle to learn exact counting and fail on longer sequences, even when weights are correctly initialized. Theoretically, Counter Indicator Conditions (CICs) were proposed and proven necessary/sufficient for exact counting in single-cell RNNs, but experiments show these CICs are not found or are unlearned during training. Why it matters: This work highlights challenges in RNNs learning systematic tasks, suggesting gradient descent-based optimization may not achieve exact counting behavior with standard setups.

Parameter-Efficient Fine-Tuning for NLP Models

MBZUAI · · NLP LLM

The article discusses parameter-efficient fine-tuning methods for large NLP models, highlighting their importance due to the increasing size and computational demands of state-of-the-art language models. It provides an overview of these methods, presenting them in a unified view to emphasize their similarities and differences. Indraneil, a PhD candidate at TU Darmstadt's UKP Lab, is researching parameter-efficient fine-tuning, sparsity, and conditional computation methods to improve LLM performance in multilingual, multi-task settings. Why it matters: Efficient fine-tuning techniques are crucial for democratizing access to and accelerating the deployment of large language models in the region and beyond.

User-Centric Gender Rewriting

MBZUAI · · NLP Arabic AI

NYU and NYU Abu Dhabi researchers are working on user-centric gender rewriting in NLP, especially for Arabic. They are building an Arabic Parallel Gender Corpus and developing models for gender rewriting tasks. The work aims to address representational harms caused by NLP systems that don't account for user preferences regarding grammatical gender. Why it matters: This research promotes fairness and inclusivity in Arabic NLP by enabling systems to generate gender-specific outputs based on user preferences, mitigating biases present in training data.

Predicting and Explaining Cross-lingual Zero-shot and Few-shot Transfer in LLMs

MBZUAI · · NLP LLM

Project LITMUS explores predicting cross-lingual transfer accuracy in multilingual language models, even without test data in target languages. The goal is to estimate model performance in low-resource languages and optimize training data for desired cross-lingual performance. This research aims to identify factors influencing cross-lingual transfer, contributing to linguistically fair MMLMs. Why it matters: Improving cross-lingual transfer is vital for creating more equitable and effective multilingual AI systems, especially for languages with limited resources.

Explainable Fact Checking for Statistical and Property Claims

MBZUAI · · Research NLP

EURECOM researchers developed data-driven verification methods using structured datasets to assess statistical and property claims. The approach translates text claims into SQL queries on relational databases for statistical claims. For property claims, they use knowledge graphs to verify claims and generate explanations. Why it matters: The methods aim to support fact-checkers by efficiently labeling claims with interpretable explanations, potentially combating misinformation in the region and beyond.

Using Machine Learning to Study How Brains Process Natural Language

MBZUAI · · NLP Research

Tom M. Mitchell from Carnegie Mellon University discussed using machine learning to study how the brain processes natural language, using fMRI and MEG to record brain activity while reading text. The research explores neural encodings of word meaning, information flow during word comprehension, and how meanings of words combine in sentences and stories. He also touched on how understanding of the brain aligns with current AI approaches to NLP. Why it matters: This interdisciplinary research could bridge the gap between neuroscience and AI, potentially leading to more human-like NLP models.

Challenges in low-resourced NLP: an Irish case study

MBZUAI · · NLP Research

Dr. Teresa Lynn from Dublin City University (DCU) discussed the challenges in developing NLP tools for Irish, a low-resource language facing digital extinction. She highlighted the lack of speech and language applications and fundamental language resources for Irish. Lynn also mentioned her work at DCU on the GaelTech project and her involvement in the European Language Equality project. Why it matters: The development of NLP tools for low-resource languages like Irish is crucial for preserving linguistic diversity and preventing digital marginalization in the AI era.

Addressing NLP problems in low resource settings

MBZUAI · · NLP Research

Thamar Solorio from the University of Houston will discuss machine learning approaches for spontaneous human language processing. The talk will cover adapting multilingual transformers to code-switching data and using data augmentation for domain adaptation in sequence labeling tasks. Solorio will also provide an overview of other research projects at the RiTUAL lab, focusing on the scarcity of labeled data. Why it matters: This presentation addresses key challenges in Arabic NLP related to data scarcity, which is a persistent obstacle in developing effective AI applications for the region.

NLP for Long, Structured Documents

MBZUAI · · NLP Research

Jan Buchmann from TU Darmstadt presented research on NLP for long, structured documents at MBZUAI. The research addresses gaps in using document structure and improving the verifiability of LM responses. Experiments showed that models learn to represent document structure during pre-training, and larger models can cite sources well. Why it matters: This research contributes to making NLP more effective for complex documents like scientific articles and legal texts, which is crucial for information accessibility.

Human-Centric Approaches for Multimodal Deepfakes Analysis

MBZUAI · · NLP CV

A talk explores multimodal approaches inspired by user behavior for detecting deepfakes, considering user studies on multicultural deepfakes and the ACM Multimedia 2024 benchmark. The research leverages insights into how different audiences perceive manipulated media. Abhinav Dhall from Flinders University will present findings and future directions in deepfake analysis at MBZUAI. Why it matters: Addressing deepfakes is crucial for maintaining trust in digital content, especially with the increasing sophistication and accessibility of AI-driven manipulation tools.

Past, Present and Future of Speech Technologies

MBZUAI · · NLP LLM

Pedro J. Moreno, former head of ASR R&D at Google, presented a talk at MBZUAI on the past, present, and future of speech technologies. The talk covered the evolution of speech tech, his career contributions including work on Google Voice search, and the impact of LLMs on speech science. He also discussed the interplay between foundational and applied research and preparing the next generation of scientists. Why it matters: The talk provides insights into the trajectory of speech technologies from a leading researcher, highlighting future directions and the ethical considerations surrounding AI's impact on society.

AI Safety Research

MBZUAI · · Research LLM

Adel Bibi, a KAUST alumnus and researcher at the University of Oxford, presented his research on AI safety, covering robustness, alignment, and fairness of LLMs. The research addresses challenges in AI systems, alignment issues, and fairness across languages in common tokenizers. Bibi's work includes instruction prefix tuning and its theoretical limitations towards alignment. Why it matters: This research from a leading researcher highlights the importance of addressing safety concerns in LLMs, particularly regarding alignment and fairness in the Arabic language.

Navigating NLP for Underrepresented Languages: Dataset Challenges, Efficient Techniques, and Evaluations

MBZUAI · · NLP Research

MBZUAI's Dr. Fajri Koto presented research on overcoming challenges in NLP for underrepresented languages. His work includes creating multilingual datasets for Indonesian languages by engaging native speakers and finding that direct composition yields better results than translation. He also discussed vocabulary adaptation and zero-shot learning to address computational resource limitations, and emphasized the importance of datasets with local context for evaluating LLMs. Why it matters: This research addresses critical gaps in NLP for low-resource languages, providing insights and techniques to improve performance and cultural relevance in multilingual AI models within the region and globally.

Alumni Spotlight: In pursuit of truth

MBZUAI · · NLP LLM

MBZUAI alumnus Zain Muhammed Mujahid is pursuing a Ph.D. at the University of Copenhagen, focusing on factual text generation in LLMs to combat misinformation. During his master's at MBZUAI, he researched political bias and misinformation in media outlets using LLMs, under the mentorship of Professor Preslav Nakov. His master's thesis involved assessing a media outlet's factual reporting level and political leaning on topics like immigration and economy. Why it matters: This research addresses a critical challenge in AI, enhancing the reliability of LLMs and mitigating the spread of disinformation, an issue of global concern.

Large Language Models for the Real World: Explorations of Sparse, Cross-lingual Understanding and Instruction-Tuned LLMs

MBZUAI · · LLM NLP

Veselin Stoyanov of Tome (previously Facebook AI) gave a talk at MBZUAI on challenges to LLM adoption. The talk covered sparse models, multilingual LLMs, and instruction finetuning. Stoyanov previously led development of RoBERTa, XLM-R, and MultiRay. Why it matters: This talk highlights MBZUAI's role as a forum for discussing key challenges and advancements in large language models, with implications for Arabic NLP and regional AI development.

Physics of Language Models: Knowledge Storage, Extraction, and Manipulation

MBZUAI · · LLM Research

A CMU professor and MBZUAI affiliated faculty presented research on how LLMs store and use knowledge learned during pre-training. The study used a synthetic biography dataset to show that LLMs may not effectively use memorized knowledge at inference time, even with zero training loss. Data augmentation during pre-training can force the model to store knowledge in specific token embeddings. Why it matters: The research highlights limitations in LLM knowledge manipulation and extraction, with implications for improving model architectures and training strategies for more effective knowledge utilization in Arabic LLMs.

Challenges and Solutions in Developing Code-switched Arabic-English NLP Systems

MBZUAI · · NLP Arabic AI

Injy Hamed from NYU Abu Dhabi's CAMeL Lab presented work on Egyptian Arabic-English code-switching for ASR and MT. She discussed the ArzEn-ST speech translation corpus and compared end-to-end and hybrid systems for ASR. For MT, she presented data augmentation and word segmentation techniques to handle data scarcity, also addressing ASR evaluation challenges in code-switching. Why it matters: Research into code-switching is crucial for building NLP systems capable of processing real-world language use in the Arab world.

Alumni Spotlight: Making AI accessible for all

MBZUAI · · Research Healthcare

MBZUAI alumnus Ahmed Sharshar is developing smaller AI models to make the technology more accessible, especially in resource-constrained environments like Egypt. His master's thesis involved creating an app that assesses lung health using mobile phone video analysis, eliminating the need for traditional medical devices. Sharshar is pursuing his Ph.D. at MBZUAI, focusing on lightweight and energy-efficient models for various applications. Why it matters: Democratizing AI through smaller, efficient models can enable broader applications and innovation across diverse sectors in the Middle East and beyond.