The article provides a basic overview of large language models (LLMs), explaining their functionality and applications. LLMs are AI systems that process and generate human-like text using transformer architecture, trained on vast datasets to predict the next word in a sequence. The piece differentiates between general-purpose, task-specific, and multimodal models, as well as closed-source and open-source LLMs. Why it matters: LLMs are foundational for advancements in Arabic NLP, as evidenced by models like MBZUAI's Jais, and understanding their mechanics is crucial for regional AI development.
A new Bayesian matrix factorization approach is explored for performance prediction in multilingual NLP, aiming to reduce the experimental burden of evaluating various language combinations. The approach outperforms state-of-the-art methods in NLP benchmarks like machine translation and cross-lingual entity linking. It also avoids hyperparameter tuning and provides uncertainty estimates over predictions. Why it matters: Accurate performance prediction methods accelerate multilingual NLP research by reducing computational costs and improving experimental efficiency, especially valuable for Arabic NLP tasks.
Thamar Solorio of MBZUAI served as general chair of EMNLP 2024, which hosted over 4,000 attendees. MBZUAI researchers presented nearly 50 studies, including one co-authored by Solorio and Monojit Choudhury that received an Outstanding Paper Award. Key themes included cultural awareness, machine-generated content detection, and LLM empathy and cultural representation. Why it matters: MBZUAI's strong presence at EMNLP highlights its growing influence in the international NLP research community and its focus on culturally aware AI.
Justice Connect, an Australian charity, collaborated with MBZUAI's Prof. Timothy Baldwin to improve their legal intake tool using NLP. The tool helps route legal requests, but users struggled to identify the relevant area of law, leading to delays and frustration. By applying NLP, the collaboration aims to help users more easily navigate the tool and access appropriate legal resources. Why it matters: This project demonstrates how NLP can be applied to improve access to justice and address unmet legal needs, particularly for those unfamiliar with legal terminology.
Researchers from MBZUAI, University of Washington, and other institutions presented studies at EMNLP 2024 exploring how LLMs represent cultures. A survey analyzed dozens of recent studies on LLMs and culture and proposes a new framework for future research. The survey found that there is no widely accepted definition of 'culture' in NLP, making it challenging to interpret how models represent culture through language. Why it matters: This highlights a key gap in the field and emphasizes the need for a more rigorous and consistent understanding of culture in AI, especially as LLMs become more globally integrated.
The 31st International Conference on Computational Linguistics (COLING 2025) will be held in Abu Dhabi in January 2025, hosted by Mohamed bin Zayed University of Artificial Intelligence (MBZUAI). COLING is a major biennial NLP and AI conference that brings together leaders from research centers, academia, and industry. The conference will feature keynote talks, presentations, workshops, and tutorials, with 1,500 expected participants. Why it matters: Hosting COLING underscores the UAE's growing role in AI and NLP research and provides a platform to address regional linguistic challenges and advance AI technologies.
MBZUAI alumnus Adnan Khan is pursuing a Ph.D. at Carleton University, focusing his research on using computer vision to improve accessibility in healthcare, particularly for the visually impaired. His work builds upon his master's thesis at MBZUAI, which focused on domain generalization, enabling models to adapt across different data domains. Khan credits his experiences at MBZUAI for shaping his community spirit and career path. Why it matters: This highlights the role of AI education in fostering socially impactful research and driving innovation in healthcare accessibility in the region and beyond.
MBZUAI researchers are studying how AI can be used to combat disinformation and improve news verification during elections, as AI amplifies the volume and speed of fake news. Dilshod Azizov is using machine learning to spot patterns in news that will improve verification, while Preslav Nakov's FRAPPE system identifies persuasive techniques and framing in news articles. FRAPPE uses machine learning and NLP to analyze news presentation and reporting, aiming to help users understand the underlying context of news. Why it matters: This research highlights the potential of AI to both negatively and positively impact democratic processes, emphasizing the need for tools to analyze and verify information in the face of increasing AI-generated disinformation.
Researchers from MBZUAI and other institutions presented a study at ACL 2024 on combatting misinformation by identifying misrepresented scientific research. They compiled a dataset called MISSCI, comprised of real-world examples of misinformation gathered from the HealthFeedback fact-checking website. The annotators classified the different types of errors in reasoning into nine different classes. Why it matters: This work addresses a critical need to combat the spread of scientific falsehoods online, especially given the challenges of manual fact-checking.
MBZUAI researchers presented a study at NAACL 2024 analyzing errors made by open-source LLMs when solving math word problems. The study, led by Ekaterina Kochmar and KV Aditya Srivatsa, investigates characteristics that make math word problems difficult for machines. Llama2-70B was used to test the ability of LLMs to solve these problems, revealing that LLMs can perform math operations correctly but still give the wrong answer. Why it matters: The research aims to improve AI's ability to understand and solve math word problems, potentially leading to better educational applications and teaching methods.
MBZUAI researchers have expanded LLM safety research to Chinese, presenting their work at the 62nd Annual Meeting of the Association for Computational Linguistics in Bangkok. They developed an open-source Chinese dataset of 3,000 prompts translated and localized from the English "Do-Not-Answer" dataset. The dataset includes a "region-specific sensitivity" category to address unique safety risks for Chinese speakers, evaluating if models are over-sensitive in identifying innocuous questions as harmful. Why it matters: This research addresses a critical gap in LLM safety evaluation, ensuring that language models are both safe and effective for diverse linguistic and cultural contexts, particularly in regions with unique sensitivities.
MBZUAI researchers presented a new uncertainty quantification method at ACL to identify hallucinations in LLMs, called claim conditioned probability (CCP). CCP leverages the internal token probabilities generated by the LLM itself to highlight claims with low confidence. Unlike external fact-checking methods, CCP is computationally efficient as it uses probabilities already computed by the model. Why it matters: This research offers a practical approach to mitigate the impact of LLM hallucinations by highlighting potentially unreliable information, improving the trustworthiness of these models, especially for Arabic LLMs.
MBZUAI student Zain Muhammad Mujahid is researching methods to detect media bias using NLP and LLMs. His approach profiles bias across media outlets using LLMs like ChatGPT to predict bias based on 16 identifiers. The research aims to develop a tool that instantly provides a bias profile for a given media URL. Why it matters: This research has the potential to combat misinformation and enhance media literacy in the region by providing tools to identify biased reporting, and it is expanding to Arabic and other languages.
MBZUAI graduate Ahmed Sharshar developed a computer vision application that assesses lung health from a video of a person breathing, estimating Forced Vital Capacity (FVC), Forced Expiratory Volume in 1 second (FEV1), and Peak Expiratory Flow (PEF). The model achieved up to 100% accuracy using thermal video data from 60 participants. Sharshar aims to create lightweight models applicable in developing countries without high-end GPUs. Why it matters: This research showcases the potential of AI to democratize healthcare access through non-invasive, accessible diagnostic tools.
MBZUAI's Professor Ted Briscoe is working on an educational technology initiative with IBM to support Arabic literacy in the Gulf by providing personalized feedback on student writing. He is also developing a question-answering system for Abu Dhabi Global Market to help companies understand local regulations. The Q&A system aims to assist smaller companies in establishing offices in Abu Dhabi by providing affordable access to regulatory information. Why it matters: These projects apply NLP to address practical needs in education and business, fostering Arabic literacy and easing regulatory compliance for SMEs in the UAE.
MBZUAI adjunct professor Iryna Gurevych was appointed to the German National Academy of Sciences Leopoldina and received the “Social Impact Award” at the 18th Conference of the European Chapter of the Association for Computational Linguistics. The Social Impact Award recognized her study on sociodemographic prompting, a technique that steers prompt-based models towards answers reflecting specific sociodemographic profiles. Gurevych was also named one of the 15 most important women in AI in Germany by Manager Magazin for her work building an AI assistant with Amazon. Why it matters: Recognizing experts at MBZUAI raises the visibility of the university and its contributions to cutting-edge NLP research, particularly in areas like ethical and responsible AI development.
Professor Timothy Baldwin has been appointed as the Provost of Mohamed bin Zayed University of Artificial Intelligence (MBZUAI). He previously served as Department Chair of NLP, Associate Provost for Academic Affairs, and Acting Provost. During his tenure, Baldwin co-led the technical development of Jais, the leading Arabic LLM, and spearheaded initiatives including new academic departments and the Undergraduate Research Internship Program. Why it matters: Baldwin's appointment signals continued investment in AI talent and research at MBZUAI, particularly in Arabic NLP and large language models.
MBZUAI Professor Preslav Nakov has developed FRAPPE, an interactive website that analyzes news articles to identify persuasion techniques. FRAPPE helps users understand framing, persuasion, and propaganda at an aggregate level, across different news outlets and countries. Presented at EACL, FRAPPE uses 23 specific techniques categorized into six broader buckets, such as 'attack on reputation' and 'manipulative wording'. Why it matters: The tool addresses the increasing difficulty in discerning factual information from disinformation, providing a means to identify biases in news media from different countries.
MBZUAI Professor Monojit Choudhury co-authored a study on LLMs and their capacity for moral reasoning, with the study being presented at the 18th Conference of the European Chapter of the Association for Computational Linguistics (EACL) in Malta. The study included contributions from Aditi Khandelwal, Utkarsh Agarwal, and Kumar Tanmay from Microsoft. The research explores AI alignment, ensuring AI systems align with human values, moral principles, and ethical considerations. Why it matters: The study provides insight into LLMs' capabilities regarding complex ethical issues, which is important for guiding the development of AI in a way that is consistent with human values.
MBZUAI Assistant Professor Alham Fikri Aji is presenting research at EACL 2024 on efficient NLP for low-resource languages. The study uses knowledge distillation, transferring knowledge from a larger model (ChatGPT) to a smaller one using synthetic instruction data. The goal is to achieve similar performance with less computational resources, focusing on underrepresented languages. Why it matters: This work addresses the need for more accessible and inclusive NLP technologies, especially for languages lacking extensive datasets and computational resources.
MBZUAI researcher Karima Kadaoui is using AI to assist disadvantaged communities and languages, with a focus on democratizing NLP tasks for Arabic dialects. Her master's thesis focused on impaired speech recognition, converting disfluencies of individuals with speech disabilities into clear speech. She emphasizes the importance of diversity and inclusion in AI to avoid bias and ensure systems reflect the user distribution. Why it matters: This highlights MBZUAI's commitment to gender equity in STEM and the development of AI solutions tailored to the nuances of the Arabic language.
MBZUAI is highlighting five key AI innovations for UAE Innovation Month, including the Jais Arabic LLM developed with Core42 and Cerebras Systems. They also highlight the AI Operating System (AIOS) for reducing AI computing energy costs. Additionally, MBZUAI received a US patent for an AI-based handwriting generation technology. Why it matters: MBZUAI's focus on Arabic NLP and efficient AI computing positions the UAE as a leader in responsible and inclusive AI development.
MBZUAI researchers presented studies at EMNLP and ArabicNLP conferences on improving NLP for diverse languages, especially Arabic. One study evaluated ChatGPT and GPT-4's performance across Arabic dialects, finding limitations compared to English. GPT-4 showed better performance than GPT-3.5 in Arabic. Why it matters: This research highlights the need for NLP models to better support the linguistic diversity of Arabic and other languages to avoid widening existing technological gaps.
Cleveland Clinic Abu Dhabi and MBZUAI have signed an MoU to collaborate on research and education initiatives. The partnership aims to create opportunities such as joint research projects and mentorship programs for students. Both institutions will leverage their expertise to explore AI applications in healthcare, focusing on areas like diagnostics and digital twins. Why it matters: The collaboration will strengthen Abu Dhabi's position as a hub for AI-enabled healthcare innovation and talent development.
MBZUAI faculty won two awards and published eight papers at the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL 2023). Alham Fikri Aji and Fajri Koto won the Best Resource Award for NusaWrites, a paper on constructing high-quality corpora for low-resource Indonesian languages by engaging speaker communities. Muhammad Abdul-Mageed won an Area Chair award for ProMap, a method for constructing bilingual dictionaries via language model prompting. Why it matters: This highlights MBZUAI's contribution to NLP research, particularly in low-resource languages and bilingual lexicon induction, and strengthens its position as a hub for AI research in the region.
MBZUAI has been actively involved in developing AI and generative models, contributing to models like Llama 2, Jais, Vicuna, and LaMini. Professor Preslav Nakov notes Llama 2's improvements in size and carbon footprint over Llama 1. MBZUAI aims to tackle challenges like information accuracy, economic costs, and the scarcity of Arabic online content. Why it matters: MBZUAI's work helps address the limitations of current LLMs, particularly for Arabic, and promotes sustainable AI development in the region.
MBZUAI hosted an event for UAE students to demonstrate generative AI and its potential, featuring an interactive storytelling demonstration on Jais, the Arabic LLM. A survey at the event showed that 77% of students aged 12-15 believe AI skills will be required for future employment. The event included speakers from MBZUAI and NASA, showcasing AI applications in education and creative fields. Why it matters: This event highlights the UAE's focus on AI literacy among youth and MBZUAI's role in promoting AI education and awareness, aligning with the country's national AI strategy.
MBZUAI President Eric Xing discussed the transformative potential of AI with Abu Dhabi's Department of Community Development, likening its impact to that of the printing press. He emphasized AI's role in democratizing knowledge and enabling discoveries in genetics, pharmaceuticals, and healthcare. Xing also highlighted the UAE's strategic thinking and openness to innovation, positioning the nation as an international leader in AI, exemplified by MBZUAI's Jais LLM. Why it matters: This signals the UAE's continued focus on AI as a strategic priority, with emphasis on its potential to drive societal and economic development.
MBZUAI is prioritizing natural language processing (NLP) research, aiming to be a top university in the field within 12-18 months according to Professor Timothy Baldwin. MBZUAI's NLP department is focusing on deep learning, algorithmic fairness, computational social science and social media analytics. A key area is Arabic NLP, addressing the challenges of dialectal variations and code-switching in social media. Why it matters: This focus on Arabic NLP and real-world problem-solving will contribute to the UAE's ambitious agenda of growing a local AI industry and integrating AI into various sectors.
MBZUAI Professor Preslav Nakov is researching methods to combat fake news and online disinformation through NLP techniques. His work focuses on detecting harmful memes and identifying the stance of individuals regarding disinformation. Four of Nakov’s recent papers on these topics were presented at NAACL 2022. Why it matters: This research aims to mitigate the impact of weaponized news and online manipulation, contributing to a more trustworthy information environment in the region and globally.
MBZUAI 2023 graduate Muhammad Umar is researching propaganda detection in low-resource, code-switched languages like Roman Urdu. His master's thesis focuses on detecting propaganda techniques in social media text using deep learning models. Umar aims to submit a paper on his findings to the EMNLP 2023 conference. Why it matters: This research addresses the under-explored area of propaganda detection in low-resource languages, which is crucial for combating misinformation in bilingual communities.
MBZUAI faculty Alham Fikri Aji, Timothy Baldwin, and Fajri Koto won an Outstanding Paper Award at EACL 2023 for their paper "NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages." The paper introduces the first parallel resource for 10 Indonesian low-resource languages to boost performance in sentiment analysis and machine translation. The dataset is available on HuggingFace. Why it matters: This work highlights MBZUAI's commitment to advancing NLP research in low-resource languages, which can help preserve linguistic diversity and improve access to digital resources for speakers of underrepresented languages.
The article discusses the challenges in effectively applying text classification techniques, despite the availability of tools like LibMultiLabel. It highlights the importance of guiding users to appropriately use machine learning methods due to considerations in practical applications such as evaluation criteria and data strategies. The piece also mentions a panel discussion hosted by MBZUAI in collaboration with the Manara Center for Coexistence and Dialogue. Why it matters: This signals ongoing efforts within the UAE AI ecosystem to address practical challenges and promote responsible AI usage in NLP applications.
MBZUAI Professor Preslav Nakov believes AI can outpace human fact-checkers in detecting fake news by analyzing language and sentence structure. AI systems can identify common sources of fake news and flag domains for blocking. Nakov's research focuses on disinformation, fact checking, and media bias detection. Why it matters: AI-driven solutions for combating fake news could help mitigate the spread of misinformation and its impact on society, especially in the Arabic-speaking world.
MBZUAI's Hanan Al Darmaki is working to improve automated speech recognition (ASR) for low-resource languages, where labeled data is scarce. She notes that Arabic presents unique challenges due to dialectal variations and a lack of written resources corresponding to spoken dialects. Al Darmaki's research focuses on unsupervised speech recognition to address this gap. Why it matters: Overcoming these challenges can improve virtual assistant effectiveness across diverse languages and enable more inclusive AI applications in the Arabic-speaking world.
MBZUAI master's student Sayed Hashim is applying machine learning to improve cancer diagnosis and treatment, motivated by personal loss. He and fellow student Muhammad Ali developed algorithms for cancer type classification from multi-omics data, achieving over 96% accuracy. Their work, supervised by MBZUAI faculty, resulted in a published paper on multi-omics data representation learning. Why it matters: This research demonstrates the potential of AI and machine learning to advance cancer research and personalized medicine in the region.
This article discusses retrieval augmentation in text generation, where information retrieved from an external source is used to condition predictions. It references recent work on retrieval-augmented image captioning, showing that model size can be greatly reduced when training data is available through retrieval. The author intends to continue this work focusing on the intersection of retrieval augmentation and in-context learning, and controllable image captioning for language learning materials. Why it matters: This research direction has the potential to improve transfer learning in vision-language models, which could be especially relevant for downstream applications in Arabic NLP and multimodal tasks.
NYUAD and MBZUAI co-hosted the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP) in Abu Dhabi from December 7-11. EMNLP is a top-tier NLP and AI conference organized by the ACL special interest group on linguistic data (SIGDAT). MBZUAI's Natural Language Processing Department is actively developing NLP datasets and methods to solve social problems. Why it matters: Hosting EMNLP in the UAE highlights the growing importance of NLP research in the region and the increasing contributions of local institutions like MBZUAI to the field.
MBZUAI Visiting Assistant Professor Gus Xia studies music to understand how AI can act more human-like in high-context activities. Xia analyzes and creates music with computers to explore the differences between human and machine perception. He aims to leverage music's abstract nature to study creative intelligence in AI. Why it matters: This research could lead to AI systems that interact more naturally with humans, particularly in creative fields.
MBZUAI Department Chair Le Song served as a program co-chair at the 39th International Conference on Machine Learning (ICML). MBZUAI faculty, researchers, and students had 7 papers accepted at ICML 2022. Song noted the increasing focus on biomedicine and other science areas within the AI research community. Why it matters: Song's leadership role at ICML and MBZUAI's strong presence highlights the university's growing influence in the global machine learning landscape.
ICESCO and MBZUAI concluded a series of meetings at Moroccan universities to introduce engineering and science students to AI and scholarship opportunities at MBZUAI. Over 500 master’s and doctoral students participated in the week-long event. MBZUAI representatives highlighted the university's focus on computer vision and machine learning. Why it matters: This collaboration promotes AI education and research opportunities for students in Morocco, potentially fostering AI talent and innovation in the region.
Researchers at MBZUAI have developed Auto-DUB, a system using deep learning, NLP, and CV to improve audio-visual dubbing, particularly for educational videos. The three-step process generates subtitles, creates an audio representation, and synchronizes the audio with lip movements. The system aims to overcome language barriers in e-learning by providing accurate translations and lip-synced audio. Why it matters: This research addresses a critical need in online education by making content more accessible to non-native English speakers, potentially expanding access to global educational resources in the Arab world.
Ted Briscoe from the University of Cambridge discussed using machine learning and NLP to develop learning-oriented assessment (LOA) for non-native writers. The technology is used in Cambridge English courseware like Empower and Linguaskill, as well as Write and Improve. Briscoe is also the co-founder and CEO of iLexIR Ltd. Why it matters: Improving automated language assessment could significantly enhance online language learning platforms in the Arab world and beyond.
WAM (Emirates News Agency) and MBZUAI have signed a strategic agreement to collaborate on media and AI, knowledge sharing, training, and development. MBZUAI will be the Strategic Academic Sponsor of the Global Media Congress organized by ADNEC and WAM in November 2022. MBZUAI will also provide WAM employees with seats in its Executive Program and offer consultancy services for establishing an AI lab at WAM. Why it matters: This partnership aims to modernize the UAE's media sector by leveraging MBZUAI's AI expertise to develop innovative media applications and support the Global Media Congress.
A delegation from MBZUAI visited Egypt to discuss potential collaborations with Egyptian universities in AI. Discussions involved joint research projects in healthcare and Arabic language processing, establishing joint AI labs, faculty exchange programs, and dual degree programs. MBZUAI expressed its enthusiasm for collaborating with Egyptian universities, offering its faculty and research capabilities. Why it matters: This partnership can help advance AI research and education in both countries, especially in areas like Arabic NLP and AI applications in healthcare, fostering regional AI talent and innovation.
Dr. Min Xu joins MBZUAI as Affiliated Assistant Professor in Computer Vision to advance AI-based biomedical image analysis. His research focuses on cellular cryo-electron tomography (Cryo-ET) 3D image analysis, spatial transcriptomics, digital pathology, and automated science. Xu will collaborate with MBZUAI faculty and advise master’s students, leveraging his expertise in computational biology and bioinformatics. Why it matters: This appointment strengthens MBZUAI's capabilities in applying AI to critical areas of biomedical research, potentially leading to breakthroughs in disease understanding and treatment.
MBZUAI Professor Timothy Baldwin delivered the presidential keynote at the 60th Annual Meeting of the Association for Computational Linguistics (ACL). Baldwin also published three papers at the conference, including work on biomedical literature summarization, NLP for Indonesian languages, and understanding procedural texts. The papers address challenges such as reducing human effort in reviewing medical documents and digitally preserving Indonesian indigenous languages. Why it matters: Baldwin's contributions and leadership role at ACL highlight the growing prominence of MBZUAI and GCC-based researchers in the global NLP community.
MBZUAI hosted a senior delegation from Iraq to discuss potential collaborations. The delegation toured the university campus and met with Provost Fakhri Karray. Discussions focused on MBZUAI's objectives, strategic plans, and opportunities for cooperative development between the UAE and Iraq. Why it matters: This visit signifies MBZUAI's ongoing efforts to foster AI development and collaboration across the Middle East.
MBZUAI and the Abu Dhabi School of Government (ADSG) signed an MoU at GITEX 2021 to develop AI training programs for UAE leadership. The programs will focus on integrating AI technologies into governance, industry, education, and healthcare. MBZUAI and ADSG will jointly develop training programs and offer seminars/workshops on key AI research areas. Why it matters: This partnership strengthens the UAE's knowledge economy and supports Abu Dhabi's digitalization agenda by enhancing AI expertise in the government sector.
A delegation of senior officials from Singapore, including Minister Mohamed Maliki Bin Osman and Ambassador Kamal R. Vaswani, visited MBZUAI. They were hosted by MBZUAI's VP of Corporate Services Ian Matthews, Director of Outreach and Engagement Dr. Hosni Ghedira, and Director of Special Projects, Yun Xu. The visit involved discussions about MBZUAI's achievements and potential future collaborations. Why it matters: This signals growing international interest in MBZUAI and opportunities for partnerships in AI research and education between the UAE and Singapore.