Natural language processing research from GCC institutions, covering Arabic NLP, multilingual models, text classification, named entity recognition, and machine translation.
Xiaolin Huang from Shanghai Jiao Tong University presented a talk at MBZUAI on training deep neural networks in tiny subspaces. The talk covered the low-dimension hypothesis in neural networks and methods to find subspaces for efficient training. It suggests that training in smaller subspaces can improve training efficiency, generalization, and robustness. Why it matters: Investigating efficient training methods is crucial for resource-constrained environments and can enable broader access to advanced AI.
Axel Sauer from the University of Tübingen presented research on scaling Generative Adversarial Networks (GANs) using pretrained representations. The work explores shaping GANs into causal structures, training them up to 40 times faster, and achieving state-of-the-art image synthesis. The presentation mentions "Counterfactual Generative Networks", "Projected GANs", "StyleGAN-XL”, and “StyleGAN-T". Why it matters: Scaling GANs and improving their training efficiency is crucial for advancing image and video synthesis, with implications for various applications in computer vision, graphics, and robotics.
MBZUAI researchers presented a new second-order method for optimizing neural networks at NeurIPS 2024. The method addresses optimization problems related to variational inequalities common in machine learning. They demonstrated that for monotone inequalities with inexact second-order derivatives, no faster second- or first-order methods can theoretically exist, supporting this with experiments. Why it matters: This research has the potential to reduce the computational cost of training large and complex neural networks, which could accelerate AI development in the region.
Thamar Solorio of MBZUAI served as general chair of EMNLP 2024, which hosted over 4,000 attendees. MBZUAI researchers presented nearly 50 studies, including one co-authored by Solorio and Monojit Choudhury that received an Outstanding Paper Award. Key themes included cultural awareness, machine-generated content detection, and LLM empathy and cultural representation. Why it matters: MBZUAI's strong presence at EMNLP highlights its growing influence in the international NLP research community and its focus on culturally aware AI.
Justice Connect, an Australian charity, collaborated with MBZUAI's Prof. Timothy Baldwin to improve their legal intake tool using NLP. The tool helps route legal requests, but users struggled to identify the relevant area of law, leading to delays and frustration. By applying NLP, the collaboration aims to help users more easily navigate the tool and access appropriate legal resources. Why it matters: This project demonstrates how NLP can be applied to improve access to justice and address unmet legal needs, particularly for those unfamiliar with legal terminology.
MBZUAI researchers presented a new causal discovery method at NeurIPS that identifies relationships between deterministic and non-deterministic variables. The method builds directed graphs visualizing relationships between variables, incorporating both probabilistic and deterministic principles. The lead author, Longkang Li, aims to apply causal discovery to healthcare and biology for better understanding of diseases. Why it matters: This research advances the field of causal inference, potentially improving applications in areas like healthcare where understanding complex relationships is critical.
MBZUAI researchers presented new resources at EMNLP for improving the factuality of LLMs, including a web application for fact-checking LLM-generated text and benchmarks for evaluating automated fact-checkers. They found that current automated fact-checkers miss nearly 40% of false claims generated by LLMs. The study breaks down the fact-checking process into eight tasks, including decomposition and decontextualization, to identify where systems fail. Why it matters: This work addresses a critical challenge in the deployment of LLMs by providing tools and methods for improving their reliability and trustworthiness, which is essential for widespread adoption in sensitive applications.
Researchers from MBZUAI, University of Washington, and other institutions presented studies at EMNLP 2024 exploring how LLMs represent cultures. A survey analyzed dozens of recent studies on LLMs and culture and proposes a new framework for future research. The survey found that there is no widely accepted definition of 'culture' in NLP, making it challenging to interpret how models represent culture through language. Why it matters: This highlights a key gap in the field and emphasizes the need for a more rigorous and consistent understanding of culture in AI, especially as LLMs become more globally integrated.
Researchers from MBZUAI and Monash University presented a study at EMNLP 2024 examining LLMs' ability to interpret empathy, emotion, and morality in written stories. The study builds on a framework for modeling empathic similarity between narratives, using the EmpathicStories dataset. They are exploring ways to improve LLMs' capabilities with complex concepts like empathy, especially for applications in fields like healthcare. Why it matters: Enhancing LLMs with empathic understanding could lead to more effective and human-centered AI applications, particularly in sensitive domains requiring nuanced communication.
Nutrigenics, an AI startup founded by MBZUAI PhD students, is developing a platform to improve dietetics. The platform features 200,000 tagged recipes and a vision language model (VLM) that analyzes meal photos with 70% accuracy. Nutrigenics aims to bridge the gap between clinical advice and daily eating habits, enabling dieticians to monitor patient progress more effectively. Why it matters: This technology can personalize nutrition at scale in the region and improve adherence to dietary guidelines, addressing a critical need in preventative healthcare.
MBZUAI Professor Timothy Baldwin reflects on his decision to move from the University of Melbourne to help build MBZUAI. He emphasizes the importance of inclusive AI education to ensure the benefits of AI are shared globally. Baldwin notes the concentration of AI innovation in a few countries, leading to disparities in language model performance for non-dominant languages. Why it matters: The article highlights MBZUAI's role in addressing the global imbalance in AI development and promoting inclusivity in AI education and research, particularly for Arabic and other underrepresented languages.
MBZUAI's Eduardo da Veiga Beltrame is developing machine learning tools for analyzing single-cell RNA sequencing data, which measures RNA in thousands of individual cells. Sequencing costs have decreased faster than Moore's Law, enabling large-scale data collection in biology. RNA sequencing provides insights into gene expression and cellular activity, crucial for personalized medicine. Why it matters: Advancements in single-cell RNA sequencing and ML analysis will accelerate personalized medicine by providing detailed insights into cellular mechanisms and disease pathways.
The 31st International Conference on Computational Linguistics (COLING 2025) will be held in Abu Dhabi in January 2025, hosted by Mohamed bin Zayed University of Artificial Intelligence (MBZUAI). COLING is a major biennial NLP and AI conference that brings together leaders from research centers, academia, and industry. The conference will feature keynote talks, presentations, workshops, and tutorials, with 1,500 expected participants. Why it matters: Hosting COLING underscores the UAE's growing role in AI and NLP research and provides a platform to address regional linguistic challenges and advance AI technologies.
MBZUAI will present its latest AI research applications at GITEX 2024, focusing on computer vision, machine learning, NLP, and robotics. The university aims to demonstrate AI's potential in transforming sectors like healthcare, industry, and media, aligning with the UAE’s vision for a knowledge-based economy. MBZUAI will also showcase AI tools designed to combat misinformation and enhance digital media reliability. Why it matters: MBZUAI's presence at GITEX highlights the UAE's commitment to AI innovation and the university's role in developing AI solutions for real-world challenges.
MBZUAI researchers are studying how AI can be used to combat disinformation and improve news verification during elections, as AI amplifies the volume and speed of fake news. Dilshod Azizov is using machine learning to spot patterns in news that will improve verification, while Preslav Nakov's FRAPPE system identifies persuasive techniques and framing in news articles. FRAPPE uses machine learning and NLP to analyze news presentation and reporting, aiming to help users understand the underlying context of news. Why it matters: This research highlights the potential of AI to both negatively and positively impact democratic processes, emphasizing the need for tools to analyze and verify information in the face of increasing AI-generated disinformation.
Researchers from MBZUAI and other institutions presented a study at ACL 2024 on combatting misinformation by identifying misrepresented scientific research. They compiled a dataset called MISSCI, comprised of real-world examples of misinformation gathered from the HealthFeedback fact-checking website. The annotators classified the different types of errors in reasoning into nine different classes. Why it matters: This work addresses a critical need to combat the spread of scientific falsehoods online, especially given the challenges of manual fact-checking.
MBZUAI has placed over 90 master's and PhD students in internships at public, private, and multinational organizations globally. The internships span various AI disciplines, including computer science, CV, ML, NLP, and robotics. Students are undertaking placements at institutions like the Technical University of Darmstadt, Johns Hopkins University, and Microsoft Research Lab – Asia, as well as UAE entities like ADNOC and Dubai Police. Why it matters: This initiative strengthens the UAE's AI ecosystem by providing hands-on experience for students and addressing the growing demand for AI expertise in the region.
MBZUAI researchers presented a study at NAACL 2024 analyzing errors made by open-source LLMs when solving math word problems. The study, led by Ekaterina Kochmar and KV Aditya Srivatsa, investigates characteristics that make math word problems difficult for machines. Llama2-70B was used to test the ability of LLMs to solve these problems, revealing that LLMs can perform math operations correctly but still give the wrong answer. Why it matters: The research aims to improve AI's ability to understand and solve math word problems, potentially leading to better educational applications and teaching methods.
MBZUAI highlighted five Emirati women making contributions in AI, entrepreneurship, and leadership, coinciding with Emirati Women’s Day. Fatima AlKhoori is pursuing a Ph.D. at MBZUAI, researching transformer models for autonomous vehicle traffic sign recognition using UAE and German datasets. Dr. Hanan Aldarmaki, an MBZUAI assistant professor, specializes in Arabic speech and language processing. Why it matters: Showcasing Emirati women in AI underscores the UAE's commitment to gender diversity and national talent development in advanced technology fields.
MBZUAI researchers have expanded LLM safety research to Chinese, presenting their work at the 62nd Annual Meeting of the Association for Computational Linguistics in Bangkok. They developed an open-source Chinese dataset of 3,000 prompts translated and localized from the English "Do-Not-Answer" dataset. The dataset includes a "region-specific sensitivity" category to address unique safety risks for Chinese speakers, evaluating if models are over-sensitive in identifying innocuous questions as harmful. Why it matters: This research addresses a critical gap in LLM safety evaluation, ensuring that language models are both safe and effective for diverse linguistic and cultural contexts, particularly in regions with unique sensitivities.
MBZUAI researchers presented a new uncertainty quantification method at ACL to identify hallucinations in LLMs, called claim conditioned probability (CCP). CCP leverages the internal token probabilities generated by the LLM itself to highlight claims with low confidence. Unlike external fact-checking methods, CCP is computationally efficient as it uses probabilities already computed by the model. Why it matters: This research offers a practical approach to mitigate the impact of LLM hallucinations by highlighting potentially unreliable information, improving the trustworthiness of these models, especially for Arabic LLMs.
MBZUAI and KAUST researchers collaborated to present new optimization methods at ICML 2024 for composite and distributed machine learning settings. The study addresses challenges in training large models due to data size and computational power. Their work focuses on minimizing the "loss function" by adjusting internal trainable parameters, using techniques like gradient clipping. Why it matters: This research contributes to the ongoing advancement of machine learning optimization, crucial for improving the performance and efficiency of AI models in the region and globally.
MBZUAI welcomed 45 international STEM students to its month-long Undergraduate Research Internship Program (UGRIP), a 32% increase from its second year. The program exposes students to AI research and faculty, attracting applicants from universities like IIT Madras, Harvard, and Yale. Interns worked on AI projects including digital healthcare metaverse prototypes, baby cry analysis, and LLM generalizability. Why it matters: This program helps to foster AI talent and promote the UAE as a global hub for AI research.
MBZUAI student Zain Muhammad Mujahid is researching methods to detect media bias using NLP and LLMs. His approach profiles bias across media outlets using LLMs like ChatGPT to predict bias based on 16 identifiers. The research aims to develop a tool that instantly provides a bias profile for a given media URL. Why it matters: This research has the potential to combat misinformation and enhance media literacy in the region by providing tools to identify biased reporting, and it is expanding to Arabic and other languages.
MBZUAI will graduate its first three Ph.D. students on June 6, 2024. Numan Saeed's research focused on using AI and big data to diagnose head and neck cancers using PET and CT scans, aided by NLP to interpret doctors' notes. The graduates will remain in the UAE to contribute to the country's growing AI sector. Why it matters: This milestone highlights the growing AI talent pool in the UAE and the potential for AI research at MBZUAI to address critical healthcare challenges.
MBZUAI's Professor Ted Briscoe is working on an educational technology initiative with IBM to support Arabic literacy in the Gulf by providing personalized feedback on student writing. He is also developing a question-answering system for Abu Dhabi Global Market to help companies understand local regulations. The Q&A system aims to assist smaller companies in establishing offices in Abu Dhabi by providing affordable access to regulatory information. Why it matters: These projects apply NLP to address practical needs in education and business, fostering Arabic literacy and easing regulatory compliance for SMEs in the UAE.
MBZUAI Professor Preslav Nakov is researching methods to identify and combat the harmful uses of large language models in generating disinformation. He notes that disinformation, unlike fake news, is weaponized with the intent to persuade, not just to lie. His research focuses on the linguistic differences between human-written and machine-generated disinformation, such as the use of rhetorical devices in human propaganda. Why it matters: As AI-generated content becomes more prevalent, understanding and mitigating its potential for spreading disinformation is critical for maintaining trust and integrity in information ecosystems, especially during major election cycles.
MBZUAI's Maxim Panov is developing uncertainty quantification methods to improve the reliability of language models. His work focuses on providing insights into the confidence level of machine learning models' predictions, especially in scenarios where accuracy is critical, such as medicine. Panov is working on post-processing techniques that can be applied to already-trained models. Why it matters: This research aims to address the issue of "hallucinations" in language models, enhancing their trustworthiness and applicability in sensitive domains within the region and globally.
The first International Olympiad in AI for high school students will be held in Bulgaria from August 9-15, 2024. Organized by the LERAI Foundation, the competition will test students on machine learning, computer vision, and natural language processing. Sponsors include Google and MBZUAI, with organizers hoping participants pursue further AI education and careers. Why it matters: This event aims to cultivate global AI talent and could increase interest in AI education and careers in the GCC region, particularly at MBZUAI.
LibrAI is an AI startup founded by Xudong Han, a University of Melbourne PhD graduate, in December 2023 after the release of ChatGPT. The company focuses on advancing AI safety and responsible AI practices, building on Han's prior work creating FairLib, an open-source toolkit for fairness in deep neural networks. LibrAI's team of seven aims to create practical solutions ensuring AI is both responsible and revolutionary. Why it matters: The establishment of a startup focused on AI safety highlights growing awareness of ethical considerations in AI development within the region.
MBZUAI adjunct professor Iryna Gurevych was appointed to the German National Academy of Sciences Leopoldina and received the “Social Impact Award” at the 18th Conference of the European Chapter of the Association for Computational Linguistics. The Social Impact Award recognized her study on sociodemographic prompting, a technique that steers prompt-based models towards answers reflecting specific sociodemographic profiles. Gurevych was also named one of the 15 most important women in AI in Germany by Manager Magazin for her work building an AI assistant with Amazon. Why it matters: Recognizing experts at MBZUAI raises the visibility of the university and its contributions to cutting-edge NLP research, particularly in areas like ethical and responsible AI development.
Professor Timothy Baldwin has been appointed as the Provost of Mohamed bin Zayed University of Artificial Intelligence (MBZUAI). He previously served as Department Chair of NLP, Associate Provost for Academic Affairs, and Acting Provost. During his tenure, Baldwin co-led the technical development of Jais, the leading Arabic LLM, and spearheaded initiatives including new academic departments and the Undergraduate Research Internship Program. Why it matters: Baldwin's appointment signals continued investment in AI talent and research at MBZUAI, particularly in Arabic NLP and large language models.
MBZUAI Professor Preslav Nakov has developed FRAPPE, an interactive website that analyzes news articles to identify persuasion techniques. FRAPPE helps users understand framing, persuasion, and propaganda at an aggregate level, across different news outlets and countries. Presented at EACL, FRAPPE uses 23 specific techniques categorized into six broader buckets, such as 'attack on reputation' and 'manipulative wording'. Why it matters: The tool addresses the increasing difficulty in discerning factual information from disinformation, providing a means to identify biases in news media from different countries.
MBZUAI Professor Monojit Choudhury co-authored a study on LLMs and their capacity for moral reasoning, with the study being presented at the 18th Conference of the European Chapter of the Association for Computational Linguistics (EACL) in Malta. The study included contributions from Aditi Khandelwal, Utkarsh Agarwal, and Kumar Tanmay from Microsoft. The research explores AI alignment, ensuring AI systems align with human values, moral principles, and ethical considerations. Why it matters: The study provides insight into LLMs' capabilities regarding complex ethical issues, which is important for guiding the development of AI in a way that is consistent with human values.
MBZUAI Assistant Professor Alham Fikri Aji is presenting research at EACL 2024 on efficient NLP for low-resource languages. The study uses knowledge distillation, transferring knowledge from a larger model (ChatGPT) to a smaller one using synthetic instruction data. The goal is to achieve similar performance with less computational resources, focusing on underrepresented languages. Why it matters: This work addresses the need for more accessible and inclusive NLP technologies, especially for languages lacking extensive datasets and computational resources.
Monojit Choudhury, formerly of Microsoft Research and Project Turing, has joined MBZUAI as a professor of natural language processing. Choudhury's work at Microsoft involved developing NLP applications and responsible AI, including manually programming LLMs to prevent toxic or biased content. He was impressed by GPT-4's capabilities and believes academia is the best place for deep research in NLP. Why it matters: Choudhury's experience at Microsoft, including his work on responsible AI and LLMs, could contribute to MBZUAI's NLP research and the development of more inclusive LLMs.
MBZUAI researcher Karima Kadaoui is using AI to assist disadvantaged communities and languages, with a focus on democratizing NLP tasks for Arabic dialects. Her master's thesis focused on impaired speech recognition, converting disfluencies of individuals with speech disabilities into clear speech. She emphasizes the importance of diversity and inclusion in AI to avoid bias and ensure systems reflect the user distribution. Why it matters: This highlights MBZUAI's commitment to gender equity in STEM and the development of AI solutions tailored to the nuances of the Arabic language.
MBZUAI is highlighting five female leaders in AI for International Women’s Day, noting its 28% female student body. Dr. Farida Al Hosani is developing an AI healthcare solution for non-communicable diseases and was appointed VP of MBZUAI’s Alumni Advisory Board. Dr. Hanan Aldarmaki focuses on improving Arabic automated speech recognition and recently won an award for a paper on Arabic speech processing. Why it matters: Showcasing women in AI leadership helps promote diversity and inclusion in the field, especially in the context of the rapidly growing AI ecosystem in the UAE.
MBZUAI researchers have developed a new approach to enhance the generalizability of vision-language models when processing out-of-distribution data. The study, led by Sheng Zhang and involving multiple MBZUAI professors and researchers, addresses the challenge of AI applications needing to manage unforeseen circumstances. The new method aims to improve how these models, which combine natural language processing and computer vision, handle new information not used during training. Why it matters: Improving the adaptability of vision-language models is critical for real-world AI applications like autonomous driving and medical imaging, especially in diverse and changing environments.
MBZUAI Assistant Professors Bin Gu and Huan Xiong are advancing spiking neural networks (SNNs) to improve computational power and energy efficiency. They will present their latest research on SNNs at the 38th Annual AAAI Conference on Artificial Intelligence in Vancouver. SNNs process information in discrete events, mimicking biological neurons and offering improved energy efficiency compared to traditional neural networks. Why it matters: This research could enable running advanced AI applications like GPTs on mobile devices, unlocking their full potential due to the energy efficiency of SNNs.
MBZUAI hosted the Second Workshop on Collaborative Learning as part of the AI Quorum in Abu Dhabi, focusing on collaborative and federated learning for sustainable development. Researchers discussed applications in medicine, biology, ecological conservation, and humanitarian aid. Eric Xing highlighted the potential of large biology models, similar to LLMs, to revolutionize biological data analysis. Why it matters: This workshop underscores the UAE's commitment to advancing AI research in crucial sectors like healthcare and sustainability through collaborative learning approaches.
MBZUAI researchers presented studies at EMNLP and ArabicNLP conferences on improving NLP for diverse languages, especially Arabic. One study evaluated ChatGPT and GPT-4's performance across Arabic dialects, finding limitations compared to English. GPT-4 showed better performance than GPT-3.5 in Arabic. Why it matters: This research highlights the need for NLP models to better support the linguistic diversity of Arabic and other languages to avoid widening existing technological gaps.
MBZUAI held an appreciation ceremony recognizing over 30 industry partners for their collaboration in building the AI ecosystem in Abu Dhabi. The event included panel discussions on AI's potential in healthcare and sustainability, featuring speakers from Mubadala Healthcare, Sheikh Shakhbout Medical City, and the Department of Health – Abu Dhabi. Faculty discussed advancements in NLP and MBZUAI's role in developing Jais and Jais Climate, along with progress in computer vision and machine learning. Why it matters: This event highlights MBZUAI's commitment to fostering partnerships that advance AI research and applications, particularly in areas crucial to the UAE's strategic priorities like healthcare and climate change.
MBZUAI awarded its first Ph.D. to Numan Saeed for his dissertation, "Deep Learning for Cancer Diagnosis and Prognosis." Saeed's research explores using deep learning models to diagnose tumors and predict survival rates for head and neck cancers by interpreting PET and CT scan imagery and doctor's notes. The AI model considers variables like age, gender, and tumor size to improve diagnosis, especially in regions with limited oncological services. Why it matters: This milestone highlights MBZUAI's growing role in AI research and its potential to contribute to advancements in AI-driven healthcare solutions, particularly for cancer diagnosis and treatment.
ADGM and MBZUAI have signed an MoU to advance AI applications in financial regulatory compliance. The partnership will focus on developing regtech and suptech solutions, including an AI model to extract meaning from financial regulations. A key project is enhancing FSRA’s ‘Risk Analyser’ platform, which uses AI to provide insights on supervised firms. Why it matters: This collaboration signals a push towards AI-driven regulatory innovation in the UAE's financial sector, potentially improving efficiency and compliance.
MBZUAI students won the top three awards at the Alibaba AI Hackathon in Dubai, part of GITEX Global AI InnovateFest. First place went to TalkTrain, a smart business assistant for public speaking practice, developed by Kane Lindsay and Hawau Olamide Toyin. Second place was awarded to Anaaya, a generative AI application for predicting adverse drug interactions, created by Mai A. Shaaban and Anees Ur Rehman Hashmi. Why it matters: This sweep highlights MBZUAI's strength in applied AI research and the potential for its students to create impactful solutions for real-world problems.
MBZUAI faculty won two awards and published eight papers at the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL 2023). Alham Fikri Aji and Fajri Koto won the Best Resource Award for NusaWrites, a paper on constructing high-quality corpora for low-resource Indonesian languages by engaging speaker communities. Muhammad Abdul-Mageed won an Area Chair award for ProMap, a method for constructing bilingual dictionaries via language model prompting. Why it matters: This highlights MBZUAI's contribution to NLP research, particularly in low-resource languages and bilingual lexicon induction, and strengthens its position as a hub for AI research in the region.
A team of MBZUAI graduate students won first place at the UAE University's University Challenge for their SawabAI project, which addresses AI-generated misinformation about climate change. The winning team included Salem Bin Saqer AlMarri, Hanoona Bangalath, and Muhammad Maaz, all Computer Vision Ph.D. students. SawabAI is envisioned as a platform to evaluate the authenticity and source of information, including text, image, and video, to combat fake news. Why it matters: This win highlights the growing importance of AI in addressing misinformation and promoting sustainability in government communication within the region.
MBZUAI researchers presented a new approach to video question answering at ICCV 2023. The method leverages insights from analyzing still images to understand video content, potentially reducing the computational resources needed for training video question answering models. Guangyi Chen, Kun Zhang, and colleagues aim to apply pre-trained image models to understand video concepts. Why it matters: This research could lead to more efficient and accessible video analysis tools, benefiting fields like healthcare and security where video data is abundant.
MBZUAI has been actively involved in developing AI and generative models, contributing to models like Llama 2, Jais, Vicuna, and LaMini. Professor Preslav Nakov notes Llama 2's improvements in size and carbon footprint over Llama 1. MBZUAI aims to tackle challenges like information accuracy, economic costs, and the scarcity of Arabic online content. Why it matters: MBZUAI's work helps address the limitations of current LLMs, particularly for Arabic, and promotes sustainable AI development in the region.