Search

Results for "Metaphor"

CAMMAR: Culture-Aware Matryoshka for Metaphorical Arabic Representations

arXiv · Jul 17

Researchers introduced CAMMAR (Culture-Aware Matryoshka for Metaphorical Arabic Representations), a framework designed to organize meaning in Arabic language models into nested lexical, cultural, and metaphorical embedding subspaces, addressing the issue of "semantic smearing." The framework, inspired by Al-Jurjani's theory of nazum, provides a training-free geometric measure of metaphoricity. Evaluated on a new span-annotated Arabic metaphor dataset, CAMMAR achieved an AUC of up to 0.84, effectively detecting metaphor when inter-layer geometry was shaped by paired supervision. Why it matters: This research offers a novel approach to enhancing the cultural and metaphorical understanding of Arabic AI, potentially leading to more nuanced and accurate Arabic language models.

Fann or Flop: A Multigenre, Multiera Benchmark for Arabic Poetry Understanding in LLMs

arXiv · May 23

MBZUAI researchers release 'Fann or Flop', a new benchmark for evaluating Arabic poetry understanding in LLMs. The benchmark covers 12 historical eras and 14 poetic genres, assessing semantic understanding, metaphor interpretation, and cultural context. Evaluation of state-of-the-art LLMs reveals challenges in poetic understanding despite strong performance on standard Arabic benchmarks.