VideoMathQA: Benchmarking Mathematical Reasoning via Multimodal Understanding in Videos
arXiv · · Significant research
Summary
MBZUAI researchers introduce VideoMathQA, a new benchmark for evaluating mathematical reasoning in videos, requiring models to interpret visual information, text, and spoken cues. The dataset spans 10 mathematical domains with videos ranging from 10 seconds to over 1 hour, and includes multi-step reasoning annotations. The benchmark aims to evaluate temporal cross-modal reasoning and highlights the limitations of existing approaches in complex video-based mathematical problem solving.
Keywords
VideoMathQA · benchmark · mathematical reasoning · multimodal · cross-modal reasoning
Get the weekly digest
Top AI stories from the GCC region, every week.