arXiv ·
Researchers at MBZUAI release SlimPajama-DC, an empirical analysis of data combinations for pretraining LLMs using the SlimPajama dataset. The study examines the impact of global vs. local deduplication and the proportions of highly-deduplicated multi-source datasets. Results show that increased data diversity after global deduplication is crucial, with the best configuration outperforming models trained on RedPajama.
MBZUAI ·
This article summarizes a talk by Erci Xu on doing computer systems research, focusing on idea generation and paper writing. Xu shares experiences on developing research ideas and provides a tutorial on academic writing principles. He has published 20 papers in venues like OSDI, FAST, ATC, and Eurosys and received awards including two FAST Best Paper Awards. Why it matters: The talk and summary offer valuable guidance for researchers in the Middle East, particularly those at institutions like MBZUAI, on how to conduct impactful computer systems research and effectively communicate their findings in top-tier academic publications.
TII ·
Researchers from the Directed Energy Research Center (DERC) will present research papers at the 17th Workshop of the International Lithosphere Program Task Force on Sedimentary Basins in Abu Dhabi. Dr. Meixia Geng's study identifies potential geothermal exploration sites in the UAE based on Curie isotherm depths. Dr. Felix Vega's research demonstrates drone-borne synthetic aperture radar (SAR) for subsurface mapping of underground cavities. Why it matters: These studies showcase the UAE's commitment to sustainable development through geothermal energy exploration and advanced subsurface imaging techniques.