MMMG: A Comprehensive and Reliable Evaluation Suite for Multitask Multimodal Generation
May 20, 2025·,,,,,
,,,·
1 min read
Jihan Yao
Yuxuan Hu
Yichen Yi
Bin Han
Sheng Shen Feng
Guande Yang
Bingbing Wen
Ranjay Krishna
Lucy Lu Wang
Others
Abstract
We present MMMG, a comprehensive and reliable evaluation suite for multitask multimodal generation that covers diverse tasks and modalities to better assess the capabilities of large multimodal models.
Type
Publication
arXiv preprint
MMMG is an evaluation suite for multitask multimodal generation, enabling more reliable assessment of large multimodal models across a wide range of generation tasks and modalities.
