Magma: A Foundation Model for Multimodal AI Agents
One model for UI navigation and robot manipulation, pretrained on images, videos and robot data labelled with Set-of-Mark (what to act on) and Trace-of-Mark (how things move); model and code are public.同一个模型同时做界面操作与机器人操作：在图像、视频和机器人数据上预训练，用 Set-of-Mark 标注可操作对象、用 Trace-of-Mark 标注运动轨迹；模型与代码公开。
BibTeX
@misc{yang2025magma,
title = {{Magma: A Foundation Model for Multimodal AI Agents}},
author = {Jianwei Yang and Reuben Tan and Qianhui Wu and Ruijie Zheng and Baolin Peng and Yongyuan Liang and Yu Gu and Mu Cai and Seonghyeon Ye and Joel Jang and Yuquan Deng and Lars Liden and Jianfeng Gao},
year = {2025},
eprint = {2502.13130},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2502.13130},
}