MDF++: Visuo-Tactile World Action Model with End-to-end Representation Learning
Learns visuo-tactile latents end-to-end inside a diffusion world-action model not frozen encoders; multi-task cross-modal losses avoid feature collapse. Reports up to 50% gains on real bolt screwing and nut mating.在扩散式世界-动作模型中端到端学习视触觉潜表示，而非使用冻结的预训练编码器；借助跨模态多任务学习避免特征坍缩。在真实拧螺栓、螺母配合等任务上报告最高 50% 的提升。
BibTeX
@misc{huang2026mdf,
title = {{MDF++: Visuo-Tactile World Action Model with End-to-end Representation Learning}},
author = {Zixuan Huang and Jinhao Yu and Zachary Charlick and Dmitry Berenson},
year = {2026},
eprint = {2611.09293},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.09293},
}Tactile & Visuotactile Sensing触觉与视触觉感知World Models世界模型Manipulation & Dexterous Hands操作与灵巧手world-action-modeldiffusionvisuo-tactilereal