Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Tasks
Learns a compact vision + force/torque representation with self-supervised objectives, then trains a peg-insertion policy with RL on top of it on a real robot.用自监督目标学习视觉 + 力/力矩的紧凑联合表征，再在其上用强化学习在真实机器人上训练插孔策略。
BibTeX
@misc{lee2018making,
title = {{Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Tasks}},
author = {Michelle A. Lee and Yuke Zhu and Krishnan Srinivasan and Parth Shah and Silvio Savarese and Li Fei-Fei and Animesh Garg and Jeannette Bohg},
year = {2018},
eprint = {1810.10191},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/1810.10191},
}Tactile & Visuotactile Sensing触觉与视触觉感知Manipulation & Dexterous Hands操作与灵巧手Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习realvisuotactileforce-torquerepresentationrl