DexForesight: Grounding Dexterous Policies with Implicit Spatial Foresight
Trains a world model of 3D hand-point and scene motion, then aligns policy latents to it; at test time only the RGB policy runs, with no depth or future frames. Reports 49.4% → 60.5% on 11 DexJoCo tasks.先训练预测 3D 手部点与场景变化的世界模型,再把策略潜表示对齐到它;部署时只保留 RGB 策略,无需深度或未来预测。在 11 个 DexJoCo 任务上成功率从 49.4% 提升到 60.5%。
BibTeX
@misc{chen2026dexforesight,
title = {{DexForesight: Grounding Dexterous Policies with Implicit Spatial Foresight}},
author = {Zhongxi Chen and Yi Yang and Xinyi Chen and Mingzhe Ye and Yaping Li and Zhihong Liu and Congsheng Xu and Haonan Wang and Zhijie Deng},
year = {2026},
eprint = {2611.11166},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.11166},
}Manipulation & Dexterous Hands操作与灵巧手World Models世界模型Dexterous hand灵巧手dexterousworld-modelrepresentation-alignmentreal