📡 Embodied AI Radar具身智能雷达 Star3

Most of this project is curated by Claude. Drop a star to cheer Claude on!本项目大量由 Claude 整理维护,点个 Star 给克劳德大小姐鼓励一下!

★ Feed a star投喂 Star

Embodied AI Radar: the map of embodied AI & robot learning具身智能雷达:具身智能与机器人学习全景图

1361curated精选条目
613new arXiv papers this week本周新 arXiv 论文
2026-11-10latest intake最近收录
Paper论文 2026 NeurIPS 2026 new新 2026-11-10

Spatial Representation Distillation and Knowledge Routing for Vision-Language-Action Models

SPARK-VLA distils a frozen 3D expert into a LoRA visual branch beside the original one, and a small router passes only action-relevant tokens to a 0.5B LLM. No 3D input at inference; ~53M trainable parameters.SPARK-VLA 把冻结的 3D 专家蒸馏到与原视觉通路并行的 LoRA 分支,并用轻量路由器只把与动作相关的视觉 token 送入 0.5B 语言模型。推理时无需 3D 输入,可训练参数约 5300 万。

BibTeX
@misc{park2026spatial,
  title = {{Spatial Representation Distillation and Knowledge Routing for Vision-Language-Action Models}},
  author = {Jungin Park and Chaoran Zhu and Changjae Oh and Kwanghoon Sohn},
  year = {2026},
  eprint = {2611.10443},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.10443},
}
VLA & Robot Foundation ModelsVLA 与机器人基础模型3d-awaredistillationloratoken-routinglibero
Paper论文 2026 new新 2026-11-10

SimDuoReal: Object-Centric Bimanual Policy for Emergent Dexterity

One shared object-pose reward, varied training scenes: RL experts discover regrasping, in-hand adjustment and handover on their own, then distil into one policy. Reports 61 of 80 real trials with unseen objects.只用统一的物体位姿奖励并变换训练环境,强化学习专家自行学会重抓、手内调整与双手交接,再蒸馏成单一策略。报告在未见物体上真实实验 80 次成功 61 次。

BibTeX
@misc{yan2026simduoreal,
  title = {{SimDuoReal: Object-Centric Bimanual Policy for Emergent Dexterity}},
  author = {Qiyang Yan and Yulin Liu and Akash Sharma and Haozhi Qi and Guanya Shi and C. Karen Liu},
  year = {2026},
  eprint = {2611.10410},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.10410},
}
Manipulation & Dexterous Hands操作与灵巧手Robot Learning: RL & Imitation机器人学习:强化学习与模仿学习Robot arm机械臂Dexterous hand灵巧手bimanualdexterousrlsim-to-realhandoverdistillation
Paper论文 2026 new新 2026-11-10

DexForesight: Grounding Dexterous Policies with Implicit Spatial Foresight

Trains a world model of 3D hand-point and scene motion, then aligns policy latents to it; at test time only the RGB policy runs, with no depth or future frames. Reports 49.4% → 60.5% on 11 DexJoCo tasks.先训练预测 3D 手部点与场景变化的世界模型,再把策略潜表示对齐到它;部署时只保留 RGB 策略,无需深度或未来预测。在 11 个 DexJoCo 任务上成功率从 49.4% 提升到 60.5%。

BibTeX
@misc{chen2026dexforesight,
  title = {{DexForesight: Grounding Dexterous Policies with Implicit Spatial Foresight}},
  author = {Zhongxi Chen and Yi Yang and Xinyi Chen and Mingzhe Ye and Yaping Li and Zhihong Liu and Congsheng Xu and Haonan Wang and Zhijie Deng},
  year = {2026},
  eprint = {2611.11166},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.11166},
}
Manipulation & Dexterous Hands操作与灵巧手World Models世界模型Dexterous hand灵巧手dexterousworld-modelrepresentation-alignmentreal
Paper论文 2026 · National University of Singapore new新 2026-11-10

ObjectWorld: Scaling Object-Centric World Models with A Large-Scale 3D Full-Object Flow Dataset

Represents object motion as dense 3D trajectories over the whole surface, occluded parts included, for rigid and deformable objects. Adds a 1,210-hour flow dataset and a world model predicting it from image + task.把物体运动表示为覆盖整个表面(含遮挡部分)的稠密 3D 轨迹,适用于刚体与可形变物体。发布 1210 小时的全物体流数据集,并训练从图像和任务描述预测该流的世界模型。

BibTeX
@misc{chen2026objectworld,
  title = {{ObjectWorld: Scaling Object-Centric World Models with A Large-Scale 3D Full-Object Flow Dataset}},
  author = {Haonan Chen and Sicheng Isabella Lu and Haitian Li and Jiajin Wu and Hexiang Wei and Jiawei Zhang and Xin Fei and Yiwen Hou and Chenrui Tie and Chongkai Gao and Sheng Wang and Lin Shao},
  year = {2026},
  eprint = {2611.11085},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.11085},
}
Paper论文 2026 · UCLA new新 2026-11-10

CPNav: Calibrated Vision-Language Navigation for Object-Goal Search in Unseen Environments

Wraps VLM action scores for object-goal search in a conformal prediction layer with a user-set risk level, plus collision-free primitives and backtracking. Reports gains on HM3D/MP3D and on a small real robot.为目标物体搜索中的 VLM 动作打分加上共形预测校准层(风险水平可设定),结合无碰撞运动基元与回溯探索。在 HM3D/MP3D 及小型真实机器人上报告提升。

BibTeX
@misc{chen2026cpnav,
  title = {{CPNav: Calibrated Vision-Language Navigation for Object-Goal Search in Unseen Environments}},
  author = {Qizhao Chen and Yuanhong Zeng and Shoh Nishino and Anushri Dixit},
  year = {2026},
  eprint = {2611.10366},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.10366},
}
Navigation & Embodied Agents导航与具身智能体object-goal-navigationvlmconformal-predictionreal
Paper论文 2026 new新 2026-11-10

MOSU2: Long-range Navigation System with Multi-modal Scene Understanding

Outdoor long-range navigation where a VLM first reasons on context and only pulls in geometry and motion cues when an interaction stays unclear. Reports real-world success up from 61.8% to 94.2% over MOSU.户外长距离导航:VLM 先基于场景上下文推理,只有交互情形仍不明确时才调取几何与运动信息。真实实验中导航成功率相对前作 MOSU 从 61.8% 提升到 94.2%。

BibTeX
@misc{liang2026mosu,
  title = {{MOSU2: Long-range Navigation System with Multi-modal Scene Understanding}},
  author = {Jing Liang and Zhenyu Hou and Senthurbavan Kirubaharan and Md Safwan Mondal and Ashok Gudivada and Xuesu Xiao and Dinesh Manocha},
  year = {2026},
  eprint = {2611.11148},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.11148},
}
Navigation & Embodied Agents导航与具身智能体outdoor-navigationvlmsocial-navigationtraversabilityreal

Topics主题

VLA & Robot Foundation ModelsVLA 与机器人基础模型

Vision-language-action models and generalist robot policies.视觉-语言-动作模型与通用机器人策略。

327 curated精选 · 81 new this week本周新增

Manipulation & Dexterous Hands操作与灵巧手

Imitation learning, diffusion policies, grasping, bimanual and dexterous manipulation.模仿学习、扩散策略、抓取、双臂与灵巧操作。

354 curated精选 · 125 new this week本周新增

Tactile & Visuotactile Sensing触觉与视触觉感知

Tactile sensors, touch representations and contact-rich control.触觉传感器、触觉表征与接触丰富的控制。

93 curated精选 · 34 new this week本周新增

Locomotion & Humanoids运动控制与人形机器人

Legged locomotion, humanoid whole-body control and parkour.足式运动、人形全身控制与跑酷。

212 curated精选 · 52 new this week本周新增

World Models世界模型

Learned dynamics, video world models, world action models (WAM) and model-based RL for embodied agents.学习的动力学模型、视频世界模型、世界动作模型(WAM)与基于模型的强化学习。

159 curated精选 · 49 new this week本周新增

Navigation & Embodied Agents导航与具身智能体

Vision-language navigation, embodied question answering, mobile manipulation and LLM planners.视觉语言导航、具身问答、移动操作与大模型规划。

109 curated精选 · 44 new this week本周新增

Perception, SLAM & 3D Mapping感知、SLAM 与三维建图

Visual / LiDAR SLAM and odometry, 3D reconstruction, object pose, depth and open-vocabulary scene maps for robots.视觉/激光 SLAM 与里程计、三维重建、物体位姿、深度估计与开放词汇场景地图。

79 curated精选 · 43 new this week本周新增

Planning, Control & Safety规划、控制与安全

Motion planning, trajectory optimization, MPC, safety filters and safe learning-based control.运动规划、轨迹优化、模型预测控制、安全滤波器与安全的学习型控制。

74 curated精选 · 36 new this week本周新增

Robot Learning: RL & Imitation机器人学习:强化学习与模仿学习

Reinforcement learning, imitation learning and policy post-training methods for robots, on any embodiment.面向机器人的强化学习、模仿学习与策略后训练方法,不限机器人形态。

219 curated精选 · 72 new this week本周新增

Sim-to-Real & Simulators仿真与 Sim-to-Real

Physics simulators, GPU-parallel training and transfer to real robots.物理仿真器、GPU 并行训练与向真实机器人迁移。

104 curated精选 · 20 new this week本周新增

Datasets & Benchmarks数据集与基准

Large robot datasets, egocentric data and evaluation suites.大规模机器人数据集、第一视角数据与评测基准。

158 curated精选 · 47 new this week本周新增

Hardware & Open-Source Robots硬件与开源机器人

Low-cost arms, hands, grippers and data-collection rigs you can build.可自行搭建的低成本机械臂、灵巧手、夹爪与数据采集设备。

70 curated精选 · 13 new this week本周新增

By robot type:按机器人形态: Robot arm机械臂 · Dexterous hand灵巧手 · Humanoid人形 · Quadruped / legged四足 / 足式 · Mobile robot移动机器人 · Drone / aerial无人机 · Autonomous driving自动驾驶 · Underwater / marine水下 / 海洋

Accepted at:会议/期刊录用: NeurIPS 2026 (54) · IROS 2026 (353) · WACV 2027 (14) · CoRL 2026 (579) · Humanoids 2026 (9) · RA-L 2026 (3) · All venues →全部 →

By lab:按机构: NVIDIA英伟达 · UC Berkeley加州大学伯克利分校 · Stanford斯坦福大学 · Google DeepMind / Google谷歌 DeepMind / 谷歌 · Meta AI (FAIR)Meta AI(FAIR) · Carnegie Mellon University卡内基梅隆大学 · MIT麻省理工学院 · Shanghai Jiao Tong University上海交通大学 · Shanghai AI Lab (InternRobotics)上海人工智能实验室(InternRobotics) · Tsinghua University清华大学 · All labs →全部机构 →

Editor's picks: ★★★ must-read and ★★ highly recommended编辑推荐:★★★ 必读 · ★★ 强烈推荐

Paper论文 2023 · NVIDIA ★★★

cuRobo: Parallelized Collision-Free Minimum-Jerk Robot Motion Generation

GPU-parallel motion generation for arms — many trajectory optimizations run at once, giving collision-free, smooth plans in milliseconds.面向机械臂的 GPU 并行运动生成:同时运行大量轨迹优化,在毫秒级给出无碰撞且平滑的轨迹。

BibTeX
@misc{sundaralingam2023curobo,
  title = {{cuRobo: Parallelized Collision-Free Minimum-Jerk Robot Motion Generation}},
  author = {Balakumar Sundaralingam and Siva Kumar Sastry Hari and Adam Fishman and Caelan Garrett and Karl Van Wyk and Valts Blukis and Alexander Millane and Helen Oleynikova and Ankur Handa and Fabio Ramos and Nathan Ratliff and Dieter Fox},
  year = {2023},
  eprint = {2310.17274},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2310.17274},
}
Dataset数据集 2023 · Open X-Embodiment Collaboration ★★★

Open X-Embodiment: Robotic Learning Datasets and RT-X Models

1M+ trajectories from 22 robot types pooled by 30+ labs; RT-X models trained on it beat single-robot baselines.30 多个实验室汇集 22 种机器人的 100 多万条轨迹;在其上训练的 RT-X 优于单机器人基线。

BibTeX
@misc{collaboration2023open,
  title = {{Open X-Embodiment: Robotic Learning Datasets and RT-X Models}},
  author = {Open X-Embodiment Collaboration and Abby O'Neill and Abdul Rehman and Abhinav Gupta and Abhiram Maddukuri and Abhishek Gupta and Abhishek Padalkar and Abraham Lee and Acorn Pooley and Agrim Gupta and Ajay Mandlekar and Ajinkya Jain and Albert Tung and Alex Bewley and Alex Herzog and Alex Irpan and Alexander Khazatsky and Anant Rai and Anchit Gupta and Andrew Wang and Andrey Kolobov and Anikait Singh and Animesh Garg and Aniruddha Kembhavi and Annie Xie and Anthony Brohan and Antonin Raffin and Archit Sharma and Arefeh Yavary and Arhan Jain and Ashwin Balakrishna and Ayzaan Wahid and Ben Burgess-Limerick and Beomjoon Kim and Bernhard Schölkopf and Blake Wulfe and Brian Ichter and Cewu Lu and Charles Xu and Charlotte Le and Chelsea Finn and Chen Wang and Chenfeng Xu and Cheng Chi and Chenguang Huang and Christine Chan and Christopher Agia and Chuer Pan and Chuyuan Fu and Coline Devin and others},
  year = {2023},
  eprint = {2310.08864},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2310.08864},
}
Hardware硬件 2023 · CMU ★★★

LEAP Hand: Low-Cost, Efficient, and Anthropomorphic Hand for Robot Learning

A 16-DoF dexterous hand buildable for about $2,000 from off-the-shelf parts.16 自由度灵巧手,用现成零件约 2000 美元即可搭建。

BibTeX
@misc{shaw2023leap,
  title = {{LEAP Hand: Low-Cost, Efficient, and Anthropomorphic Hand for Robot Learning}},
  author = {Kenneth Shaw and Ananye Agarwal and Deepak Pathak},
  year = {2023},
  eprint = {2309.06440},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2309.06440},
}
Paper论文 2017 · OpenAI ★★★

Proximal Policy Optimization Algorithms

The clipped policy-gradient method behind most GPU-parallel sim-to-real locomotion and dexterity training.采用截断目标的策略梯度方法,是大多数 GPU 并行仿真训练(运动控制、灵巧操作)背后的算法。

BibTeX
@misc{schulman2017proximal,
  title = {{Proximal Policy Optimization Algorithms}},
  author = {John Schulman and Filip Wolski and Prafulla Dhariwal and Alec Radford and Oleg Klimov},
  year = {2017},
  eprint = {1707.06347},
  archivePrefix = {arXiv},
  primaryClass = {cs.LG},
  url = {https://arxiv.org/abs/1707.06347},
}
Paper论文 2021 · ETH Zurich, NVIDIA ★★★

Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning

Thousands of parallel GPU environments train a quadruped walking policy in minutes; legged_gym became a standard starter.数千个 GPU 并行环境几分钟就能训练出四足行走策略;legged_gym 成为标准入门框架。

BibTeX
@misc{rudin2021learning,
  title = {{Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning}},
  author = {Nikita Rudin and David Hoeller and Philipp Reist and Marco Hutter},
  year = {2021},
  eprint = {2109.11978},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2109.11978},
}
Paper论文 2023 · Columbia, TRI, MIT ★★★

Diffusion Policy: Visuomotor Policy Learning via Action Diffusion

Generating action sequences by denoising handles multimodal demos far better than regression; now a standard IL baseline.以去噪方式生成动作序列,比回归更能处理多模态演示,已成为模仿学习标准基线。

BibTeX
@misc{chi2023diffusion,
  title = {{Diffusion Policy: Visuomotor Policy Learning via Action Diffusion}},
  author = {Cheng Chi and Zhenjia Xu and Siyuan Feng and Eric Cousineau and Yilun Du and Benjamin Burchfiel and Russ Tedrake and Shuran Song},
  year = {2023},
  eprint = {2303.04137},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2303.04137},
}
Paper论文 2022 · Google ★★★

Do As I Can, Not As I Say: Grounding Language in Robotic Affordances

SayCan — an LLM proposes steps and learned value functions score what the robot can actually do right now.SayCan:大模型提出步骤,学习到的价值函数评估机器人当下实际能做什么。

BibTeX
@misc{ahn2022do,
  title = {{Do As I Can, Not As I Say: Grounding Language in Robotic Affordances}},
  author = {Michael Ahn and Anthony Brohan and Noah Brown and Yevgen Chebotar and Omar Cortes and Byron David and Chelsea Finn and Chuyuan Fu and Keerthana Gopalakrishnan and Karol Hausman and Alex Herzog and Daniel Ho and Jasmine Hsu and Julian Ibarz and Brian Ichter and Alex Irpan and Eric Jang and Rosario Jauregui Ruano and Kyle Jeffrey and Sally Jesmonth and Nikhil J Joshi and Ryan Julian and Dmitry Kalashnikov and Yuheng Kuang and Kuang-Huei Lee and Sergey Levine and Yao Lu and Linda Luu and Carolina Parada and Peter Pastor and Jornell Quiambao and Kanishka Rao and Jarek Rettinghouse and Diego Reyes and Pierre Sermanet and Nicolas Sievers and Clayton Tan and Alexander Toshev and Vincent Vanhoucke and Fei Xia and Ted Xiao and Peng Xu and Sichun Xu and Mengyuan Yan and Andy Zeng},
  year = {2022},
  eprint = {2204.01691},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2204.01691},
}
Paper论文 2020 · Universidad de Zaragoza ★★★

ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM

The go-to feature-based SLAM library — monocular, stereo and RGB-D, with IMU fusion and multi-map relocalization.最常用的特征点 SLAM 库:支持单目、双目与 RGB-D,可融合 IMU,并支持多地图重定位。

BibTeX
@misc{campos2020orb,
  title = {{ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM}},
  author = {Carlos Campos and Richard Elvira and Juan J. Gómez Rodríguez and José M. M. Montiel and Juan D. Tardós},
  year = {2020},
  eprint = {2007.11898},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2007.11898},
}
Paper论文 2020 · Meta AI ★★★

DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulation

An inexpensive, compact GelSight-style fingertip sensor that made vision-based touch widely accessible.低成本、紧凑的 GelSight 式指尖传感器,让视触觉传感器得以普及。

BibTeX
@misc{lambeta2020digit,
  title = {{DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulation}},
  author = {Mike Lambeta and Po-Wei Chou and Stephen Tian and Brian Yang and Benjamin Maloon and Victoria Rose Most and Dave Stroud and Raymond Santos and Ahmad Byagowi and Gregg Kammerer and Dinesh Jayaraman and Roberto Calandra},
  year = {2020},
  eprint = {2005.14679},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2005.14679},
}
Paper论文 2024 · Physical Intelligence ★★★

π0: A Vision-Language-Action Flow Model for General Robot Control

A VLM backbone with a flow-matching action expert, trained across many robots, doing long dexterous tasks like laundry folding.VLM 主干加流匹配动作专家,跨多种机器人训练,能完成叠衣服等长时程灵巧任务。

BibTeX
@misc{black2024vision,
  title = {{$π_0$: A Vision-Language-Action Flow Model for General Robot Control}},
  author = {Kevin Black and Noah Brown and Danny Driess and Adnan Esmail and Michael Equi and Chelsea Finn and Niccolo Fusai and Lachy Groom and Karol Hausman and Brian Ichter and Szymon Jakubczak and Tim Jones and Liyiming Ke and Sergey Levine and Adrian Li-Bell and Mohith Mothukuri and Suraj Nair and Karl Pertsch and Lucy Xiaoyang Shi and James Tanner and Quan Vuong and Anna Walling and Haohuan Wang and Ury Zhilinsky},
  year = {2024},
  eprint = {2410.24164},
  archivePrefix = {arXiv},
  primaryClass = {cs.LG},
  url = {https://arxiv.org/abs/2410.24164},
}
VLA & Robot Foundation ModelsVLA 与机器人基础模型Robot arm机械臂Dexterous hand灵巧手realarmbimanualflow-matchingcross-embodimentopen-weights
Paper论文 2023 · Google DeepMind ★★★

Mastering Diverse Domains through World Models

DreamerV3 — one set of hyperparameters works across 150+ tasks, including collecting diamonds in Minecraft from scratch.DreamerV3:一套超参数适用于 150 多个任务,包括从零开始在《我的世界》中挖到钻石。

BibTeX
@misc{hafner2023mastering,
  title = {{Mastering Diverse Domains through World Models}},
  author = {Danijar Hafner and Jurgis Pasukonis and Jimmy Ba and Timothy Lillicrap},
  year = {2023},
  eprint = {2301.04104},
  archivePrefix = {arXiv},
  primaryClass = {cs.AI},
  url = {https://arxiv.org/abs/2301.04104},
}
World Models世界模型simmodel-based-rl
Benchmark基准 2023 · UT Austin ★★

LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning

130 language-conditioned tasks in four suites; now the most common simulation benchmark for VLA papers.四个套件共 130 个语言条件任务,现已成为 VLA 论文最常用的仿真基准。

BibTeX
@misc{liu2023libero,
  title = {{LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning}},
  author = {Bo Liu and Yifeng Zhu and Chongkai Gao and Yihao Feng and Qiang Liu and Yuke Zhu and Peter Stone},
  year = {2023},
  eprint = {2306.03310},
  archivePrefix = {arXiv},
  primaryClass = {cs.AI},
  url = {https://arxiv.org/abs/2306.03310},
}
Datasets & Benchmarks数据集与基准simmanipulationlifelong-learning
Paper论文 2026 ★★ new新 2026-11-03

Pixel: A Co-Designed Full-Stack Robot System for Learning General-Purpose Mobile Manipulation

Hardware, data and learning designed together: a low-cost wheeled humanoid with compliant grippers, teleoperation and robot-free human data collection, one whole-body controller and a shared policy pipeline.把硬件、数据和学习放在一起设计:低成本轮式人形、柔顺夹爪,遥操作与免机器人的人类数据采集,统一的全身控制器,以及人类与机器人示范共用的策略学习流程。

BibTeX
@misc{tao2026pixel,
  title = {{Pixel: A Co-Designed Full-Stack Robot System for Learning General-Purpose Mobile Manipulation}},
  author = {Tony Tao and Jason Jingzhou Liu and Ruslan Salakhutdinov and Deepak Pathak},
  year = {2026},
  eprint = {2611.03648},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.03648},
}
Hardware & Open-Source Robots硬件与开源机器人Manipulation & Dexterous Hands操作与灵巧手Humanoid人形Mobile robot移动机器人mobile-manipulationwheeled-humanoidlow-costteleoperationreal
Paper论文 2024 · UC Berkeley ★★

Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learning

HIL-SERL — real-world RL with human corrections, reported to reach near-perfect success on precise assembly and dynamic tasks after a few hours of training.HIL-SERL:结合人类纠正的真机强化学习,报告称在精密装配与动态任务上经数小时训练即可接近满分成功率。

BibTeX
@misc{luo2024precise,
  title = {{Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learning}},
  author = {Jianlan Luo and Charles Xu and Jeffrey Wu and Sergey Levine},
  year = {2024},
  eprint = {2410.21845},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2410.21845},
}
Paper论文 2026 · Apple ★★ new新 2026-11-05

Perceptive Humanoid Motion from Simulation

HALO trains humanoid skills on vision-language-motion data synthesised in a thousand procedural homes, so data scales with compute. Reports zero-shot transfer: 91% over 360 trials in six real environments.HALO 在上千个程序化生成的家庭场景中合成视觉-语言-动作数据来训练人形技能,数据量随算力增长。报告零微调迁移:六个未建图真实环境的 360 次试验成功率 91%。

BibTeX
@misc{hu2026perceptive,
  title = {{Perceptive Humanoid Motion from Simulation}},
  author = {Siyuan Hu and Abulikemu Abuduweili and Yue Meng and Shipeng Liu and Quentin Leboutet and Chen Chen and Matthias Müller and Vladlen Koltun},
  year = {2026},
  eprint = {2611.06908},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.06908},
}
Paper论文 2025 · UC Berkeley, Stanford ★★

BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion

One motion-tracking recipe with shared hyperparameters learns agile skills (cartwheels, flip-kicks); a guided latent diffusion model composes them for new goals like joystick control, zero-shot on hardware.用同一套超参数的运动跟踪方案学会侧手翻、飞踢、冲刺等敏捷技能,再用带引导的潜空间扩散模型组合这些技能以完成摇杆遥控、避障等新目标,零样本迁移到真机。

BibTeX
@misc{liao2025beyondmimic,
  title = {{BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion}},
  author = {Qiayuan Liao and Takara E. Truong and Xiaoyu Huang and Yuman Gao and Guy Tevet and Koushil Sreenath and C. Karen Liu},
  year = {2025},
  eprint = {2508.08241},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2508.08241},
}
Locomotion & Humanoids运动控制与人形机器人Humanoid人形sim2realhumanoidmotion-trackingdiffusionwhole-body
Paper论文 2025 · NVIDIA ★★ new新 2026-11-04

SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control

Tests scaling on humanoid control: more network, data and compute yield a generalist motion-tracking foundation model, with no manual reward engineering.检验规模定律在人形控制上的效果:扩大网络、数据和算力,得到通用动作跟踪基础模型,无需手工设计奖励。

BibTeX
@misc{luo2025sonic,
  title = {{SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control}},
  author = {Zhengyi Luo and Ye Yuan and Tingwu Wang and Chenran Li and Fernando Castañeda and Sirui Chen and Zi-Ang Cao and Jiefeng Li and David Minor and Qingwei Ben and Jinhyung Park and David Sami and Zi Wang and Xingye Da and Runyu Ding and Cyrus Hogg and Lina Song and Edy Lim and Eugene Jeong and Tairan He and Haoru Xue and Wenli Xiao and Simon Yuen and Jan Kautz and Yan Chang and Umar Iqbal and Linxi "Jim" Fan and Yuke Zhu},
  year = {2025},
  eprint = {2511.07820},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2511.07820},
}
Paper论文 2023 · UC Berkeley ★★

Real-World Humanoid Locomotion with Reinforcement Learning

A causal Transformer policy trained in simulation walks a full-size humanoid outdoors, zero-shot.在仿真中训练的因果 Transformer 策略零样本驱动全尺寸人形机器人在户外行走。

BibTeX
@misc{radosavovic2023real,
  title = {{Real-World Humanoid Locomotion with Reinforcement Learning}},
  author = {Ilija Radosavovic and Tete Xiao and Bike Zhang and Trevor Darrell and Jitendra Malik and Koushil Sreenath},
  year = {2023},
  eprint = {2303.03381},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2303.03381},
}
Locomotion & Humanoids运动控制与人形机器人Humanoid人形sim2realhumanoidrltransformer
Paper论文 2018 · UC Berkeley SIGGRAPH 2018 ★★ new新 2026-11-04

DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills

Showed RL can imitate a wide range of motion clips, flips and spins included, while staying robust. The motion-imitation template much humanoid work builds on.证明强化学习能模仿包括空翻在内的大量动作片段并保持鲁棒,是后续人形动作模仿工作的基本范式。

BibTeX
@misc{peng2018deepmimic,
  title = {{DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills}},
  author = {Xue Bin Peng and Pieter Abbeel and Sergey Levine and Michiel van de Panne},
  year = {2018},
  eprint = {1804.02717},
  archivePrefix = {arXiv},
  primaryClass = {cs.GR},
  url = {https://arxiv.org/abs/1804.02717},
}
Paper论文 2026 · AIRoA ★★ new新 2026-11-04

AIRoA-0: Long-Horizon, Precise, Cross-Embodiment Manipulation from Handheld Data

Learned from 16,151 hours of handheld gripper demos with no robot data; reports 78% average success over ten tasks versus 27% for the best other VLA, and releases the dataset, weights and post-training recipe.从 16,151 小时手持夹爪演示中学习,全程不采机器人数据;报告十项任务平均成功率 78%,其他 VLA 最好为 27%,并开放数据集、权重和后训练方案。

BibTeX
@misc{wu2026airoa,
  title = {{AIRoA-0: Long-Horizon, Precise, Cross-Embodiment Manipulation from Handheld Data}},
  author = {Yueh-Hua Wu and Kei Ota and Hanlong Li and Hayata Yuasa and Jason Wang and Kengo Ikeuchi and Kensuke Chiyoma and Makoto Sugiura and Masafumi Takahashi and Masatoshi Tateno and Naoaki Kanazawa and Nicola Scianca and Petr Khrapchenkov and Satoshi Otsubo and Takehiko Ohkawa and Takuya Okubo and Tatsuya Matsushima and Yuki Noguchi and Yuma Shin and Zixuan Zhong},
  year = {2026},
  eprint = {2611.03815},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.03815},
}
Paper论文 2024 · Stanford, Columbia, TRI ★★

Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots

A handheld gripper with a GoPro collects demos anywhere; policies transfer directly to robot arms.手持夹爪加 GoPro 可随处采集演示,训练出的策略可直接迁移到机械臂。

BibTeX
@misc{chi2024universal,
  title = {{Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots}},
  author = {Cheng Chi and Zhenjia Xu and Chuer Pan and Eric Cousineau and Benjamin Burchfiel and Siyuan Feng and Russ Tedrake and Shuran Song},
  year = {2024},
  eprint = {2402.10329},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2402.10329},
}
Paper论文 2024 · Stanford ★★ new新 2026-11-04

Generalizable Humanoid Manipulation with 3D Diffusion Policies

iDP3: whole-upper-body teleop, a 25-DoF humanoid with 3D LiDAR, and an improved 3D Diffusion Policy for noisy human data, aiming at skills beyond a single scene.iDP3:上半身全身遥操作、带三维激光雷达的 25 自由度人形,加上改进的三维扩散策略,使技能不再局限于单一场景。

BibTeX
@misc{ze2024generalizable,
  title = {{Generalizable Humanoid Manipulation with 3D Diffusion Policies}},
  author = {Yanjie Ze and Zixuan Chen and Wenhao Wang and Tianyi Chen and Xialin He and Ying Yuan and Xue Bin Peng and Jiajun Wu},
  year = {2024},
  eprint = {2410.10803},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2410.10803},
}
Paper论文 2023 · Stanford ★★

Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware

ALOHA + ACT — a ~$20k bimanual teleop rig and an action-chunking Transformer that learns precise tasks from ~50 demos.ALOHA + ACT:约 2 万美元的双臂遥操作平台,加上动作分块 Transformer,约 50 条演示即可学会精细任务。

BibTeX
@misc{zhao2023learning,
  title = {{Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware}},
  author = {Tony Z. Zhao and Vikash Kumar and Sergey Levine and Chelsea Finn},
  year = {2023},
  eprint = {2304.13705},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2304.13705},
}
Paper论文 2023 · Meta AI ICCV 2023 ★★

Segment Anything

SAM — a promptable segmentation model (points, boxes, masks) trained on 1B+ masks; a standard building block for object masks in robot perception pipelines.SAM:可用点、框、掩码提示的分割模型,在 10 亿级掩码上训练;已成为机器人感知流程中获取物体掩码的常用基础组件。

BibTeX
@misc{kirillov2023segment,
  title = {{Segment Anything}},
  author = {Alexander Kirillov and Eric Mintun and Nikhila Ravi and Hanzi Mao and Chloe Rolland and Laura Gustafson and Tete Xiao and Spencer Whitehead and Alexander C. Berg and Wan-Yen Lo and Piotr Dollár and Ross Girshick},
  year = {2023},
  eprint = {2304.02643},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/2304.02643},
}
Paper论文 2026 ★★ new新 2026-11-02

When the Simulator Fails, Not the Policy: Auditing Contact Artifacts in Simulated Robot Benchmarks

Many benchmark 'policy failures' are physics-engine ejections. SimuGuard traced RoboTwin artifacts to one collision constant; changing it cut artifact episodes from 12/100 to none and lifted five tasks 89% → 98%.审计仿真基准:不少“策略失败”其实是物理引擎把物体弹飞。SimuGuard 为 LIBERO、RoboTwin、RoboCasa、RoboDojo 提供审计插件,把 RoboTwin 上的问题追溯到碰撞检测的一个常量;仅改动它,异常回合由 100 回合 12 次降到 0,五个容器任务成功率由 89% 升到 98%。

BibTeX
@misc{zhou2026when,
  title = {{When the Simulator Fails, Not the Policy: Auditing Contact Artifacts in Simulated Robot Benchmarks}},
  author = {Alex Zhou and Junhao Wu and Xueyang Zhou and Yixiao Huo and Hongcheng Gao and Di Zhu and Zhenghao Zhang and Yongchao Chen},
  year = {2026},
  eprint = {2610.41857},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2610.41857},
}
Sim-to-Real & Simulators仿真与 Sim-to-Realbenchmark-auditphysxrobotwinliberocontact
Paper论文 2026 ★★ new新 2026-11-03

RoboColosseum: Evaluating Physical Intelligence at Scale In-The-Wild

Blinded pairwise trials at 124 sites compare VLAs and frontier agents. Rankings barely agree across robots (W = 0.24), and open rankings poorly predict results after fine-tuning; no policy finishes a G1 task.在 124 个站点做盲测两两对比,横跨四种机器人评测 VLA 与前沿智能体。不同机器人的排名几乎不一致(Kendall W = 0.24),开箱排名也难以预测微调后的表现;G1 人形上没有策略完成任何任务。

BibTeX
@misc{nguyen2026robocolosseum,
  title = {{RoboColosseum: Evaluating Physical Intelligence at Scale In-The-Wild}},
  author = {Tan Sang Nguyen and Yi Ru Wang and Shailesh Shailesh and Gang Yang and Jiamo Hu and Jianuo Jiang and Haoquan Fang and Zhongzheng Ren and Zhongyi Luo and Ian Chong and Aaron Tung and Santiago Pravisani and Minghui Lin and Yao Mo and Ishneet Singh and Benjamin Tee and Harold Soh and Siddhartha Srinivasa and Dieter Fox and David Hsu and Haoming Song and Maxime Ellerbach and Thomas Wolf and Pepijn Kooijmans and Ruijie He and Michael Cho and Jiafei Duan},
  year = {2026},
  eprint = {2611.02497},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.02497},
}
Paper论文 2026 · Robbyant ★★

A Pragmatic VLA Foundation Model

LingBot-VLA: an Apache-2.0 foundation model trained on about 20,000 hours of real data from nine dual-arm setups, tested on four platforms with 100 tasks each; code, base model and benchmark data are released.LingBot-VLA:Apache-2.0 开源的基础模型,用九种双臂构型约 2 万小时真实数据训练,并在四个平台各 100 项任务上评测;代码、基座模型和评测数据一并开放。

BibTeX
@misc{wu2026pragmatic,
  title = {{A Pragmatic VLA Foundation Model}},
  author = {Wei Wu and Fan Lu and Yunnan Wang and Shuai Yang and Shi Liu and Fangjing Wang and Qian Zhu and He Sun and Yong Wang and Shuailei Ma and Yiyu Ren and Kejia Zhang and Hui Yu and Jingmei Zhao and Shuai Zhou and Zhenqi Qiu and Houlong Xiong and Ziyu Wang and Zechen Wang and Ran Cheng and Yong-Lu Li and Yongtao Huang and Xing Zhu and Yujun Shen and Kecheng Zheng},
  year = {2026},
  eprint = {2601.18692},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2601.18692},
}
VLA & Robot Foundation ModelsVLA 与机器人基础模型Robot arm机械臂realbimanualopen-weightsopen-datacross-embodiment
Paper论文 2026 ★★ new新 2026-11-05

From Pixels to Actions - Towards Native Vision-Language-Action Policies

NEO-VLA drops the visual encoder: images and language evolve in one backbone and a flow-matching action expert reads several depths. Layer probing shows action signals often peak before the final visual layer.NEO-VLA 去掉独立视觉编码器:图像与语言在同一主干中共同演化,流匹配动作专家从多个深度读取特征。逐层探测显示,对动作关键的信号往往在最终视觉层之前达到峰值。

BibTeX
@misc{fan2026from,
  title = {{From Pixels to Actions - Towards Native Vision-Language-Action Policies}},
  author = {Weichen Fan and Haiwen Diao and Penghao Wu and Siyuan Hu and Ziqi Huang and Tianqi Liu and Mingze Sun and Ziyi Wang and Zhongang Cai and Hanming Deng and Quan Wang and Lei Yang and Lewei Lu and Fangzhou Hong and Zhaoxi Chen and Dahua Lin and Ziwei Liu},
  year = {2026},
  eprint = {2611.06918},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/2611.06918},
}
Paper论文 2026 ★★ new新 2026-11-05

Open-HumanWAM: An Open Recipe for Scaling Human and Robot Experience for Embodied Foundation Models

Opens a 50,000-hour annotated egocentric video corpus with pipelines and checkpoints. Reports a log-linear law between pretraining hours and robot success, and 84.6% on RoboTwin 2.0 Clean2Random.开源 5 万小时带标注的第一视角视频语料及流程和权重。报告预训练时长与机器人成功率之间的对数线性规律,后训练后在 RoboTwin 2.0 Clean2Random 上达到 84.6%。

BibTeX
@misc{ma2026open,
  title = {{Open-HumanWAM: An Open Recipe for Scaling Human and Robot Experience for Embodied Foundation Models}},
  author = {Juncheng Ma and Jiaxin Li and Jiankai Tu and Bo Liang and Guodong Lv and Yufan Deng and Junzhe Tang and Liangzhu Yang and Chen Bian and Zicong Cao and Baohao Zhu and Jianxin Bi and Tengfei Yan and Yinyuan Zhang and Kewei Zhang and Xinglong Chen and Kaiqi Chen and Duomin Wang and Xiaotian Tang and Liang Tan and Li Li and Yuan Xu and Haosen Yang and Yuqi Wang and Jingfei Xia and Songyan Huang and Zhiyang Dou and Zhen Dong and Enze Xie and Tat-Seng Chua and Daquan Zhou},
  year = {2026},
  eprint = {2611.06817},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/2611.06817},
}
Paper论文 2025 · Physical Intelligence RSS 2026 ★★

π*0.6: a VLA That Learns From Experience

RECAP trains a VLA with RL via advantage conditioning on demos, on-robot rollouts and teleop corrections; reports it more than doubles throughput on hard tasks like laundry folding and espresso making.RECAP 通过优势条件化,用演示、机器人自主运行数据和遥操作纠正对 VLA 做强化学习;论文报告在叠衣服、做意式咖啡等难任务上吞吐量提升一倍以上、失败率约减半。

BibTeX
@misc{intelligence2025vla,
  title = {{π*0.6: a VLA That Learns From Experience}},
  author = {Physical Intelligence and Ali Amin and Raichelle Aniceto and Ashwin Balakrishna and Kevin Black and Ken Conley and Grace Connors and James Darpinian and Karan Dhabalia and Jared DiCarlo and Danny Driess and Michael Equi and Adnan Esmail and Yunhao Fang and Chelsea Finn and Catherine Glossop and Thomas Godden and Ivan Goryachev and Lachy Groom and Hunter Hancock and Karol Hausman and Gashon Hussein and Brian Ichter and Szymon Jakubczak and Rowan Jen and Tim Jones and Ben Katz and Liyiming Ke and Chandra Kuchi and Marinda Lamb and Devin LeBlanc and Sergey Levine and Adrian Li-Bell and Yao Lu and Vishnu Mano and Mohith Mothukuri and Suraj Nair and Karl Pertsch and Allen Z. Ren and Charvi Sharma and Lucy Xiaoyang Shi and Laura Smith and Jost Tobias Springenberg and Kyle Stachowicz and Will Stoeckle and Alex Swerdlow and James Tanner and Marcel Torne and Quan Vuong and Anna Walling and others},
  year = {2025},
  eprint = {2511.14759},
  archivePrefix = {arXiv},
  primaryClass = {cs.LG},
  url = {https://arxiv.org/abs/2511.14759},
}
Paper论文 2024 · Stanford, UC Berkeley, TRI ★★

OpenVLA: An Open-Source Vision-Language-Action Model

A 7B open VLA built on Llama 2 + DINOv2/SigLIP; the de-facto open baseline for VLA research and LoRA fine-tuning.基于 Llama 2 与 DINOv2/SigLIP 的 7B 开源 VLA,是 VLA 研究与 LoRA 微调的事实开源基线。

BibTeX
@misc{kim2024openvla,
  title = {{OpenVLA: An Open-Source Vision-Language-Action Model}},
  author = {Moo Jin Kim and Karl Pertsch and Siddharth Karamcheti and Ted Xiao and Ashwin Balakrishna and Suraj Nair and Rafael Rafailov and Ethan Foster and Grace Lam and Pannag Sanketi and Quan Vuong and Thomas Kollar and Benjamin Burchfiel and Russ Tedrake and Dorsa Sadigh and Sergey Levine and Percy Liang and Chelsea Finn},
  year = {2024},
  eprint = {2406.09246},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2406.09246},
}
Paper论文 2023 · Google DeepMind ★★

RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control

Coined "VLA" — co-fine-tuning a web-scale VLM to output action tokens transfers semantic knowledge to robot control.提出 "VLA" 概念:把网络规模的视觉语言模型联合微调为输出动作 token,把语义知识迁移到机器人控制。

BibTeX
@misc{brohan2023rt,
  title = {{RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control}},
  author = {Anthony Brohan and Noah Brown and Justice Carbajal and Yevgen Chebotar and Xi Chen and Krzysztof Choromanski and Tianli Ding and Danny Driess and Avinava Dubey and Chelsea Finn and Pete Florence and Chuyuan Fu and Montse Gonzalez Arenas and Keerthana Gopalakrishnan and Kehang Han and Karol Hausman and Alexander Herzog and Jasmine Hsu and Brian Ichter and Alex Irpan and Nikhil Joshi and Ryan Julian and Dmitry Kalashnikov and Yuheng Kuang and Isabel Leal and Lisa Lee and Tsang-Wei Edward Lee and Sergey Levine and Yao Lu and Henryk Michalewski and Igor Mordatch and Karl Pertsch and Kanishka Rao and Krista Reymann and Michael Ryoo and Grecia Salazar and Pannag Sanketi and Pierre Sermanet and Jaspiar Singh and Anikait Singh and Radu Soricut and Huong Tran and Vincent Vanhoucke and Quan Vuong and Ayzaan Wahid and Stefan Welker and Paul Wohlhart and Jialin Wu and Fei Xia and Ted Xiao and others},
  year = {2023},
  eprint = {2307.15818},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2307.15818},
}
Paper论文 2026 · NUS ★★

World Action Models: A Survey

Separates WAMs from world models, video generators and VLAs, then sorts work by what is generated (rendered, latent or none) and how it is built; concludes the field is moving toward generating less of the future.厘清 WAM 与世界模型、视频生成模型、VLA 的区别,并按生成内容(渲染、潜空间或不生成)和架构分类;结论是领域正走向少生成未来,只保留控制所需。

BibTeX
@misc{shen2026world,
  title = {{World Action Models: A Survey}},
  author = {Qiuhong Shen and Shihua Zhang and Yue Liao and Qi Li and Zhenxiong Tan and Shizun Wang and Shuicheng Yan and Xinchao Wang},
  year = {2026},
  eprint = {2606.20781},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2606.20781},
}
World Models世界模型surveyworld-action-model
Paper论文 2026 · NVIDIA ★★ new新 2026-11-04

Cosmos 3: Omnimodal World Models for Physical AI

A family of omnimodal models that handles language, image, video, audio and action in one mixture-of-transformers, folding VLMs, video generators, world simulators and world-action models into a single framework.全模态世界模型家族,用一个 Mixture-of-Transformers 同时处理语言、图像、视频、音频和动作,把 VLM、视频生成、世界模拟器和世界动作模型并入同一框架。

BibTeX
@misc{nvidia2026cosmos,
  title = {{Cosmos 3: Omnimodal World Models for Physical AI}},
  author = {NVIDIA and : and Aditi and Niket Agarwal and Arslan Ali and Jon Allen and Martin Antolini and Adeline Aubame and Alisson Azzolini and Junjie Bai and Maciej Bala and Yogesh Balaji and Josh Bapst and Aarti Basant and Mukesh Beladiya and Mohammad Qazim Bhat and Zaid Pervaiz Bhat and Dan Blick and Vanni Brighella and Han Cai and Tiffany Cai and Eric Cameracci and Jiaxin Cao and Yulong Cao and Mark Carlson and Carlos Casanova and Ting-Yun Chang and Yan Chang and Yu-Wei Chao and Prithvijit Chattopadhyay and Roshan Chaudhari and Chieh-Yun Chen and Junyu Chen and Ke Chen and Qizhi Chen and Wenkai Chen and Xiaotong Chen and Yu Chen and An-Chieh Cheng and Click Cheng and Xiu Chia and Jeana Choi and Chaeyeon Chung and Wenyan Cong and Yin Cui and Magdalena Dadela and Nalin Dadhich and Wenliang Dai and Joyjit Daw and Alperen Degirmenci and others},
  year = {2026},
  eprint = {2606.02800},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/2606.02800},
}
World Models世界模型world-foundation-modelopen-weights
Paper论文 2026 · NVIDIA ★★ new新 2026-11-04

DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos

A foundation world model pretrained on 44k hours of egocentric human video, using continuous latent actions as proxies for missing labels, then post-trained on small robot datasets.在 4.4 万小时第一视角人类视频上预训练的基础世界模型,用连续潜动作代替缺失的动作标签,再用小规模机器人数据后训练。

BibTeX
@misc{gao2026dreamdojo,
  title = {{DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos}},
  author = {Shenyuan Gao and William Liang and Kaiyuan Zheng and Ayaan Malik and Seonghyeon Ye and Sihyun Yu and Wei-Cheng Tseng and Yuzhu Dong and Kaichun Mo and Chen-Hsuan Lin and Qianli Ma and Seungjun Nah and Loic Magne and Jiannan Xiang and Yuqi Xie and Ruijie Zheng and Dantong Niu and You Liang Tan and K. R. Zentner and George Kurian and Suneel Indupuru and Pooya Jannaty and Jinwei Gu and Jun Zhang and Jitendra Malik and Pieter Abbeel and Ming-Yu Liu and Yuke Zhu and Joel Jang and Linxi "Jim" Fan},
  year = {2026},
  eprint = {2602.06949},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2602.06949},
}
World Models世界模型Dexterous hand灵巧手human-videodexterouslatent-action
Paper论文 2026 ★★ new新 2026-11-04

OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining

An open research stack that splits world-action models into composable modules, then runs controlled studies on what to inherit from video priors and how world and action learning interact.开放研究栈,把世界动作模型拆成可组合模块,并通过对照实验研究该从视频先验继承什么、世界学习与动作学习如何相互作用。

BibTeX
@misc{wang2026openwam,
  title = {{OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining}},
  author = {Yuran Wang and Siqiao Huang and Mingleyang Li and Chenhao Zhang and Jiaqi Liang and Weiyang Jin and Yue Chen and Xuemin Chi and Donghao Zhou and Qize Yu and Yu-Kai Wang and Yuhan Rui and Shenzhe Yao and Zhen Yuan and Zhenhao Shen and Kefei Zhu and Zijie Zhu and Ning Gao and Xiaowei Chi and Guanqi He and Shanghang Zhang and Hao Dong and Lin Shao and Hang Zhao},
  year = {2026},
  eprint = {2609.07398},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2609.07398},
}
Paper论文 2026 · Meta ★★ new新 2026-11-04

RoboJEPA: Scaling Robotic Latent World Models

A JEPA world model trained across 12 robot embodiments; its imagination error follows a power law in compute, so model quality can be predicted beyond the fitted scale.跨 12 种机器人形态训练的 JEPA 世界模型;其想象误差随算力服从幂律,因此可以预测超出拟合规模时的模型质量。

BibTeX
@misc{zholus2026robojepa,
  title = {{RoboJEPA: Scaling Robotic Latent World Models}},
  author = {Artem Zholus and Nicolas Beltran-Velez and Jianhao Yuan and Sarath Chandar and Tushar Nagarajan and Daniel Severo and Koustuv Sinha and Michal Drozdzal and Adriana Romero Soriano and Jeannette Bohg and Nicolas Ballas and Mahmoud Assran},
  year = {2026},
  eprint = {2610.10515},
  archivePrefix = {arXiv},
  primaryClass = {cs.AI},
  url = {https://arxiv.org/abs/2610.10515},
}
World Models世界模型jepascaling-laws

Fresh from arXivarXiv 最新

arXiv cs.CV 2026-11-10 code

World In-Context Learning for Agentic Robot Manipulation

Heng Fang, Zehui Guo, Yuehan Zhang, Mingyang Du et al.

Abstract摘要

Trained action policies write manipulation skill into network weights, tying what is learned to the distribution it is learned from. In-context learning (ICL) avoids this coupling but has not matched trained policies, because a demonstration recorded in another scene carries no feedback from the world the robot currently faces. We observe that what an agent learns in context is semantic, recording task steps and object roles rather than visual appearance, so experience gathered in one world transfers to another. Based on this insight, we propose World In-Context Learning (WICL), a paradigm in …

BibTeX
@misc{fang2026world,
  title = {{World In-Context Learning for Agentic Robot Manipulation}},
  author = {Heng Fang and Zehui Guo and Yuehan Zhang and Mingyang Du and Dingkang Liang and Xiang Bai},
  year = {2026},
  eprint = {2611.12885},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/2611.12885},
}
arXiv cs.CV 2026-11-10 code

SWAM: Scaling World Action Models with Cross-Modal Alignment

Yu Zhou, Xinyuan Xia, Xuankun Yang, Yinghao Yang et al.

Abstract摘要

World action models jointly predict video and actions conditioned on language. Existing studies focus primarily on architectures and training mechanisms, typically treating language-video alignment acquired through video pretraining as an established foundation. However, introducing action learning may impair this alignment. Principled guidance on data and supervision design for maintaining language-video alignment during action learning remains limited. To investigate this, we curate a pool of approximately 47,000 hours of general videos, egocentric videos, UMI demonstrations, and robot …

BibTeX
@misc{zhou2026swam,
  title = {{SWAM: Scaling World Action Models with Cross-Modal Alignment}},
  author = {Yu Zhou and Xinyuan Xia and Xuankun Yang and Yinghao Yang and Wendi Chen and Bowen Liu and Jianhan Ma and Weicheng Duan and others},
  year = {2026},
  eprint = {2611.12870},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/2611.12870},
}
arXiv cs.RO 2026-11-10

DreamLander: A 6-DOF World Model based Reinforcement Learning Planetary Lander

George Nehma, Patrick Quinn, Madhur Tiwari, Camilo Riano-Rios

Abstract摘要

Soft powered descent landings are becoming evermore important in the field of space exploration and scientific advancement, because of their ability to deliver mission critical payloads, both highly accurately and safely. The high efficiency restriction on planetary landings due to the severely limited fuel supply results in the need for optimal guidance trajectories and control. Model based reinforcement learning is proving to be an important tool in simplifying the highly complex process of generating optimal guidance trajectories and control. In this work, we present DreamLander, a state …

BibTeX
@misc{nehma2026dreamlander,
  title = {{DreamLander: A 6-DOF World Model based Reinforcement Learning Planetary Lander}},
  author = {George Nehma and Patrick Quinn and Madhur Tiwari and Camilo Riano-Rios},
  year = {2026},
  eprint = {2611.12824},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.12824},
}
arXiv cs.RO 2026-11-10

Simulating Vein Compressibility for Ultrasound-Guided Femoral Access: Speed, Accuracy, and Phantom Validation

Amit Manicka, Laurent Coulon, Darwin Ang, Michael Loushin et al.

Abstract摘要

In ultrasound-guided femoral access, probe pressure deforms the tissue and changes the vascular anatomy a robot observes. A simulator must reproduce these mechanics fast enough for robotic interaction, yet the computational effort needed for a clinically meaningful signal like vein collapse before artery is unclear. We test the feasibility of a physics-based simulation in NVIDIA's Isaac Sim for Healthcare, with Stable Neo-Hookean tissue solved by Vertex Block Descent on one GPU. A simulation of a low-fidelity cylindrical benchtop phantom with known geometry and mechanical properties, pressed …

BibTeX
@misc{manicka2026simulating,
  title = {{Simulating Vein Compressibility for Ultrasound-Guided Femoral Access: Speed, Accuracy, and Phantom Validation}},
  author = {Amit Manicka and Laurent Coulon and Darwin Ang and Michael Loushin and Timothy M. Kowalewski},
  year = {2026},
  eprint = {2611.12818},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.12818},
}
arXiv cs.RO 2026-11-10 code

Learning Heterogeneous Tactile Representation for General Dexterous Manipulation

Bing Han, Yichuan Peng, Haoyu Dong, Yuanmeng Hu et al.

Abstract摘要

Tactile sensing is an indispensable modality for contact-rich dexterous manipulation, a capability that hints at the ultimate frontiers of embodied intelligence. However, commercially available tactile sensors are still at a relatively early stage of development, with each type of sensor offering irreplaceable strengths alongside its own drawbacks. A key challenge is thus to free tactile understanding from sensor-specific physics, so that embodied models can effectively leverage heterogeneous tactile data. To this end, we develop LingBot-Touch, a tactile foundation model characterized by the …

BibTeX
@misc{han2026learning,
  title = {{Learning Heterogeneous Tactile Representation for General Dexterous Manipulation}},
  author = {Bing Han and Yichuan Peng and Haoyu Dong and Yuanmeng Hu and Yongyi Jia and Fangjing Wang and Kecheng Zheng and Yiming Zhang and others},
  year = {2026},
  eprint = {2611.12806},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.12806},
}
arXiv cs.RO 2026-11-10 CoRL 2026

Benchmarking Real-World Robotic Manipulation through Stochastic Challenges

Elias Gläßer, Gülhan Şikaroğlu, Pavlo Kupyn, Marc Pollefeys et al.

Abstract摘要

A challenging bottleneck in manipulation research is reproducibility and comparability of methods in real-world environments. Since manipulation is an interactive task, it cannot be evaluated on a static dataset of observations. Benchmarking in simulation is a common remedy, but cannot cover the whole complexity of real-world tests. This paper proposes a new paradigm of stochastic challenges. Like the well-known YCB objects, it is based on reproducible real-world scenes and therefore allows system-level innovation and comparability between different platforms. Due to their stochastic nature, …

BibTeX
@misc{glaer2026benchmarking,
  title = {{Benchmarking Real-World Robotic Manipulation through Stochastic Challenges}},
  author = {Elias Gläßer and Gülhan Şikaroğlu and Pavlo Kupyn and Marc Pollefeys and Zuria Bauer and Hermann Blum},
  year = {2026},
  eprint = {2611.12804},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.12804},
}
arXiv eess.SY 2026-11-10

Certified Zonotopic Reachability Analysis for Trajectory Tracking on Lie Groups

Yanliang Huang, Peng Xie, Zhen Zhang, Zhuoqi Zeng et al.

Abstract摘要

Autonomous vehicles track planned trajectories close to obstacles. Unknown disturbances make them deviate from these trajectories. With a bound on the tracking error that disturbances can cause, a planned trajectory can be certified as safe before execution. Existing set-based methods bound the tracking error by one invariant ellipsoid for the whole trajectory or by intervals, which are both conservative. For aerial and space vehicles, the tracking error evolves on a matrix Lie group with nonlinear dynamics. However, for group-affine systems, the error dynamics are linear in Lie algebra …

BibTeX
@misc{huang2026certified,
  title = {{Certified Zonotopic Reachability Analysis for Trajectory Tracking on Lie Groups}},
  author = {Yanliang Huang and Peng Xie and Zhen Zhang and Zhuoqi Zeng and Amr Alanwar},
  year = {2026},
  eprint = {2611.12767},
  archivePrefix = {arXiv},
  primaryClass = {eess.SY},
  url = {https://arxiv.org/abs/2611.12767},
}
arXiv cs.RO 2026-11-10

Sliding into Balance: Benefits of a Sliding Payload for Load Distribution and Disturbance Rejection in Dual-UAV Transportation

Jorge Vicente-Martinez, Francisco José Mañas-Álvarez, Edgar Ramirez-Laboreo

Abstract摘要

This paper analyzes the cooperative transportation of a payload suspended from two drones in which, instead of being attached to two independent ropes, the payload is allowed to slide along a single rope connecting both UAVs. First, a planar nondimensional dynamical model of the sliding motion with viscous friction is presented. Then, considering stationary drones, this configuration is compared with a fixed payload with the same total rope length, both at equilibrium and under disturbances. The analytical results show that the sliding payload equalizes the tension in both rope segments for …

BibTeX
@misc{vicentemartinez2026sliding,
  title = {{Sliding into Balance: Benefits of a Sliding Payload for Load Distribution and Disturbance Rejection in Dual-UAV Transportation}},
  author = {Jorge Vicente-Martinez and Francisco José Mañas-Álvarez and Edgar Ramirez-Laboreo},
  year = {2026},
  eprint = {2611.12754},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.12754},
}
Drone / aerial无人机

See the full daily feed →查看完整每日论文 →