📡 Embodied AI Radar具身智能雷达 Star3

Most of this project is curated by Claude. Drop a star to cheer Claude on!本项目大量由 Claude 整理维护,点个 Star 给克劳德大小姐鼓励一下!

★ Feed a star投喂 Star

arXiv papersarXiv 论文 · 2026-11-09

62 papers篇论文 · 13 with code附代码 · 8 accepted at a venue已被会议/期刊接收

← 2026-11-06 2026-11-10 →

arXiv cs.RO 2026-11-09 code

On Agentic Manipulation Policies

Chen Chen, Omid Bagherieh, Naveen Nikamanth Appiah Balaji, Jesse T. Gonzalez et al.

Abstract摘要

Recent work on robot manipulation has focused on specialist policies trained on demonstrations. We show that generalist AI models can control manipulators more reliably than specialist policies such as vision-language-action models (VLAs) and world-action models (WAMs). We systematically analyze agentic manipulation policies (AMPs), in which a generalist AI model commands the manipulator directly, adapting its actions as the task unfolds. We present AMP1, a reference harness that runs unchanged across single-arm, bimanual, and mobile manipulation. AMP1 achieves state-of-the-art results on the …

BibTeX
@misc{chen2026agentic,
  title = {{On Agentic Manipulation Policies}},
  author = {Chen Chen and Omid Bagherieh and Naveen Nikamanth Appiah Balaji and Jesse T. Gonzalez and Negin Heravi and Fahad Islam and Xueting Li and Jean-Baptiste Regli and others},
  year = {2026},
  eprint = {2611.09892},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09892},
}
arXiv cs.LG 2026-11-09 code

Computer-Use Agents Are Embodied Generalists

Pranjal Aggarwal, Sean Welleck

Abstract摘要

In many areas of AI, general-purpose models have increasingly replaced handcrafted methods and specialized architectures. We argue that embodied AI is poised for a similar shift. Our key claim is that embodied tasks can be formulated as interaction with digital software. Specifically, we build software that renders an agent's view of a physical environment on a screen and provides controls for acting in it. A computer-use agent (CUA) can then perform embodied tasks through the same screenshots and keyboard and mouse actions that it uses to operate ordinary software. Using a single CUA design …

BibTeX
@misc{aggarwal2026computer,
  title = {{Computer-Use Agents Are Embodied Generalists}},
  author = {Pranjal Aggarwal and Sean Welleck},
  year = {2026},
  eprint = {2611.09847},
  archivePrefix = {arXiv},
  primaryClass = {cs.LG},
  url = {https://arxiv.org/abs/2611.09847},
}
arXiv cs.RO 2026-11-09 code

DKWBC: Decoupling Motion Tracking and Balancing for Humanoid Whole-Body Control

Dingkun Wei, Zehong Shen, Huaijin Pi, Xueyang Wang et al.

Abstract摘要

Humanoid whole-body control requires a robot to track diverse reference motions while maintaining balance under gravity, torque limits, contact switching, and external disturbances. Existing reinforcement-learning-based trackers typically learn control outputs that jointly address motion tracking and balance. However, similar reference poses can correspond to substantially different dynamic demands, requiring a unified policy to learn motion-dependent control requirements alongside balance corrections. This can complicate learning and lead to high-frequency fluctuations in control outputs. We …

BibTeX
@misc{wei2026dkwbc,
  title = {{DKWBC: Decoupling Motion Tracking and Balancing for Humanoid Whole-Body Control}},
  author = {Dingkun Wei and Zehong Shen and Huaijin Pi and Xueyang Wang and Xing Zhu and Hujun Bao and Yujun Shen and Xiaowei Zhou},
  year = {2026},
  eprint = {2611.09605},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09605},
}
arXiv cs.RO 2026-11-09 code

Task-Driven Closed-Loop Design Optimization of Passively Morphing Quadrotors for Contact-Mediated Narrow Gap Traversal

Etor Arza, Luca Girardi, Gabriel Maquignaz, Javier Paez et al.

Abstract摘要

Aerial robots operating in cluttered environments may encounter openings narrower than their nominal width. Existing passively morphing drones reduce their width upon traversal, but they typically involve human-made designs, which can struggle to find the right balance among folding ratio, flight efficiency, and control tracking performance. We introduce a closed-loop design method that jointly optimizes quadrotor geometry and the torque-deflection response of two passively folding arms driven by the success rate in simulation for contact-mediated gap traversal. An optimization algorithm …

BibTeX
@misc{arza2026task,
  title = {{Task-Driven Closed-Loop Design Optimization of Passively Morphing Quadrotors for Contact-Mediated Narrow Gap Traversal}},
  author = {Etor Arza and Luca Girardi and Gabriel Maquignaz and Javier Paez and Stefan Leutenegger and Stefano Mintchev and Kostas Alexis},
  year = {2026},
  eprint = {2611.09272},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09272},
}
Drone / aerial无人机
arXiv cs.RO 2026-11-09 code WACV 2027

Auditing Grasp Feasibility Predictors with Planner-Verified Counterfactuals

Sajid Ansari, Antony Thomas, Girish Varma

Abstract摘要

Grasp-feasibility predictors report near-perfect accuracy on Task and Motion Planning benchmarks, but high accuracy on these benchmarks does not verify that a predictor uses the collision geometry that the motion planner checks. We propose a planner-verified counterfactual (CF) test: holding the grasp pose fixed, we insert a solid obstacle into the approach corridor, add its points to the model input, and let a planner re-derive the label, which flips from feasible to infeasible. Across eight predictors spanning point clouds, voxels, depth, and object tokens, CF-pair AUROC falls from high …

BibTeX
@misc{ansari2026auditing,
  title = {{Auditing Grasp Feasibility Predictors with Planner-Verified Counterfactuals}},
  author = {Sajid Ansari and Antony Thomas and Girish Varma},
  year = {2026},
  eprint = {2611.09130},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09130},
}
arXiv cs.RO 2026-11-09 code

Toward the Era of Agentic Embodied Intelligence

Chao Liang, Ke Chen, Fengxiaoxiao Li, Shibo Huang et al.

Abstract摘要

Foundation models increasingly guide robot actions, yet sustained autonomy requires efficient control and failure recovery. We introduce A2-MEAS, an embodied multi-agent framework built around code as a scaling interface. Learned correction codes combine corrective language, spatial evidence, execution history, and action proposals. MetaBrain provides training supervision and runtime guidance. A correction encoder and adapter absorb this knowledge into policy weights during training, while fresh codes adapt behavior with frozen weights at deployment. The action model, A2-WLA, adds …

BibTeX
@misc{liang2026toward,
  title = {{Toward the Era of Agentic Embodied Intelligence}},
  author = {Chao Liang and Ke Chen and Fengxiaoxiao Li and Shibo Huang and Yufeng Sun and Zhaokai Yin and Jianhuan Lai and Haozhe Feng and others},
  year = {2026},
  eprint = {2611.09124},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09124},
}
arXiv cs.RO 2026-11-09 code

DobotTrack: Target-Grounded Vision-Language-Action Learning for Embodied Person Tracking

Shengjun Deng, Yinghan Zhang, Chengrui Wei, Liu Liang et al.

Abstract摘要

Language-guided embodied person tracking requires a mobile agent to identify a target from a referring description and consistently follow the target under egocentric observations. We present DobotTrack, a target-grounded vision-language-action (VLA) framework that integrates auxiliary grounding supervision with efficient temporal modeling. We systematically investigate five auxiliary tasks---person segmentation, bounding-box grounding, visual-spatial classification (VSC), future DINO feature prediction, and future-frame prediction---and adopt complementary mask and bounding-box supervision …

BibTeX
@misc{deng2026dobottrack,
  title = {{DobotTrack: Target-Grounded Vision-Language-Action Learning for Embodied Person Tracking}},
  author = {Shengjun Deng and Yinghan Zhang and Chengrui Wei and Liu Liang and Songyuan Liu and Pengkun Zheng and Yajun Zheng and Ying Zhang and others},
  year = {2026},
  eprint = {2611.09041},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09041},
}
arXiv cs.AI 2026-11-09 code

Flex-RSI: Benchmarking Recursive Self-Improvement of Frontier Agents

Jingdong Zhang, Jionghao Wang, Zhengming Yu, Yancheng Cai et al.

Abstract摘要

Frontier language models are increasingly deployed as agents, and how well an agent performs depends not only on its model but also on its harness: the prompts, tools, memory, and control loop through which the model acts. When an agent is applied to a new problem, a natural question is whether it can use the feedback of the task to improve the way it works, and not merely its answer. Most existing benchmarks keep the agent's harness fixed and score the solution it produces, or target large-scale model training. We introduce Flex-RSI, a benchmark for the recursive self-improvement of agents …

BibTeX
@misc{zhang2026flex,
  title = {{Flex-RSI: Benchmarking Recursive Self-Improvement of Frontier Agents}},
  author = {Jingdong Zhang and Jionghao Wang and Zhengming Yu and Yancheng Cai and Wei Chow and Chris Choy and Zhiyang Dou and Hang Hua and others},
  year = {2026},
  eprint = {2611.08946},
  archivePrefix = {arXiv},
  primaryClass = {cs.AI},
  url = {https://arxiv.org/abs/2611.08946},
}
arXiv cs.RO 2026-11-09 code

RevoSim: Scalable Multimodal Tactile Simulation for Dexterous Manipulation

Ke Zhang, Lixin Xu, Ziyi Wang, Xiyue Dong et al.

Abstract摘要

We present RevoSim, a scalable and high-fidelity multimodal tactile simulator for the BrainCo Revo3 hand that jointly models 285 piezoresistive taxels and five visuotactile fingertips. RevoSim efficiently generates synchronized pressure, depth, RGB, and marker-displacement observations; on a single RTX 5090, its depth-conditioned marker-displacement configuration supports up to 4,096 parallel environments. We train in-hand manipulation and grasping policies entirely in simulation, establishing a foundation for future sim-to-real transfer. Project page: …

BibTeX
@misc{zhang2026revosim,
  title = {{RevoSim: Scalable Multimodal Tactile Simulation for Dexterous Manipulation}},
  author = {Ke Zhang and Lixin Xu and Ziyi Wang and Xiyue Dong and Jie Tan and Lianghu Shao and Xianpeng Wang and Chuanyu Li and others},
  year = {2026},
  eprint = {2611.08939},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08939},
}
arXiv cs.RO 2026-11-09 code

Lodos: A Lightweight Simulator Designed for Contact-Rich Interactions with Detailed Meshes

Onur Beker, Andreas René Geist, Georg Martius

Abstract摘要

In recent years, massively parallelized rigid-body simulation has played a central role in robotics research, enabling rapid progress in areas such as reinforcement learning, stochastic optimal control, and randomized smoothing-based trajectory optimization. Particularly in contact-rich settings, the scalability of such simulations in large part depends on well-optimized representations of collision geometry, often requiring a coarse approximation of the underlying surfaces using primitives such as spheres, capsules, cylinders, and boxes. Whenever the complexity of the surfaces or the …

BibTeX
@misc{beker2026lodos,
  title = {{Lodos: A Lightweight Simulator Designed for Contact-Rich Interactions with Detailed Meshes}},
  author = {Onur Beker and Andreas René Geist and Georg Martius},
  year = {2026},
  eprint = {2611.08872},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08872},
}
arXiv cs.RO 2026-11-09 code

Lodos-v2: An Efficient Primal Formulation of the Exact Frictional Contact Problem

Onur Beker, Andreas René Geist, Georg Martius

Abstract摘要

Lodos-v2 is a GPU-based simulation framework for massively parallel rigid-body dynamics with contact. It is specifically designed to achieve high throughput in scenes involving collisions among large numbers of detailed meshes. Its predecessor, Lodos-v1, had two main limitations. First, it solved the standard convex relaxation of cone-complementarity-based contact dynamics, thereby inheriting well-known physical artifacts, including lift-off and artificial compliance in the normal direction, as well as creep in the tangential direction. Second, its contact-group reparameterization scheme, …

BibTeX
@misc{beker2026lodos,
  title = {{Lodos-v2: An Efficient Primal Formulation of the Exact Frictional Contact Problem}},
  author = {Onur Beker and Andreas René Geist and Georg Martius},
  year = {2026},
  eprint = {2611.08868},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08868},
}
arXiv cs.RO 2026-11-09 code CoRL 2026

CS-Pi: Constraint-Satisfying Flow Policy Sampling

Soumojit Bhattacharya, Oliver Kroemer, Shubham Tulsiani

Abstract摘要

A flow-matching policy deployed in the field must often satisfy a constraint that was absent from its demonstrations, such as avoiding an obstacle it has never seen. Retraining for every new constraint is impractical, so the constraint must be enforced at inference time. Enforcing it must not discard what the policy learned: an action the policy would rarely sample may avoid the obstacle yet fail the task. We therefore want actions that are both safe, satisfying the constraint, and plausible, remaining likely under the policy. Gradient guidance, the most common approach, steers noisy states, …

BibTeX
@misc{bhattacharya2026cs,
  title = {{CS-Pi: Constraint-Satisfying Flow Policy Sampling}},
  author = {Soumojit Bhattacharya and Oliver Kroemer and Shubham Tulsiani},
  year = {2026},
  eprint = {2611.08654},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08654},
}
arXiv cs.RO 2026-11-09 code

Meituan-Robotics-0: A Vision-Language-Action Foundation Model for Desktop Manipulation

Meituan Robotics Team, Caicheng Wang, Chen Zhao, Chengpeng Jin et al.

Abstract摘要

We present Meituan-Robotics-0 (MR0), a vision-language-action foundation model and embodied-agent system for stationary-base desktop manipulation. MR0 combines 147 million vision-language samples with 15,060 hours of curated robot trajectories spanning 12 embodiments. A three-stage training recipe aligns multimodal representations with robot behavior through discrete action-token pre-training, transfers these priors to continuous cross-embodiment control through flow-matching mid-training, and adapts the policy through real-world post-training. We introduce Rollback, which pairs replaced …

BibTeX
@misc{team2026meituan,
  title = {{Meituan-Robotics-0: A Vision-Language-Action Foundation Model for Desktop Manipulation}},
  author = {Meituan Robotics Team and Caicheng Wang and Chen Zhao and Chengpeng Jin and Duo Xu and Fengjiao Chen and Guanglu Wan and Heqing Yang and others},
  year = {2026},
  eprint = {2611.08577},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08577},
}
arXiv cs.RO 2026-11-09

Scenario Orchestration for Closed-loop Policy Evaluation of Autonomous Driving

Frieda Rong, Zhaoyue Wang, Veer Kapadia, Vishaka Rajani et al.

Abstract摘要

Scenario-based simulation is central to evaluating autonomous-driving policies, but a scenario scripted before execution (i.e., with predetermined, fixed actor routes and speeds) may not preserve its intended interaction once the tested ego policy responds in closed loop. Scripted scenarios cannot adapt to unanticipated ego behavior, while learned traffic actors may remain reactive without reliably realizing a particular scenario intent. We introduce a scenario orchestrator that continuously monitors the joint traffic state and adapts non-ego actors through re-timing, re-routing, and role …

BibTeX
@misc{rong2026scenario,
  title = {{Scenario Orchestration for Closed-loop Policy Evaluation of Autonomous Driving}},
  author = {Frieda Rong and Zhaoyue Wang and Veer Kapadia and Vishaka Rajani and Aren A. Babikian and Xujie Si and Mahsa Golchoubian and Raquel Urtasun and others},
  year = {2026},
  eprint = {2611.09888},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09888},
}
Autonomous driving自动驾驶
arXiv cs.RO 2026-11-09

Locating Contact on Tendon-Driven Continuum Robots From Tendon Measurements Alone via Constrained Moving Horizon Estimation

Haitham El-Hussieny

Abstract摘要

Tendon-driven continuum robots can reach through constrained spaces, but contact along their bodies is invisible to the sensors at their motors. We show that this is a structural limitation rather than a tuning problem: the map from contact forces to tendon measurements has a null space of dimension at least seven, so no estimator that leaves the contact support free can locate contact. When the obstacle geometry is known, however, non-penetration and complementarity make the contact force locally identifiable, and we prove that the resulting system with unknown contact inputs is locally …

BibTeX
@misc{elhussieny2026locating,
  title = {{Locating Contact on Tendon-Driven Continuum Robots From Tendon Measurements Alone via Constrained Moving Horizon Estimation}},
  author = {Haitham El-Hussieny},
  year = {2026},
  eprint = {2611.09877},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09877},
}
arXiv cs.RO 2026-11-09

Grasp-TAGS: Task-Aware Grasp Selection via Critic Distillation for Prehensile Loco-Manipulation

Xun Tu, Minghao Zou, Karthik Desingh

Abstract摘要

Loco-manipulation, which requires mobile manipulators to coordinate locomotion and manipulation over long horizons, is a key capability for large-object rearrangement in applications such as service robotics and warehouse automation. Despite recent progress, reliably executing these tasks remains challenging because performance depends on complex robot-object and object-environment interaction dynamics. Existing approaches address this challenge either through model-based methods, which often require accurate dynamics models, or through learning-based methods, which reduce this requirement …

BibTeX
@misc{tu2026grasp,
  title = {{Grasp-TAGS: Task-Aware Grasp Selection via Critic Distillation for Prehensile Loco-Manipulation}},
  author = {Xun Tu and Minghao Zou and Karthik Desingh},
  year = {2026},
  eprint = {2611.09864},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09864},
}
Manipulation & Dexterous Hands操作与灵巧手Robot arm机械臂Mobile robot移动机器人
arXiv cs.RO 2026-11-09

Seeing What Matters: Benchmarking Task-Conditioned Actionable Spatial Belief for Manipulation

Yina Jian, Mingkun Xu

Abstract摘要

When should a robot look at the cup, and when at the portafilter? Spatial-reasoning benchmarks evaluate whether a model can describe a scene, but manipulation needs something more specific: the ability to acquire the particular evidence that makes the current command executable. A view that is informative for one task can be useless for another, even at the same workstation. We introduce Seeing What Matters, a benchmark for task-conditioned actionable spatial belief in simulated tabletop manipulation. Across three domains--coffee workstation, drawer/cabinet, and microwave/appliance--the …

BibTeX
@misc{jian2026seeing,
  title = {{Seeing What Matters: Benchmarking Task-Conditioned Actionable Spatial Belief for Manipulation}},
  author = {Yina Jian and Mingkun Xu},
  year = {2026},
  eprint = {2611.09794},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09794},
}
arXiv cs.RO 2026-11-09 IROS 2026

Autonomous Whole-body Loco-manipulation Using a Snake Robot

Adarsh Salagame, Henry Noyes, Haroon Hublikar, Alireza Ramezani

Abstract摘要

Snake robots can leverage their hyper-redundant morphology for both locomotion and manipulation through distributed body contact but whole-body loco-manipulation is particularly challenging since the entire body serves simultaneously as propulsive mechanism and manipulation tool Prior work on wheeled legged and snake robot platforms has decoupled these functions through dedicated appendages body segmentation or grippers We present closed-loop loco-manipulation with our snake robot COBRA without this distinction such that any part of the body may make contact We develop a contact-implicit …

BibTeX
@misc{salagame2026autonomous,
  title = {{Autonomous Whole-body Loco-manipulation Using a Snake Robot}},
  author = {Adarsh Salagame and Henry Noyes and Haroon Hublikar and Alireza Ramezani},
  year = {2026},
  eprint = {2611.09777},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09777},
}
arXiv cs.RO 2026-11-09

A wearable input/output interface learns personalized models of haptic perception

Wen Li, E. Magnus Adams, Zijie Xu, Jiawen Yao et al.

Abstract摘要

Wearable haptic interfaces deliver physical stimuli to the skin, yet perceived locations vary widely across users and diverge from actuator locations, particularly for emergent tactile-feedback techniques. We developed a wearable haptic input/output (I/O) device integrating a 36-channel electrotactile array with capacitive touch sensing, enabling stimulation and user-reported percept locations to be registered within the same body-referenced coordinate frame. In 24 participants, the device revealed electrotactile and referred-thermal perceptual maps with notable interparticipant variability. …

BibTeX
@misc{li2026wearable,
  title = {{A wearable input/output interface learns personalized models of haptic perception}},
  author = {Wen Li and E. Magnus Adams and Zijie Xu and Jiawen Yao and Aybala Esmer and Xiaoyue Ni and Bozhi Tian and Pedro Lopes},
  year = {2026},
  eprint = {2611.09708},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09708},
}
arXiv cs.RO 2026-11-09

SURE:Spatiotemporal Uncertainty Representation for Efficient Vision-Language-Action Learning

Jingye Zhang, Choo Sin Wai, Dake Zhong, Zhifang Liu et al.

Abstract摘要

Vision-language-action (VLA) policies have become a promising paradigm for end-to-end robot control, but their effectiveness still depends heavily on large volumes of demonstration data. In manipulation tasks, this dependence is compounded by structured spatiotemporal uncertainty in the action space: multiple nearby actions or trajectories may successfully solve the same task, while semantically equivalent demonstrations often unfold at different speeds. Standard pointwise supervision treats each demonstrated action as an exact target, imposing an unnecessary learning burden under such …

BibTeX
@misc{zhang2026sure,
  title = {{SURE:Spatiotemporal Uncertainty Representation for Efficient Vision-Language-Action Learning}},
  author = {Jingye Zhang and Choo Sin Wai and Dake Zhong and Zhifang Liu and Yuhong Zhang and Siyao Xiao and Guorui Song and Guocun Wang and others},
  year = {2026},
  eprint = {2611.09684},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09684},
}
arXiv cs.RO 2026-11-09

Autonomous Particle Image Velocimetry Using Zero-Shot Sim-to-Real Reinforcement Learning

Chang Rajani, Luke Sebastien Marsden, Stephan Kunz, Claudio Mucignat et al.

Abstract摘要

Particle image velocimetry (PIV) reconstructs a flow field from the motion of tracer particles but the reconstruction quality is bounded by how well the flow structure of interest is resolved in the images. The acquisition position is typically fixed by the operator before the measurement. We cast camera placement as a sequential decision-making problem and train a reinforcement learning agent to control a 6-DoF manipulator equipped with a camera, enabling it to locate, frame and resolve a hydrofoil wake in a water tunnel. The agent commands the camera pose and observes the scene only through …

BibTeX
@misc{rajani2026autonomous,
  title = {{Autonomous Particle Image Velocimetry Using Zero-Shot Sim-to-Real Reinforcement Learning}},
  author = {Chang Rajani and Luke Sebastien Marsden and Stephan Kunz and Claudio Mucignat and Ivan Lunati},
  year = {2026},
  eprint = {2611.09679},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09679},
}
arXiv cs.RO 2026-11-09

ODEAction: From Predicting Chunks to Evolving Actions

Qishen Wang, Pengxiang Ding, Shifeng Bao, Mingyang Sun et al.

Abstract摘要

Vision-language-action (VLA) models typically generate actions in chunks, organizing continuous robot execution into separately predicted segments and thus introducing potential discontinuities at action-chunk transitions. We propose ODEAction, a chunk-free action generation paradigm that replaces action-chunk prediction with Continuous Action Evolution. Given visual observations, language instructions, and robot proprioceptive information, ODEAction learns an action transition field defined over action space, where a transition vector characterizes the evolution rate of the current action …

BibTeX
@misc{wang2026odeaction,
  title = {{ODEAction: From Predicting Chunks to Evolving Actions}},
  author = {Qishen Wang and Pengxiang Ding and Shifeng Bao and Mingyang Sun and Hengtao Li and Yi Gao and Baohua Yin and Yang Liu and others},
  year = {2026},
  eprint = {2611.09672},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09672},
}
arXiv cs.RO 2026-11-09

Goodhart in the Planner: Sampling-Based Control Exploits Rewards Learned from Human Preferences

Soovadeep Bakshi, Apurba Bose

Abstract摘要

Robots increasingly choose actions by searching against a reward model learned from human preferences, in model-predictive control or best-of-$N$ selection; we measure what this does to the true objective. On HalfCheetah and Hopper with crowd-sourced labels, and on Meta-World drawer-open and plate-slide with synthetic labels and blind labels from the two authors, harder MPPI search cuts true return by up to 76%: with human labels the drawer opens in 0 of 20 runs against 10 of 10 for the cloned policy the planner starts from, while held-out label accuracy stays at 0.75-0.97. On plate-slide …

BibTeX
@misc{bakshi2026goodhart,
  title = {{Goodhart in the Planner: Sampling-Based Control Exploits Rewards Learned from Human Preferences}},
  author = {Soovadeep Bakshi and Apurba Bose},
  year = {2026},
  eprint = {2611.09670},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09670},
}
arXiv cs.RO 2026-11-09

LACART: Lookahead-Augmented Collision Avoidance and Reference Tracking Strategies for Safety-Critical Robots

Pedro Lopes, Amit Shivam, Luis Tiago Paiva

Abstract摘要

Autonomous racing provides a demanding testbed for collision avoidance under tight geometric and computational constraints. Building on a recent conference contribution and a master's dissertation, LACART combines lookahead-based control barrier functions (CBFs), a relaxed control Lyapunov function (CLF), and quadratic programming (QP) to modify nominal vehicle commands for obstacle avoidance and reference tracking. The method handles circular obstacles and track boundaries in a common optimisation layer. Comparative simulation results against Huang \emph{et al.} \cite{r9} show similar …

BibTeX
@misc{lopes2026lacart,
  title = {{LACART: Lookahead-Augmented Collision Avoidance and Reference Tracking Strategies for Safety-Critical Robots}},
  author = {Pedro Lopes and Amit Shivam and Luis Tiago Paiva},
  year = {2026},
  eprint = {2611.09640},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09640},
}
arXiv cs.RO 2026-11-09

Extended Model-Based Learned Inertial Odometry

Sasanka Kuruppu Arachchige, Joni-Kristian Kämäräinen

Abstract摘要

Inertial odometry is a compelling approach to state estimation for agile quadrotor flight due to its affordability, low weight, and robustness to perceptual degradation. However, relying only on integrated inertial measurements is impractical, as sensor errors and time-varying biases lead to significant pose drift. Although recent advances have enabled inertial odometry for drone racing, existing approaches show limited generalization to trajectories not seen during training. This work improves generalization by adopting a body-frame representation and incorporating body-frame torque dynamics …

BibTeX
@misc{arachchige2026extended,
  title = {{Extended Model-Based Learned Inertial Odometry}},
  author = {Sasanka Kuruppu Arachchige and Joni-Kristian Kämäräinen},
  year = {2026},
  eprint = {2611.09584},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09584},
}
arXiv cs.RO 2026-11-09

Lightweight Path-Aware Frontier Re-ranking for LiDAR-Based UAV Exploration

Duc Manh Do, Thanh Nguyen Canh, Ngoc Minh Do, Mai Thanh Thai et al.

Abstract摘要

Autonomous 3D exploration with UAVs requires efficient target selection under limited flight time and onboard computation. In conventional Euclidean-distance-based frontier pipelines, geometric distance may poorly represent the actual collision-free travel cost in cluttered environments, leading to inefficient frontier choices. This paper presents a lightweight path-aware frontier re-ranking method for LiDAR-based UAV exploration. The method first retains a small top-N set of promising frontier candidates using a lightweight utility function and then applies time-bounded RRT* planning to …

BibTeX
@misc{do2026lightweight,
  title = {{Lightweight Path-Aware Frontier Re-ranking for LiDAR-Based UAV Exploration}},
  author = {Duc Manh Do and Thanh Nguyen Canh and Ngoc Minh Do and Mai Thanh Thai and Xiem HoangVan},
  year = {2026},
  eprint = {2611.09561},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09561},
}
arXiv cs.RO 2026-11-09

CucumberVision at the Edge: Accuracy, Throughput, and Energy of RGB-D Cucumber Sizing on Jetson Orin Nano and Raspberry Pi 4

Manveen Kaur, Rajmeet Singh, Saeed Mozaffari, Majid Ahmadi et al.

Abstract摘要

Non-contact fruit sizing from RGB-D imagery reaches sub-centimetre accuracy on workstation hardware, but in-field grading requires the same pipeline to run on a low-power single-board computer, and the cost of that transition is rarely reported. We deploy a curvature-aware cucumber length-measurement pipeline (YOLO26n detection, prompt-based segmentation and a medial arc spline estimator) on an NVIDIA Jetson Orin Nano and a Raspberry Pi 4, and characterize both against an RTX 3050 Ti workstation by replaying 50 identical greenhouse captures of 7 specimens, with specimen-level …

BibTeX
@misc{kaur2026cucumbervision,
  title = {{CucumberVision at the Edge: Accuracy, Throughput, and Energy of RGB-D Cucumber Sizing on Jetson Orin Nano and Raspberry Pi 4}},
  author = {Manveen Kaur and Rajmeet Singh and Saeed Mozaffari and Majid Ahmadi and Shahpour Alirezaee},
  year = {2026},
  eprint = {2611.09490},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09490},
}
arXiv cs.RO 2026-11-09

Mechanical Interaction Sensing for Robotic Kiwifruit Handling with an Optoelectronic Soft Suction Cup

Romina Adhami, Ebrahim Shahabi, Alessio Mondini, Samuel M. Youssef et al.

Abstract摘要

Robotic handling of delicate fruit benefits from compliant contact and quantitative sensing of the mechanical interaction at the end-effector. This study investigates an optoelectronic soft suction cup with a kiwifruit-specific bicomponent design for estimating interaction forces during contact with real fruit. During known-contact intervals, the optical signals accurately estimate interaction force on fruits excluded from model training: the best shallow network achieves grouped out-of-fold pooled R-squared = 0.968 +/- 0.005 (MAE = 0.138 N), with a median per-fruit held-out R-squared = 0.973 …

BibTeX
@misc{adhami2026mechanical,
  title = {{Mechanical Interaction Sensing for Robotic Kiwifruit Handling with an Optoelectronic Soft Suction Cup}},
  author = {Romina Adhami and Ebrahim Shahabi and Alessio Mondini and Samuel M. Youssef and Cosimo Della Santina and Gualtiero Volpe and Barbara Mazzolai},
  year = {2026},
  eprint = {2611.09468},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09468},
}
Dexterous hand灵巧手
arXiv cs.RO 2026-11-09

Can LLMs Debug Robots by Editing Their Weights?

Jusheng Zhang, Keze Wang, Liang Lin

Abstract摘要

A language model can repair a robot policy's lexical instruction grounding by editing just 65 token-embedding rows. We bring weight-space programming to robot foundation policies: GPT-6 Astra reads weights and uses a CPU workspace and budgeted simulator feedback, without gradient updates or new demonstrations. Three independent sessions on $π_{0.5}$ all improve success on 765 held-out paraphrases; the best raises success from 86.3\% to 92.0\% (48 repairs, four regressions; exact paired $p=1.31\times10^{-10}$). Among the 335 instructions containing edited tokens, success rises from 74.3\% to …

BibTeX
@misc{zhang2026can,
  title = {{Can LLMs Debug Robots by Editing Their Weights?}},
  author = {Jusheng Zhang and Keze Wang and Liang Lin},
  year = {2026},
  eprint = {2611.09376},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09376},
}
arXiv cs.CV 2026-11-09

HiMEM: Hippocampus-Inspired Memory Consolidation, Pruning, and Composition for Vision-Language-Action Models in 3D Scenes

Boran Zhao, Yanbin Hu, Jun Ye, Zhenxian Hu et al.

Abstract摘要

Memory plays a crucial role in long-horizon task execution and cross-task generalization for Vision-Language-Action (VLA) models operating in complex 3D scenes. However, existing VLA memory mechanisms suffer from memory noise, particularly in complex 3D scenes, as stored episodic memories contain extensive redundant details about scene layouts, object configurations, and robot-specific states, which obscure generalizable manipulation principles and hinder cross-task transfer. To address this challenge, we first introduce a hippocampus-inspired memory consolidation mechanism that synthesizes …

BibTeX
@misc{zhao2026himem,
  title = {{HiMEM: Hippocampus-Inspired Memory Consolidation, Pruning, and Composition for Vision-Language-Action Models in 3D Scenes}},
  author = {Boran Zhao and Yanbin Hu and Jun Ye and Zhenxian Hu and Yuxin Zhai and Jin Cui and Pengju Ren},
  year = {2026},
  eprint = {2611.09355},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/2611.09355},
}
arXiv cs.LG 2026-11-09

Probably Safe Sim-to-Real Transfer with Lifetime Validity

Rohan Tangri, Jan-Peter Calliess

Abstract摘要

We present Dejavu, a method that makes sim-to-real transfer of reinforcement learning policies in constrained Markov decision processes probably safe over an unbounded sequence of policy updates. An anytime valid test using per-decision importance sampling and a betting confidence sequence certifies each candidate trained in simulation before deployment using only trajectories collected by a safe baseline policy operating in production. Simulation quality does not affect the safety guarantee, only the production sample efficiency of the method. Finally, a summable per-test failure probability …

BibTeX
@misc{tangri2026probably,
  title = {{Probably Safe Sim-to-Real Transfer with Lifetime Validity}},
  author = {Rohan Tangri and Jan-Peter Calliess},
  year = {2026},
  eprint = {2611.09344},
  archivePrefix = {arXiv},
  primaryClass = {cs.LG},
  url = {https://arxiv.org/abs/2611.09344},
}
arXiv cs.RO 2026-11-09

Horizon-Coupled Obstacle Guidance for Relative-Action Diffusion Policies

Guangyuan Wang, Haishan Xia, Zitao Zhang, Kejia Chen et al.

Abstract摘要

Real-world robot deployment requires adapting learned policies to unseen obstacles without collecting new demonstrations or retraining. Existing policy-level guidance often applies obstacle corrections independently at individual horizon steps, which may address local obstacle violations but fail to coordinate the action sequence into a complete, task-directed detour. How obstacle responses should be propagated across the action horizon to coordinate complete, task-directed avoidance motion remains underexplored. We introduce an inferencetime obstacle-guidance framework for pretrained …

BibTeX
@misc{wang2026horizon,
  title = {{Horizon-Coupled Obstacle Guidance for Relative-Action Diffusion Policies}},
  author = {Guangyuan Wang and Haishan Xia and Zitao Zhang and Kejia Chen and Yuanchen Sun and Zhenguo Sun and Donghao Zhang and Yu Zhang and others},
  year = {2026},
  eprint = {2611.09340},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09340},
}
arXiv cs.RO 2026-11-09 CoRL 2026

MDF++: Visuo-Tactile World Action Model with End-to-end Representation Learning

Zixuan Huang, Jinhao Yu, Zachary Charlick, Dmitry Berenson

Abstract摘要

Recently, world-action models (WAMs) have emerged as a powerful framework for robot manipulation. By jointly modeling action generation and future observation prediction, WAMs can act and anticipate the outcomes of the actions. However, existing WAMs typically rely on frozen pretrained encoders trained with reconstruction, which may not produce representations well suited for robot control. In this paper, we tackle the problem of learning physicallygrounded, control-relevant representations for WAMs. We propose MDF++, a visuo-tactile world-action model that learns latent representations of …

BibTeX
@misc{huang2026mdf,
  title = {{MDF++: Visuo-Tactile World Action Model with End-to-end Representation Learning}},
  author = {Zixuan Huang and Jinhao Yu and Zachary Charlick and Dmitry Berenson},
  year = {2026},
  eprint = {2611.09293},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09293},
}
arXiv cs.RO 2026-11-09

EGT: Execution-Grounded Traversability through Learned Closed-Loop Trajectory Distributions

Chinmay Mundane, Amith Manoharan, Arun Kumar Singh

Abstract摘要

Rough terrain traversability is often estimated through point-wise roll, pitch, or force-angle margins along a planned path. However, these metrics are often inaccurate and overly conservative because they ignore how terrain disturbances and low-level controller corrections can affect the vehicle's motions. To overcome these limitations, we introduce Execution-Grounded Traversability (EGT), defined as the probability that a vehicle-controller pair can execute a candidate path while meeting trajectory-level tracking and progress requirements. We estimate EGT by predicting the distribution of …

BibTeX
@misc{mundane2026egt,
  title = {{EGT: Execution-Grounded Traversability through Learned Closed-Loop Trajectory Distributions}},
  author = {Chinmay Mundane and Amith Manoharan and Arun Kumar Singh},
  year = {2026},
  eprint = {2611.09270},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09270},
}
arXiv cs.RO 2026-11-09

SUGARv2: Learning Diverse Visual Humanoid Loco-Manipulation Skills from Synthesized Interaction References

Tianshu Wu, Tianxiang Gui, Yue Chen, Tingxu Liu et al.

Abstract摘要

Scaling up visual humanoid loco-manipulation skill acquisition requires reducing the human effort needed as tasks and spatial configurations expand, particularly in demonstration collection and task-specific training design. We present SUGARv2, a unified framework for learning diverse visual humanoid loco-manipulation skills through interaction reference synthesis and a shared training pipeline. To obtain diverse references at low cost, we adapt reusable task templates to different spatial configurations, synthesizing coordinated robot and object motions. To reduce task-specific reward design …

BibTeX
@misc{wu2026sugarv,
  title = {{SUGARv2: Learning Diverse Visual Humanoid Loco-Manipulation Skills from Synthesized Interaction References}},
  author = {Tianshu Wu and Tianxiang Gui and Yue Chen and Tingxu Liu and Ziye Peng and Guangjie Yang and Xiangqi Kong and Ye Shi and others},
  year = {2026},
  eprint = {2611.09266},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09266},
}
arXiv cs.RO 2026-11-09

TPS-A*: Path Planning for Any-Shape Vehicles with Certified Collision Checking in Trajectory Parameter Space

Jose Luis Blanco-Claraco, Shravan S. Rai, Fernando Cañadas-Aránega, José Luis Torres-Moreno et al.

Abstract摘要

Global planners for ground vehicles usually approximate the vehicle by a disk, trading safety against conservativeness, while exact-footprint checking pays for every candidate motion, pose, and footprint edge. We present TPS-A*, a lattice planner whose edges are kinematically feasible trajectories from parameterized trajectory generators, built on certified collision checking in trajectory parameter space. A grid precomputed per footprint returns, in one pass over the local obstacles, a certified free distance along every candidate trajectory, so the per-node collision cost is independent of …

BibTeX
@misc{blancoclaraco2026tps,
  title = {{TPS-A*: Path Planning for Any-Shape Vehicles with Certified Collision Checking in Trajectory Parameter Space}},
  author = {Jose Luis Blanco-Claraco and Shravan S. Rai and Fernando Cañadas-Aránega and José Luis Torres-Moreno and José Carlos Moreno-Úbeda},
  year = {2026},
  eprint = {2611.09210},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09210},
}
arXiv cs.LG 2026-11-09

Augmentron: Scalable Multi-View Visual Augmentation for Robot Learning

Tanay Tandon, Aseem Doriwala, Jade Choghari, Catherine Weaver et al.

Abstract摘要

Robot policies trained on visually narrow demonstrations can become sensitive to environmental features that are unrelated to the task. Existing generative augmentation methods can introduce visual diversity, but processing every frame and camera view independently is computationally expensive and may produce inconsistent observations across cameras and timestamps. We introduce Augmentron, a geometry-aware pipeline that generates reusable scene representations and renders them through recorded camera poses. This produces temporally and multi-view consistent environ- ment and workspace …

BibTeX
@misc{tandon2026augmentron,
  title = {{Augmentron: Scalable Multi-View Visual Augmentation for Robot Learning}},
  author = {Tanay Tandon and Aseem Doriwala and Jade Choghari and Catherine Weaver and Pragna Mannam},
  year = {2026},
  eprint = {2611.09145},
  archivePrefix = {arXiv},
  primaryClass = {cs.LG},
  url = {https://arxiv.org/abs/2611.09145},
}
arXiv cs.CV 2026-11-09

TouchAnnotator: Multi-Source Tactile Supervision with Privileged-View Distillation

Ao Li, Zhihao Yuan, Chubin Zhang, Kunrui Huang et al.

Abstract摘要

Egocentric video captures human-object interaction at scale but rarely includes tactile labels for hidden contact and pressure. We introduce TouchAnnotator, an ego-only bimanual tactile annotator trained with multi-source tactile supervision and privileged-view distillation. A canonical hand field unifies glove pressure, geometry-derived human contact, and robot fingertip deformation from six datasets and three embodiments, while source-aware masks preserve valid targets. During training, an EMA teacher observes synchronized ego and wrist views and distills hand-local representations and …

BibTeX
@misc{li2026touchannotator,
  title = {{TouchAnnotator: Multi-Source Tactile Supervision with Privileged-View Distillation}},
  author = {Ao Li and Zhihao Yuan and Chubin Zhang and Kunrui Huang and Sheng Xu and Zengjue Chen and Junjie Wang and Jiawei Li and others},
  year = {2026},
  eprint = {2611.09129},
  archivePrefix = {arXiv},
  primaryClass = {cs.CV},
  url = {https://arxiv.org/abs/2611.09129},
}
arXiv cs.RO 2026-11-09

Safe Circumnavigation on Heterogeneous Orbits: A Range-Only HOCBF-QP Framework for Nonholonomic Multi-Agent Systems

Shubham Singh, Anand Singh, Anjali Tiwari, Lara Briñón-Arranz et al.

Abstract摘要

Circumnavigating a stationary target with a team of robots requires each robot to hold its own standoff distance, to stay evenly spaced from its neighbours, and to avoid collisions with the target and with each other at every instant. The task becomes arduous when the robots are assigned different orbital radii, as their sensors or roles may demand. This paper presents a safety-critical control framework for this problem. Each robot commands both its acceleration and its turn-rate, measures only its distance to the target, and exchanges information only with its two ring neighbours. The …

BibTeX
@misc{singh2026safe,
  title = {{Safe Circumnavigation on Heterogeneous Orbits: A Range-Only HOCBF-QP Framework for Nonholonomic Multi-Agent Systems}},
  author = {Shubham Singh and Anand Singh and Anjali Tiwari and Lara Briñón-Arranz and Katsuki Fujisawa},
  year = {2026},
  eprint = {2611.09112},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09112},
}
arXiv cs.RO 2026-11-09

Robust Readout of Cross-Point Resistive Arrays via Time-Domain Optimization

Taro Tako, Hiroshi Kaminaga, Taisuke Kobayashi

Abstract摘要

Cross-point resistive arrays are attractive for high-density tactile sensing because they reduce wiring complexity. However, conventional frequency-based readout methods can become inaccurate in robotic sensing environments, where long interconnects and measurement and environmental noise degrade the observed signals. We propose a time-domain optimization method for robust readout of cross-point resistive arrays. The method determines resistance values by fitting a time-domain observation model to the measured waveform over the interval, rather than relying solely on spectral amplitudes. By …

BibTeX
@misc{tako2026robust,
  title = {{Robust Readout of Cross-Point Resistive Arrays via Time-Domain Optimization}},
  author = {Taro Tako and Hiroshi Kaminaga and Taisuke Kobayashi},
  year = {2026},
  eprint = {2611.09059},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09059},
}
arXiv cs.RO 2026-11-09

When to Trust the BIM: Identifiability-Aware LiDAR-Inertial--BIM Fusion under As-Built Deviations

Yujie Zhang, Yuxuan Guo, Xinbao Sun, Chunlei Zhao et al.

Abstract摘要

Building information models (BIM) can provide a global geometric reference for robot localization with LiDAR-inertial odometry (LIO). However, as-built deviations from the as-designed model mean that a disagreement between a scan and the BIM may arise from a pose error, an offset wall surface (an as-built deviation or an unmodeled object in front of the wall), or a shifted room, and in some geometries these explanations produce identical observations. In this paper, we formalize this attribution problem as fault identification over three fault classes and derive a geometric criterion for when …

BibTeX
@misc{zhang2026when,
  title = {{When to Trust the BIM: Identifiability-Aware LiDAR-Inertial--BIM Fusion under As-Built Deviations}},
  author = {Yujie Zhang and Yuxuan Guo and Xinbao Sun and Chunlei Zhao and Langqi Miao and Xiaohui Jia and Jinyue Liu},
  year = {2026},
  eprint = {2611.09045},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09045},
}
arXiv cs.RO 2026-11-09

ToolDex: An Ego-Exo Human Demonstration Dataset for Creative Physical Tool Use

Mohamed Elmoghany, Kehan Li, Ruoqu Chen, Tarun Chiruvolu et al.

Abstract摘要

Creative tool use is a fundamental human capability and an important step toward general-purpose embodied intelligence. It requires agents to reason about object affordances, physical constraints, and manipulation strategies, especially when standard tools are unavailable. However, progress in this area is limited by the lack of real-world datasets that capture human tool-use behavior with sufficient scale, fidelity, and diversity. Existing benchmarks are often simulation-based, focus on simplified interactions, or lack detailed observations and annotations. We introduce ToolDex, a …

BibTeX
@misc{elmoghany2026tooldex,
  title = {{ToolDex: An Ego-Exo Human Demonstration Dataset for Creative Physical Tool Use}},
  author = {Mohamed Elmoghany and Kehan Li and Ruoqu Chen and Tarun Chiruvolu and Shutong Zhang and Ryan Wang and Stephen Tian and Yaru Niu and others},
  year = {2026},
  eprint = {2611.09036},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09036},
}
arXiv cs.RO 2026-11-09

A Controlled Study of Models, Skills, Feedback, and Curriculum in Agentic Robotics

Kaiyuan Chen, Xinyue Zhu, Shuangyu Xie, Uksang Yoo et al.

Abstract摘要

Agentic robotics asks coding agents to implement and iteratively improve robot policies from simulated and real-world physical interactions. We study the self-learning loop of agentic robotics through a controlled simulation study spanning nine manipulation tasks, 631 different experiment configurations, and 28K coding agent rollouts, systematically varying model capability, skill priors, feedback structure, and curriculum. The experiment data suggests that the bottleneck is often not the access to sufficient information, but interpreting it into the right policy update. Across these factors, …

BibTeX
@misc{chen2026controlled,
  title = {{A Controlled Study of Models, Skills, Feedback, and Curriculum in Agentic Robotics}},
  author = {Kaiyuan Chen and Xinyue Zhu and Shuangyu Xie and Uksang Yoo and Thi Thu Phuong Luong and Marcus Gualtieri and Christian Juette and Liu Ren and others},
  year = {2026},
  eprint = {2611.09030},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09030},
}
arXiv cs.RO 2026-11-09

FASTFUNNELS: Agile Multi Robot Navigation in Narrow Spaces via Adaptive Dynamic Funnels

Vignesh Rajagopal, Rohan Chandra

Abstract摘要

We focus on the problem of high-speed multi-robot navigation in cluttered spaces with tight spatial constraints. A key challenge is balancing safety with agility, as existing methods often trade one for the other (slowing down near a bottleneck to avoid collisions versus failing to swerve in time at high speeds), especially for car-like systems. Our approach belongs to the family of formation control methods, in which Ackermann-steering agents coordinate while navigating tight spaces. However, current formation control techniques rely on rigid, pre-defined shapes and transitions that depend …

BibTeX
@misc{rajagopal2026fastfunnels,
  title = {{FASTFUNNELS: Agile Multi Robot Navigation in Narrow Spaces via Adaptive Dynamic Funnels}},
  author = {Vignesh Rajagopal and Rohan Chandra},
  year = {2026},
  eprint = {2611.09005},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.09005},
}
arXiv cs.RO 2026-11-09

VLA Handover: Failure-Prediction-Based Switching from On-Robot to Server VLA Models

Takayuki Nishio

Abstract摘要

Large vision-language-action (VLA) models generalize well but are difficult to run in real time on a robot, and small VLAs that run there fail more often. Remote inference over beyond-5G and 6G networks lets a robot use a large VLA on a server, but querying the server for every action chunk limits the number of robots per server. We propose VLA handover: the robot runs a small VLA (S-VLA) and switches to a large VLA (L-VLA) on a server only when the S-VLA is likely to fail. We formulate the switching as minimizing the request cost under a required success probability and, since this problem …

BibTeX
@misc{nishio2026vla,
  title = {{VLA Handover: Failure-Prediction-Based Switching from On-Robot to Server VLA Models}},
  author = {Takayuki Nishio},
  year = {2026},
  eprint = {2611.08987},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08987},
}
arXiv cs.LG 2026-11-09 NeurIPS 2026

Ordered Policy Optimization

Dongkyu Derek Cho, Pan Xu

Abstract摘要

Proximal Policy Optimization (PPO) stabilizes policy updates by clipping the importance ratio between the new policy and the data-collecting policy. The standard rule uses one fixed clipping range for all samples. While this choice offers simplicity and effectiveness, it fails to distinguish statistically harmful extreme ratio values from large, yet tolerable changes. We study how to adapt the clipping radius to the reliability of the induced importance ratio distribution. Our case study demonstrates that reliable updates require controlling these extreme ratios, rather than merely verifying …

BibTeX
@misc{cho2026ordered,
  title = {{Ordered Policy Optimization}},
  author = {Dongkyu Derek Cho and Pan Xu},
  year = {2026},
  eprint = {2611.08936},
  archivePrefix = {arXiv},
  primaryClass = {cs.LG},
  url = {https://arxiv.org/abs/2611.08936},
}
arXiv cs.RO 2026-11-09

Wellness Robots and the Path to Full Autonomy

Mohammad H. Mahoor, Matthew Hessler, Lombe Chileshe, Ola Alsaadi et al.

Abstract摘要

This paper introduces the autonomous wellness robot as a distinct category of socially assistive system, defined by its capacity to continuously assess and respond across the seven ICAA dimensions of wellness (see Figure 2). We propose the Care Robot Autonomy Scale (CRAS): a six-level taxonomy (L0-L5) modeled on the automotive automation standard SAE J3016 and evaluated across four wellness-aligned dimensions. We present Ryan, developed initially at the University of Denver and commercialized by DreamFace Technologies, as a case study. NIH/NIA-funded longitudinal evidence (N = 18; 887 hours) …

BibTeX
@misc{mahoor2026wellness,
  title = {{Wellness Robots and the Path to Full Autonomy}},
  author = {Mohammad H. Mahoor and Matthew Hessler and Lombe Chileshe and Ola Alsaadi and Eshrat Emamian and Kerstin S. Haring and Richard M. Voyles},
  year = {2026},
  eprint = {2611.08930},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08930},
}
arXiv cs.RO 2026-11-09

HOC2R: Hand-Object Contact Trajectories for Human-to-Robot Motion Transfer

Hongkun Yu, Francisco M. López, Francisco Cruz

Abstract摘要

Human videos contain abundant object-manipulation demonstrations, but they do not directly provide motion cues that a robot can follow. We present HOC2R, a Hand-Object Contact trajectory extractor for Robot motion that combines frozen DINOv3 and SAM 2.1 features with learned heads for hand-object association and contact localization. HOC2R supports two modes: count-aware automation that detects, counts, and localizes visible contacts in untrimmed videos, and fixed-two localization for two-finger grippers when contact frames are known. On a 30-task point-annotated benchmark, count-aware …

BibTeX
@misc{yu2026hoc,
  title = {{HOC2R: Hand-Object Contact Trajectories for Human-to-Robot Motion Transfer}},
  author = {Hongkun Yu and Francisco M. López and Francisco Cruz},
  year = {2026},
  eprint = {2611.08920},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08920},
}
arXiv cs.RO 2026-11-09 NeurIPS 2026

PRISM: Primitive Routing via In-context Skill Mixing for Retentive VLA Adaptation

Jiachen Tao, Gengyu Zhang, Haoxuan Wang, Bing Liu et al.

Abstract摘要

Vision-Language-Action (VLA) models promise a single language-conditioned policy adaptable to many manipulation behaviors, yet deployment additionally requires skill retention and long-horizon composition: a policy must retain previously acquired skills and reuse them inside composite tasks whose behavior changes across phases. The standard recipe absorbs every new task into one shared update, which provides neither a parameter-level locus for reusable skills nor a mechanism for invoking each skill along the trajectory. We observe that this missing structure is latent rather than absent: …

BibTeX
@misc{tao2026prism,
  title = {{PRISM: Primitive Routing via In-context Skill Mixing for Retentive VLA Adaptation}},
  author = {Jiachen Tao and Gengyu Zhang and Haoxuan Wang and Bing Liu and Yan Yan},
  year = {2026},
  eprint = {2611.08917},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08917},
}
arXiv cs.RO 2026-11-09

HomeLoop: A Simulation Framework and Benchmark for Robot-IoT Coordination in Everyday Domestic Assistance and Safety

Ramy ElMallah, Marc Bishara, Hyegang Kim, Yuxi Zhang et al.

Abstract摘要

Recent progress in embodied robotics is bringing robots closer to deployment in homes, as vision-language models (VLMs) are demonstrating significant advances in reasoning, making VLM-driven robots promising home assistant agents. These agents will often be introduced into homes that already have cameras, Internet of Things (IoT) devices, and residents with wearables. To fulfill their potential, they need to integrate with existing smart infrastructure and reason through ambiguous scenarios: a smoke alarm may come from a pan about to ignite, a pan already on fire, a resident cooking or a …

BibTeX
@misc{elmallah2026homeloop,
  title = {{HomeLoop: A Simulation Framework and Benchmark for Robot-IoT Coordination in Everyday Domestic Assistance and Safety}},
  author = {Ramy ElMallah and Marc Bishara and Hyegang Kim and Yuxi Zhang and Chongyu Zhu and Chi-Guhn Lee},
  year = {2026},
  eprint = {2611.08914},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08914},
}
arXiv cs.RO 2026-11-09

Polarization calibration of fisheye cameras using skylight in the wild

Shuo Wang, Shiqi Che, Dianze Dong, Wenxin Liu

Abstract摘要

Skylight polarization provides directional cues for robotic navigation, but fisheye lens effects and analyzer imperfections can degrade polarization measurements across the field of view. We present a joint lens-analyzer calibration method that explicitly models incidence-dependent lens transmission together with analyzer gains and angular offsets in a unified eight-parameter formulation. Given known geometric calibration, rotations between camera frames can be estimated using visual features and cross-frame directional polarized light consistency can be used for polarization calibration. …

BibTeX
@misc{wang2026polarization,
  title = {{Polarization calibration of fisheye cameras using skylight in the wild}},
  author = {Shuo Wang and Shiqi Che and Dianze Dong and Wenxin Liu},
  year = {2026},
  eprint = {2611.08911},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08911},
}
arXiv cs.RO 2026-11-09

FATHOM: World-Model-Guided Diffusion Action-Trajectory Selection for Sparse-Marker AUV Tracking

Xiaorui Wang, Zeyu Sha, Mingyang Yang, David Chen Wang et al.

Abstract摘要

Reliable relative tracking is fundamental to cooperative autonomous underwater vehicles (AUVs), yet remains challenging under nonlinear vehicle dynamics and degraded underwater visual conditions. Active light markers improve robustness to appearance variation, but provide deliberately sparse observations that can become incomplete or corrupted by occlusion, reflections, and detection noise during dynamic motion. To address the resulting partial-observation control problem, this paper proposes FATHOM, a world-model-guided diffusion action-trajectory selection framework for sparse-marker AUV …

BibTeX
@misc{wang2026fathom,
  title = {{FATHOM: World-Model-Guided Diffusion Action-Trajectory Selection for Sparse-Marker AUV Tracking}},
  author = {Xiaorui Wang and Zeyu Sha and Mingyang Yang and David Chen Wang and Feitian Zhang},
  year = {2026},
  eprint = {2611.08898},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08898},
}
Underwater / marine水下 / 海洋
arXiv cs.RO 2026-11-09

Localizing and Editing the Goal Representation of a Vision-Language-Action Model

Sudhanshu Srivastava, Faisal Aqlan

Abstract摘要

Operators can state safety constraints for robots as prohibitions such as "do not put the bowl on the stove". We study whether OpenVLA follows such prohibitions and where it represents the goal it executes. The 10 tasks of LIBEROGoal share one scene, so we can label the goal that each rollout executes. We combine closed-loop rollouts with activation patching, linear probes, activation steering and runtime monitors. On LIBERO-Goal, negation had no detectable effect on which task OpenVLA executed. The model executed the forbidden task in 79% of negated rollouts and completed 78% of plain tasks. …

BibTeX
@misc{srivastava2026localizing,
  title = {{Localizing and Editing the Goal Representation of a Vision-Language-Action Model}},
  author = {Sudhanshu Srivastava and Faisal Aqlan},
  year = {2026},
  eprint = {2611.08895},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08895},
}
arXiv cs.RO 2026-11-09

What Limits mmWave Human-State Sensing for Robot Perception?

Shuntian Zheng, Guangming Wang, Hongyang He, Shuai He et al.

Abstract摘要

Assistive robots and search-and-rescue platforms require reliable human state sensing in smoke, darkness, and privacy-sensitive environments, where cameras and LiDAR may be unreliable Millimeter-wave radar offers an alternative that works without ambient light, penetrates smoke, and does not capture visual appearance. However, the compact arrays that fit robot size, power, and cost budgets have limited apertures, producing joint-localization errors on the order of decimeters at a few meters, large enough to compromise the safety margins and tracking accuracy a robot depends on. Existing …

BibTeX
@misc{zheng2026what,
  title = {{What Limits mmWave Human-State Sensing for Robot Perception?}},
  author = {Shuntian Zheng and Guangming Wang and Hongyang He and Shuai He and Yu Guan},
  year = {2026},
  eprint = {2611.08863},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08863},
}
arXiv cs.RO 2026-11-09

STRIDE: Learning Humanoid Locomotion in Minutes with Acceleration-Based Rewards

Nico Bohlinger, Jan Peters

Abstract摘要

Learning locomotion directly on a humanoid robot is a promising direction to avoid the sim-to-real gap. However, locomotion rewards in Reinforcement Learning (RL) typically track the base velocity, which cannot be measured onboard without an external motion capture system or well-calibrated state estimator. This is why we introduce \method{}, which learns humanoid locomotion from minutes of samples with a reward that only requires the onboard Inertial Measurement Unit (IMU). Instead of tracking the base velocity, STRIDE rewards the robot for following a commanded acceleration profile. To …

BibTeX
@misc{bohlinger2026stride,
  title = {{STRIDE: Learning Humanoid Locomotion in Minutes with Acceleration-Based Rewards}},
  author = {Nico Bohlinger and Jan Peters},
  year = {2026},
  eprint = {2611.08857},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08857},
}
arXiv cs.RO 2026-11-09

ActPrune: Action-Grounded Visual Token Pruning for Efficient Vision-Language-Action Models

Sungwon Moon, Minji Kim, Hyemin Boo, Daeun Song et al.

Abstract摘要

Vision-language-action (VLA) models perform versatile manipulation tasks from language instructions, but their inference cost limits how fast a robot can respond in closed-loop control. Visual token pruning reduces this cost; however, prior methods estimate token redundancy from encoded visual embeddings or attention, only after the visual encoder has processed the entire observation. We propose \ours, a training-free token pruning method that moves the pruning decision ahead of the vision encoder by grounding it in a geometric prior derived from the robot's own action. The action chunk …

BibTeX
@misc{moon2026actprune,
  title = {{ActPrune: Action-Grounded Visual Token Pruning for Efficient Vision-Language-Action Models}},
  author = {Sungwon Moon and Minji Kim and Hyemin Boo and Daeun Song and Jiyoung Lee},
  year = {2026},
  eprint = {2611.08827},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08827},
}
arXiv cs.RO 2026-11-09

It Takes Two to Tangram: Multi-Agent Object Centric Reinforcement Learning for Assembly

Paul Knaußt, Kay Pompetzki, Nico Bohlinger, Niklas Funk et al.

Abstract摘要

Geometric assembly requires fine spatiotemporal coordination to place parts without causing collisions or deadlocks under tight clearances. To address this, we present an object-centric reinforcement learning framework that treats each part as an agent and learns a shared policy for continuous assembly control. A graph neural network represents the pieces, their target poses, and their spatial relationships, and predicts translational and angular velocities for each component. Per-agent proximal policy optimization with a centralized graph critic directly learns motion and temporal …

BibTeX
@misc{knaut2026it,
  title = {{It Takes Two to Tangram: Multi-Agent Object Centric Reinforcement Learning for Assembly}},
  author = {Paul Knaußt and Kay Pompetzki and Nico Bohlinger and Niklas Funk and Cristiana de Farias and Rolf Findeisen and Jan Peters},
  year = {2026},
  eprint = {2611.08814},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08814},
}
arXiv cs.RO 2026-11-09

VICTR: Value-Informed In-Context Learning for Vision-Language-Action Models

Luca Macesanu, Tianluo Zhang, Aditya Patil, Archit Sharma et al.

Abstract摘要

Recent advances in robot foundation models have highlighted the potential of in-context learning (ICL) for adapting robot behavior from demonstrations without further fine-tuning. Previous work has used retrieval-based post-training to equip pretrained vision-language-action (VLA) models with the capability for ICL by teaching them to condition action predictions on retrieved visually-relevant demonstration chunks. However, the effectiveness of retrieval hinges on selecting context relevant to the current execution stage, which visual similarity alone may not capture. We introduce VICTR, a …

BibTeX
@misc{macesanu2026victr,
  title = {{VICTR: Value-Informed In-Context Learning for Vision-Language-Action Models}},
  author = {Luca Macesanu and Tianluo Zhang and Aditya Patil and Archit Sharma and Kevin Angers and Christopher M. Clark and Chen Feng and Juexiao Zhang},
  year = {2026},
  eprint = {2611.08698},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08698},
}
arXiv cs.RO 2026-11-09

National and State-Level Approaches to Automated Vehicle Certification: A Comparative Framework for State Operational Governance

Sk Nahia Ahsan, Md Abdullah Al Hasan, Danjue Chen, George List

Abstract摘要

Automated vehicle (AV) deployment in the United States is expanding without a unified federal certification framework, leading to substantial variation in how states authorize and oversee AV testing and deployment. This paper examines how U.S. states regulate Society of Automotive Engineers (SAE) Level 4-5 automated driving systems (ADS), identifies common certification approaches, compares them with international practices, and evaluates the implications for North Carolina's future regulatory strategy. Publicly available state statutes, administrative regulations, agency guidance, and …

BibTeX
@misc{ahsan2026national,
  title = {{National and State-Level Approaches to Automated Vehicle Certification: A Comparative Framework for State Operational Governance}},
  author = {Sk Nahia Ahsan and Md Abdullah Al Hasan and Danjue Chen and George List},
  year = {2026},
  eprint = {2611.08681},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08681},
}
arXiv cs.RO 2026-11-09

ForPC: Force-Aware Whole-Body Control for Precise Humanoid Cart Pushing

ZhenYu Zou, Xing Liu, ShiChuang Wang, YunLong Dong et al.

Abstract摘要

Humanoid robots are expected to take over strenuous material handling in manufacturing, logistics, and healthcare, where operating existing wheeled carts would let them move heavy loads without modifying the workplace. However, humanoid cart pushing remains challenging because the bimanual grasp closes a force-coupled loop in which the contact wrenches that drive the cart also disturb the robot's balance, and payload changes alter the coupled dynamics. We propose ForPC, a force-aware whole-body control framework that regulates cart velocity through two-stage reinforcement learning. A …

BibTeX
@misc{zou2026forpc,
  title = {{ForPC: Force-Aware Whole-Body Control for Precise Humanoid Cart Pushing}},
  author = {ZhenYu Zou and Xing Liu and ShiChuang Wang and YunLong Dong and LiNan Deng and Feng Hua and Jun Wan and Cheng Cheng},
  year = {2026},
  eprint = {2611.08664},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08664},
}
arXiv cs.RO 2026-11-09 NeurIPS 2026

HaNDF: Object-Conditioned Geometric Neural Hand Distance Fields

Zuhao Liu, Melih Darcan, Zhengdi Yu, Riza Alp Guler et al.

Abstract摘要

We propose, HaNDF, object-conditional neural distance fields as data-driven priors for modeling the plausible hand-object configurations, in the product manifold of hand articulations. While recent unconditional generative priors showed success in modeling human pose, hands are versatile articulated bodies often found in interaction with other objects. This makes it crucial to develop a generative prior which can model the plausible hand poses conditioned on the object under interaction. To this end, our HaNDF proposes a geometry-aware, object-conditioned neural distance field, representing …

BibTeX
@misc{liu2026handf,
  title = {{HaNDF: Object-Conditioned Geometric Neural Hand Distance Fields}},
  author = {Zuhao Liu and Melih Darcan and Zhengdi Yu and Riza Alp Guler and Tolga Birdal},
  year = {2026},
  eprint = {2611.08578},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08578},
}
arXiv cs.RO 2026-11-09 CoRL 2026

Q-OIL: Optimistic Exploration in Learning from Human Interventions

Pranav Teegavarapu, Sriyash Poddar, Rico Qi, Cleah Winston et al.

Abstract摘要

As robots are deployed in the real world, they will inevitably make mistakes. Human interventions provide valuable feedback for improving their behavior, enabling them to adapt online to new scenarios. However, studying human-in-the-loop robot learning is difficult: real-world experiments are slow and expensive, so most algorithm development relies on simulated human models. We show that common human modeling assumptions do not match how real people intervene in practice. Through analyzing intervention data from human participants, we find that humans tend to intervene when agent progress …

BibTeX
@misc{teegavarapu2026q,
  title = {{Q-OIL: Optimistic Exploration in Learning from Human Interventions}},
  author = {Pranav Teegavarapu and Sriyash Poddar and Rico Qi and Cleah Winston and Krisha Khandelwal and Aykut Onyol and Natasha Jaques and Abhishek Gupta},
  year = {2026},
  eprint = {2611.08576},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.08576},
}

← 2026-11-06 2026-11-10 →

All days按日期浏览