Benchmarking Real-World Robotic Manipulation through Stochastic Challenges
'Stochastic challenges': reproducible real scenes with tasks sampled from a shared distribution, so robots in different labs compare by success rate like a hidden test set. Shown with two robots in two labs.提出“随机挑战”评测范式:可复现的真实场景 + 从同一分布随机抽取任务,让不同实验室的机器人能像隐藏测试集一样按成功率比较。在一个移动操作基准上用两个实验室的两台机器人做了演示。
BibTeX
@misc{glaer2026benchmarking,
title = {{Benchmarking Real-World Robotic Manipulation through Stochastic Challenges}},
author = {Elias Gläßer and Gülhan Şikaroğlu and Pavlo Kupyn and Marc Pollefeys and Zuria Bauer and Hermann Blum},
year = {2026},
eprint = {2611.12804},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2611.12804},
}Datasets & Benchmarks数据集与基准Manipulation & Dexterous Hands操作与灵巧手benchmarkreal-worldreproducibilitymobile-manipulation