Off-Policy RL with Online Inference Tuning: My Solution to the CoRL 2026 RoboEval Challenge

Challenge report: a π0.5 policy that is its own critic, trained off-policy on the exact score; Thompson sampling tunes ~20 inference settings; adds generated and recovery demos. Reports 0.987 RDS.比赛技术报告：基于 π0.5 的策略同时充当价值函数，直接以官方评分做离策略 RL，每次 rollout 用 Thompson 采样调约 20 个推理参数，并加入生成示范与失败恢复数据。官方种子上报告 0.987 RDS。

@misc{larchenko2026off,
  title = {{Off-Policy RL with Online Inference Tuning: My Solution to the CoRL 2026 RoboEval Challenge}},
  author = {Ilia Larchenko},
  year = {2026},
  eprint = {2611.11464},
  archivePrefix = {arXiv},
  primaryClass = {cs.RO},
  url = {https://arxiv.org/abs/2611.11464},
}