Diffusion Policy Policy Optimization
DPPO — fine-tunes a pre-trained diffusion policy with PPO by treating the denoising steps as part of the MDP; reports stable gains over other RL fine-tuning methods and sim-to-real transfer.DPPO：把去噪步骤视为 MDP 的一部分，用 PPO 微调预训练扩散策略；报告称比其他强化学习微调方法更稳定，并实现了仿真到真机迁移。
BibTeX
@misc{ren2024diffusion,
title = {{Diffusion Policy Policy Optimization}},
author = {Allen Z. Ren and Justin Lidard and Lars L. Ankile and Anthony Simeonov and Pulkit Agrawal and Anirudha Majumdar and Benjamin Burchfiel and Hongkai Dai and Max Simchowitz},
year = {2024},
eprint = {2409.00588},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2409.00588},
}Robot Learning: RL & Imitation机器人学习：强化学习与模仿学习Manipulation & Dexterous Hands操作与灵巧手rldiffusion-policyfine-tuningsim-to-real