Conservative Q-Learning for Offline Reinforcement Learning
CQL — penalizes Q-values on actions outside the dataset so the learned value is a lower bound; a standard offline-RL baseline for learning from fixed robot logs.CQL：压低数据集外动作的 Q 值，使学到的价值成为下界；是从固定机器人日志中学习的标准离线强化学习基线。
BibTeX
@misc{kumar2020conservative,
title = {{Conservative Q-Learning for Offline Reinforcement Learning}},
author = {Aviral Kumar and Aurick Zhou and George Tucker and Sergey Levine},
year = {2020},
eprint = {2006.04779},
archivePrefix = {arXiv},
primaryClass = {cs.LG},
url = {https://arxiv.org/abs/2006.04779},
}