rl-Convergence and divergence
rl-Convergence and divergence
Convergence Questions
Convergence of MC
Convergence of TD
Theorem:
TD is not a gradient
Example of divergence
use TD only on this transition
Residual Bellman updates
Title:
Author: wy
Created at
: 2023-07-23 16:35:14**Updated at :** 2023-07-23 16:41:31**Link:** https://yuuee-www.github.io/blog/2023/07/23/RL/step6/RLstep6/** License: ** This work is licensed under [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0). [Prev posts](/2023/07/23/RL/step7/RLstep7/) [Next posts](/2023/07/23/RL/step5/RLstep5/) Comments On this page
-
© 2022 - 2024 [wy](/) 24 posts in total VISITOR COUNT TOTAL PAGE VIEWS POWERED BY [Hexo](https://hexo.io) THEME [Redefine v2.6.4](https://github.com/EvanNotFound/hexo-theme-redefine) Blog up for days hrs Min Sec
-
-
-
-
-
-
-
- Title: rl-Convergence and divergence
- Author: wy
- Created at : 2023-07-23 08:35:14
- Updated at : 2023-07-23 08:41:31
- Link: https://yue-ruby-w.site/2023/07/23/2023-07-23-RL-step6-RLstep6/
- License: This work is licensed under CC BY-NC-SA 4.0.