[AMR] Many learnings from exercises

This commit is contained in:
2026-08-03 15:50:56 +02:00
parent d50e6bd547
commit a106331872
21 changed files with 81 additions and 38 deletions
@@ -21,7 +21,7 @@ Then update: $Q_{i + 1}(\vec{x}, \vec{u}) = (1 - \alpha)Q_i(\vec{x}, \vec{u}) +
Called off-policy learning, needs exploration. Simplest is random actions ($\varepsilon$-greedy):
$\varepsilon$ is prob. to act randomly, $1 - \varepsilon$ is prob. to act on pol. {\color{red} Space explored, still doing random stuff}
\bi{Approaches}
\bi{DL-Approaches}
\textit{Model-based} (estimate trans. model, e.g. Dyna),
Value-based (estimate val or $Q$-func and extract pol., e.g. Q-Learn),
Actor-Critic (estim. val or $Q$ of curr. pol., improve pol., e.g. A3C, SAC),