From 6f0fac534577f4a5a46ce7fe4bc7c0cde12405ae Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Adam=20=C5=A0t=C4=9Bp=C3=A1nek?= Date: Sun, 7 Jan 2024 01:52:14 +0100 Subject: [PATCH] Fix a mistake in pv021/trenink Thanks, Kuba! --- pv021/trenink.ad | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pv021/trenink.ad b/pv021/trenink.ad index b64a43e..00256d1 100644 --- a/pv021/trenink.ad +++ b/pv021/trenink.ad @@ -345,7 +345,7 @@ NOTE: Uvědom si, že tyhle stem:[\color{red}\frac{\partial E_k}{\partial y_j}] 3. backward pass -- od konce pro každou vrstvu spočítej stem:[\frac{\partial E_k}{\partial y_j}] a. pokud stem:[j \in Y], pak stem:[\frac{\partial E_k}{\partial y_j} = y_j - d_{kj}] b. pokud stem:[j \in Z \setminus Y \cup X ], a stem:[j] je v stem:[l]-té vrstvě, pak - stem:[\frac{\partial E_k}{\partial y_j} = \sum_{r \in j^{\rightarrow}} \frac{\partial E_k}{\partial y_j} \cdot \sigma'_r(\xi_r) \cdot w_{rj}] + stem:[\frac{\partial E_k}{\partial y_j} = \sum_{r \in j^{\rightarrow}} \frac{\partial E_k}{\partial y_r} \cdot \sigma'_r(\xi_r) \cdot w_{rj}] 4. weight update -- pro všechna stem:[w_{ji}] spočítej stem:[\frac{\partial E_k}{\partial w_{ji}} := \frac{\partial E_k}{\partial y_j} \cdot \sigma'_j(\xi_j) \cdot y_i] 5. stem:[\varepsilon_{ji} := \varepsilon_{ji} + \frac{\partial E_k}{\partial w_{ji}}]