계산그래프에서의 미분 derivatives on computational graphs ¶
See https://colah.github.io/posts/2015-08-Backprop/ 30% 쯤 Derivatives on Computational Graphs
미분,differentiation이 두가지
forward-mode differentiation $\displaystyle \frac{\partial}{\partial X}$
reverse-mode differentiation $\displaystyle \frac{\partial Z}{\partial}$
미분,differentiation이 두가지
forward-mode differentiation $\displaystyle \frac{\partial}{\partial X}$
reverse-mode differentiation $\displaystyle \frac{\partial Z}{\partial}$
... forward reverse mode differentiation forward reverse mode differentiation forward reverse mode differentiation