Reverse mode AD / backprop: explanation, Julia example, and custom rules
HTML-код
- Опубликовано: 11 сен 2024
- Describe basics of how reverse-mode AD (or backprop) works. Derived a couple of examples from scalars to matrices. Then jumped into code using ReverseDiff in Julia. Showed a common type issue and how to resolve. Then showed how to create your own custom rule.