PyTorch and automatic differentiation

Abstract

I will explain automatic differentiation for the gifted amateur and how to use it in the PyTorch framework. You don't have to know the PyTorch framework but some experience with NumPy could help to follow the tutorial session. I would like to keep the session interactive but you will not need to run code on your laptops. Instead, I will present code snippets, discuss them and thus introduce some common pitfalls when using PyTorch. In the end I hope that you understand better what happens behind the curtain of PyTorch (and other autodiff libraries), helping you to more effectively debug your every day code.