Tutorial: Introduction to Neural Networks

Abstract

This tutorial will give an introduction into neural networks and the basics of deep learning. After a short review of basic machine learning techniques (supervised learning, classification, lossfunction and optimizers), the mathematical background of neural networks will be covered, including multilayer perceptrons, gradient descent and backpropagation. These concepts will be introduced in the context of logistic regression, which itself comprises a well known machine learning modell. Practical application of neural networks will be illustrated on the well known example of hand-written number recognition.