Introduction to Deep Learning - Online

Description:

This is a hands-on introduction to the first steps in Deep Learning, intended for researchers who are familiar with (non-deep) Machine Learning.  This introduction aims to cover the basics of Deep Learning in a practical and hands-on manner, so that upon completion, you will be able to train your first neural network and understand what next steps to take to improve the model. 

The course covers: 

• What is deep learning?

• Classification by a neural network using Keras

• Monitor the training progress

• Advanced layer types

• Real world application

Learning Outcomes:

Introduction 

• Define deep learning
• Describe how a neural network is build up
• Explain the operations performed by a single neuron
• Describe what a loss function is
• Recall the sort of problems for which deep learning is a useful tool
• List some of the available tools for deep learning
• Recall the steps of a deep learning workflow
• Test that you have correctly installed the Keras, Seaborn and scikit-learn libraries
• Use the deep learning workflow to structure the notebook

Classification by a neural network using Keras

• Explore the dataset using pandas and seaborn
• Identify the inputs and outputs of a deep neural network.
• Use one-hot encoding to prepare data for classification in Keras
• Describe a fully connected layer
• Implement a fully connected layer with Keras
• Use Keras to train a small fully connected network on prepared data
• Interpret the loss curve of the training process
• Use a confusion matrix to measure the trained networks’ performance on a test set

Monitor the training process

• Explain the importance of keeping your test set clean, by validating on the validation set instead of the test set
• Use the data splits to plot the training process
• Explain how optimization works
• Design a neural network for a regression task
• Measure the performance of your deep neural network
• Interpret the training plots to recognize overfitting
• Use normalization as preparation step for deep learning
• Implement basic strategies to prevent overfitting

Advanced layer types

• Understand why convolutional and pooling layers are useful for image data
• Implement a convolutional neural network on an image dataset
• Use a dropout layer to prevent overfitting
• Be able to tune the hyperparameters of a Keras model

Transfer learning

• Adapt a state-of-the-art pre-trained network to your own dataset

Outlook

• Understand that what we learned in this course can be applied to real-world problems
• Use best practices for organising a deep learning project
• Identify next steps to take after this course

Pre-requisites:

Learners are expected to have the following knowledge:

• Basic Python programming skills and familiarity with the Pandas package.
• Basic knowledge on machine learning, including the following concepts: Data cleaning, train & test split, type of problems (regression, classification), overfitting & underfitting, metrics (accuracy, recall, etc.).

Setup Instructions

Please follow the setup instructions here: https://carpentries-lab.github.io/deep-learning-intro/index.html#software-setup 

Note that software installation can take some time.  Please set up your python environment at least a day in advance of the workshop. If you encounter problems with the installation procedure, ask your workshop organizers via email for assistance so you are ready to go as soon as the workshop begins.

Programme

• What is deep learning?

• Classification by a neural network using Keras

• Monitor the training progress

• Advanced layer types

• Real world application

This course is taking place on 15-17 September from 09:00 - 17:00.

 

Cost:

The fee is:

• £60 per day for students registered at university
• £150 per day for staff at academic institutions, Research Councils researchers, public sector staff and staff at registered charity organisations and recognised research institutions
• £350 per day for all other participants.

In the event of cancellation by the delegate a full refund of the course fee is available up to two weeks prior to the course. NO refunds are available after this date.

If it is no longer possible to run a course due to circumstances beyond its control, NCRM reserves the right to cancel the course at its sole discretion at any time prior to the event. In this event every effort will be made to reschedule the course. If this is not possible or the new date is inconvenient a full refund of the course fee will be given. NCRM shall not be liable for any costs, losses or expenses that may be incurred as a result of its cancellation of a course, including but not limited to any travel or accommodation costs.

The University of Southampton’s Online Store T&Cs also continue to apply.

Website and registration:

Register for this course

Region:

South East

Keywords:

Quantitative Data Handling and Data Analysis, ICT and Software, Python, Technology, Machine Learning, Deep Learning, Neural Networks

Related publications and presentations from our eprints archive:

Quantitative Data Handling and Data Analysis
ICT and Software
Python
Technology

Back to the training database