DEEP LEARNING AND ADVANCED AI - 2022/3

Module Overview

Deep learning has shown its success in many areas including computer vision, speech and audio processing, natural language processing, robotics, bioinformatics and chemistry, video games, search engines, online advertising and finance. Deep learning is a particular kind of machine learning technique that allows computer systems to improve with experience and data, and achieves great power and flexibility by learning to represent the world as a nested hierarchy of concepts. In recent years, deep learning has seen tremendous growth in its popularity and usefulness, due in large part to more powerful computers, larger datasets and techniques to train deeper networks.

This module introduces a wide range of deep learning and other state of art techniques in AI for solving real world problems. Basic concepts on statistics and applied maths that thread through key elements in machine learning techniques will be discussed throughout the module. Students will study how to build suitable AI systems that can operate in complicated, real-world environments. The module also prepares students to explore further challenges and opportunities to improve deep learning and AI and bring them to new frontiers.

 

Module provider

Computer Science and Electronic Eng

Module Leader

TANG H Lilian (CS & EE)

Number of Credits: 15

ECTS Credits: 7.5

Framework: FHEQ Level 6

Module cap (Maximum number of students): N/A

Module Availability

Semester 2

Prerequisites / Co-requisites

COM2028 Introduction to Artificial Intelligence; background in Linear algebra and probability will be helpful.

Module content

• 
  Vectors and Matrices
  
  
  
  
  • 
    Linear Algebra Basics
    
  
  
  • 
    Data Representation
    
  
  
  • 
    Non-Negative Matrix Factorization
    
  
  
  • 
    Application Examples: Collaborative Filtering, Finding Similar Users, Recommending Items
    
  
  
  
  


• 
  Data Visualisation
  
  
  
  
  • 
    Principle component analysis (PCA)
    
  
  
  • 
    Mutidimensional Scaling
    
  
  
  • 
    t-Distributed Stochastic Neighbour Embedding (t-SNE)
    
  
  
  • 
    Application Examples: Visualising High Dimensional Data
    
  
  
  
  


• 
  Machine Learning Basics
  
  
  
  
  • 
    Learning Algorithms
    
  
  
  • 
    Overfitting and Underfitting
    
  
  
  • 
    Hyperparameter and Cross Validation
    
  
  
  • 
    Linear Regression and Stochastic Gradient Decent
    
  
  
  
  


• 
  Convolutional Neural Network (CNN)
  
  
  
  
  • 
    CNN architecture
    
  
  
  • 
    Convolution Layer, Pooling and Fully Connected Layers
    
  
  
  • 
    Activation Functions
    
  
  
  • 
    Application Examples: Object Recognition in Visual Data, Search Engine
    
  
  
  
  


• 
  Recurrent neural networks (RNN)
  
  
  
  
  • 
    Deep RNN
    
  
  
  • 
    Long Short Term Memory (LSTM)
    
  
  
  • 
    Application examples: Generating Text, Image Captioning, Speech Recognition, sentiment analysis
    
  
  
  
  


• 
  Autoencoder and Restricted Boltzmann Machines
  
  
  
  
  • 
    Denoising Autoencoder
    
  
  
  • 
    Deep Boltzmann Machines and Deep Belief Networks
    
  
  
  • 
    Application Examples: Dimensionality Reduction, Classification, Collaborative Filtering, 
    
  
  
  
  


• 
  Reinforcement Learning (RL)
  
  
  
  
  • 
    Key Elements in Reinforcement Learning
    
  
  
  • 
    Deep Reinforcement Learning
    
  
  
  • 
    Application Examples: Stunt Manoeuvres in a Helicopter, Play Chess, Manage an Investment Portfolio, Make a humanoid robot walk, Play many different Atari games better than humans
    
  
  
  
  

Current Research

Assessment pattern

Alternative Assessment

N/A

Assessment Strategy

The assessment strategy is designed to provide students with the opportunity to demonstrate that they have achieved the module learning outcomes.

Thus, the summative assessment for this module consists of:

• 
  Completion of lab assignments.
  
  Deadlines: All lab assignments are due in week 8 or during the Easter break. However, students are encouraged to submit individual assignment regularly to SurrreyLearn in order to receive timely feedback from the lecturer. A diagnostic test based on all lab assignments will be available on SurreyLearn in week8. Students will have a minimum 10 days to complete the test.  See the detailed dates on SurreyLearn.
  


• 
  Coursework project: deliverables will be in the form of a poster and the demonstration of the developed work. Due: week 10 - week 12.
  

Formative assessment and feedback:

Between week 1-7, students will be guided to work on lab exercises and are encouraged to submit their work regularly through SurreyLearn in order to receive individual feedback. Students will be able to complete the coursework project successfully once the foundation of the coursework is built through lab exercises. The discussion on coursework will start from week 5 leading up to its completion date. Individual Feedback on the coursework project will be given as soon as possible within two weeks or before the exam whichever is sooner. Students will be able to gauge their progress through these feedbacks at different stages.

 

Module aims

• The module aims to show students the state of art in the field of Artificial Intelligence. It will cover a variety of approaches in the context of deep learning and demonstrate how to build intelligence systems for various practical applications.

Learning outcomes

Methods of Teaching / Learning

The module will develop analytical skills and the understanding of the subject area through:

• Lectures

• In-class discussion

The module will develop practical skills through:

• Lab sessions

• Coursework

All activities will be co-ordinated via the module webpage on the Surrey Learn.

Indicated Lecture Hours (which may also include seminars, tutorials, workshops and other contact time) are approximate and may include in-class tests where one or more of these are an assessment on the module. In-class tests are scheduled/organised separately to taught content and will be published on to student personal timetables, where they apply to taken modules, as soon as they are finalised by central administration. This will usually be after the initial publication of the teaching timetable for the relevant semester.

Reading list

https://readinglists.surrey.ac.uk
Upon accessing the reading list, please search for the module using the module code: COM3025

Other information

Digital Capabilities

Artificial Intelligence is one of the British government’s key strategy pillars. The advanced AI skills taught in this module provide students digital skills that are fundamental to solving many computer science problems today. Deep Learning is currently being used in many industries to solve problems such as speech recognition. The techniques learned in this module give student the theory and the practical experience to design and build systems that use these techniques to identify patterns in large datasets. These skills are highly valued in industry.

Employability

This module provides advanced AI, and software skills that are important in solving a many real-life problems today. The theoretical underpinning provides students with an understanding of how the algorithm works. The practical skills taught in labs build from COM2028 (Artificial Intelligence) and allow students to develop the Deep Learning solutions to problems. Students are equipped with practical problem-solving skills, theoretical skills, and mathematical and statistical skills, all of which are highly valuable to employers.

Global and Cultural Skills

Computer Science is a global language and the tools and languages used on this module can be used internationally. This module allows students to develop skills that will allow them to reason about and develop applications with global reach and collaborate with their peers around the world.

Resourcefulness and Resilience

This module involves practical problem-solving skills that teach a student how to reason about and solve new unseen problems through combining the theory taught with practical technologies for systems that are in everyday use. These problems often involve large and complex datasets and the techniques taught in this module will allow students to develop practical solutions to analyse these datasets using cutting edge techniques.

Programmes this module appears in

Please note that the information detailed within this record is accurate at the time of publishing and may be subject to change. This record contains information for the most up to date version of the programme / module for the 2022/3 academic year.