AUDIO AND VIDEO PROCESSING - 2022/3

Module Overview

Expected prior learning: Mathematics equivalent to Year 2 of EEE Programmes.

Module purpose: Using lectures and examples, this module will provide the fundamental concepts needed to understand the operation of modern media processing and transmission systems delivering high quality audio-visual content.

Module provider

Computer Science and Electronic Eng

Module Leader

WANG Wenwu (CS & EE)

Number of Credits: 15

ECTS Credits: 7.5

Framework: FHEQ Level 6

Module cap (Maximum number of students): N/A

Module Availability

Semester 2

Prerequisites / Co-requisites

None.

Module content

Topics will include 2D and 3D audio-visual content capture, compression, transmission, adaptation, media quality evaluation, and users’ experience. Indicative content includes the following.

 

Part A – Audio processing

[1-2]     Characteristics of speech and audio signals, and audio processing chain.

[3-4]     Principles of audio capture and coding methods. Need for source compression. Definition of quantisation. Scalar and vector quantisation.

[5-6]  Probability density function, auto-correlation, cross-correlation, stationarity etc.

[7-9]     Fundamental methods of speech processing. Voiced and unvoiced speech. Effects of windowing. Short and long term modelling of speech.

[10-12] Simple coding methods (PCM, APCM, ADPCM). Analysis and Synthesis coding methods. Analysis by synthesis coding methods. Harmonic coding.

[13-14] Audio reproduction formats and coding technologies, and spatial audio and 3D audio systems. File formats and standards.

[15]      Perceptual evaluation of audio quality

 

Part B – Video processing

[1-2]     Introduction to 2D-3D video applications and systems

[3-5]     Video capture and coding principles. Image and video formats. Spatial and temporal redundancy. DCT. Motion estimation and compensation. Coding complexity. RD optimisation.

[6-9]     Networked video concepts: processing, transmission/communications, and rendering.

[10-12] Media adaptation concepts: adaptation decision and content adaptation

[13-14] Introduction to 3D video compression. Depth perception cues. 3D video signal formats. 3D video compression approaches.

[15]      Perceptual video quality assessment

Assessment pattern

Alternative Assessment

Alternative assessment:  Not applicable: students failing a unit of assessment resit the assessment in its original format.

Assessment Strategy

The assessment strategy for this module is designed to provide students with the opportunity to demonstrate the level of achievement made towards reaching the expected learning outcomes. Two courseworks are designed which provide students with opportunities to apply the concepts learned in classes and exercise on some audio/video processing and programming skills. A written examination has been designed that will assess the knowledge and assimilation of the necessary definitions and terminology, concepts and theory of 2D and 3D audio-visual content capture, compression, transmission, adaptation, media quality evaluation, and users’ experience. The examination also aims to assess the students’ ability to analyse common media processing problems and apply necessary solutions in accordance with their understanding of how media processing can address those challenges and limitations that can be faced in real-world situations.

Thus, the summative assessment for this module consists of the following.

• Coursework 1  (15%)

           This coursework is designed for the audio processing part, e.g. DFT transform, DCT transform, etc.

• Coursework 2  (15%)

           This coursework is designed for the video processing part, e.g. image/video coding, etc.

• Written exam (70%)

These deadlines are indicative. For confirmation of exact date and time, please check the Departmental assessment calendar issued to you.

 

Formative assessment and feedback

For the module, students will receive formative assessment/feedback in the following ways.

• During lectures, by question and answer sessions


• During revision & tutorial classes


• By means of unassessed tutorial problem sheets

 

Module aims

• Provide students with a basic understanding of the media signal processing systems that are ubiquitous in our modern age.
• Introduce them to the essential characteristics of the signals, their capturing, encoding, transmission and assessment of their perceived quality.

Learning outcomes

Methods of Teaching / Learning

The learning and teaching strategy is designed to achieve the following aims.

• 
  Directive learning through classroom teaching
  


• 
  Tutorial to enable students to check and clarify their understanding of the material
  

 

Learning and teaching methods include the following.

Lectures (3-hour lectures per week x 10 weeks)

Indicated Lecture Hours (which may also include seminars, tutorials, workshops and other contact time) are approximate and may include in-class tests where one or more of these are an assessment on the module. In-class tests are scheduled/organised separately to taught content and will be published on to student personal timetables, where they apply to taken modules, as soon as they are finalised by central administration. This will usually be after the initial publication of the teaching timetable for the relevant semester.

Reading list

https://readinglists.surrey.ac.uk
Upon accessing the reading list, please search for the module using the module code: EEE3042

Programmes this module appears in

Please note that the information detailed within this record is accurate at the time of publishing and may be subject to change. This record contains information for the most up to date version of the programme / module for the 2022/3 academic year.