AUDIO AND VIDEO PROCESSING - 2022/3

Module code: EEE3042

Module Overview

Expected prior learning: Mathematics equivalent to Year 2 of EEE Programmes.

Module purpose: Using lectures and examples, this module will provide the fundamental concepts needed to understand the operation of modern media processing and transmission systems delivering high quality audio-visual content.

Module provider

Computer Science and Electronic Eng

Module Leader

WANG Wenwu (CS & EE)

Number of Credits: 15

ECTS Credits: 7.5

Framework: FHEQ Level 6

Module cap (Maximum number of students): N/A

Overall student workload

Independent Learning Hours: 88

Lecture Hours: 11

Tutorial Hours: 11

Guided Learning: 10

Captured Content: 30

Module Availability

Semester 2

Prerequisites / Co-requisites

None.

Module content

Topics will include 2D and 3D audio-visual content capture, compression, transmission, adaptation, media quality evaluation, and users’ experience. Indicative content includes the following.

 

Part A – Audio processing

[1-2]     Characteristics of speech and audio signals, and audio processing chain.

[3-4]     Principles of audio capture and coding methods. Need for source compression. Definition of quantisation. Scalar and vector quantisation.

[5-6]  Probability density function, auto-correlation, cross-correlation, stationarity etc.

[7-9]     Fundamental methods of speech processing. Voiced and unvoiced speech. Effects of windowing. Short and long term modelling of speech.

[10-12] Simple coding methods (PCM, APCM, ADPCM). Analysis and Synthesis coding methods. Analysis by synthesis coding methods. Harmonic coding.

[13-14] Audio reproduction formats and coding technologies, and spatial audio and 3D audio systems. File formats and standards.

[15]      Perceptual evaluation of audio quality

 

Part B – Video processing

[1-2]     Introduction to 2D-3D video applications and systems

[3-5]     Video capture and coding principles. Image and video formats. Spatial and temporal redundancy. DCT. Motion estimation and compensation. Coding complexity. RD optimisation.

[6-9]     Networked video concepts: processing, transmission/communications, and rendering.

[10-12] Media adaptation concepts: adaptation decision and content adaptation

[13-14] Introduction to 3D video compression. Depth perception cues. 3D video signal formats. 3D video compression approaches.

[15]      Perceptual video quality assessment

Assessment pattern

Assessment type Unit of assessment Weighting
Coursework COURSEWORK 1 15
Coursework COURSEWORK 2 15
Examination ONLINE (OPEN BOOK) EXAM WITHIN 4HR WINDOW 70

Alternative Assessment

Alternative assessment:  Not applicable: students failing a unit of assessment resit the assessment in its original format.

Assessment Strategy

The assessment strategy for this module is designed to provide students with the opportunity to demonstrate the level of achievement made towards reaching the expected learning outcomes. Two courseworks are designed which provide students with opportunities to apply the concepts learned in classes and exercise on some audio/video processing and programming skills. A written examination has been designed that will assess the knowledge and assimilation of the necessary definitions and terminology, concepts and theory of 2D and 3D audio-visual content capture, compression, transmission, adaptation, media quality evaluation, and users’ experience. The examination also aims to assess the students’ ability to analyse common media processing problems and apply necessary solutions in accordance with their understanding of how media processing can address those challenges and limitations that can be faced in real-world situations.

Thus, the summative assessment for this module consists of the following.


  • Coursework 1  (15%)



           This coursework is designed for the audio processing part, e.g. DFT transform, DCT transform, etc.


  • Coursework 2  (15%)



           This coursework is designed for the video processing part, e.g. image/video coding, etc.


  • Written exam (70%)



These deadlines are indicative. For confirmation of exact date and time, please check the Departmental assessment calendar issued to you.

 

Formative assessment and feedback

For the module, students will receive formative assessment/feedback in the following ways.


  • During lectures, by question and answer sessions

  • During revision & tutorial classes

  • By means of unassessed tutorial problem sheets



 

Module aims

  • Provide students with a basic understanding of the media signal processing systems that are ubiquitous in our modern age.
  • Introduce them to the essential characteristics of the signals, their capturing, encoding, transmission and assessment of their perceived quality.

Learning outcomes

Attributes Developed
001 Demonstrate a general knowledge of the nature of audio and video signal. KC
002 Identify the processing, transmission and rendering stages of networked content distribution. KCT
003 Develop appreciation of practical implementation issues related to signal compression for communication applications CT
004 Construct knowledge on important features of different compression standards and identify their future requirements for new applications KC
005 Describe and discuss the principles of media adaptation through the interaction between system capability and user experience. KC
006 Learn and appreciate the differences of the assessment methods for perceived audio and video quality KCT

Attributes Developed

C - Cognitive/analytical

K - Subject knowledge

T - Transferable skills

P - Professional/Practical skills

Methods of Teaching / Learning

The learning and teaching strategy is designed to achieve the following aims.



  • Directive learning through classroom teaching


  • Tutorial to enable students to check and clarify their understanding of the material



 

Learning and teaching methods include the following.

Lectures (3-hour lectures per week x 10 weeks)

Indicated Lecture Hours (which may also include seminars, tutorials, workshops and other contact time) are approximate and may include in-class tests where one or more of these are an assessment on the module. In-class tests are scheduled/organised separately to taught content and will be published on to student personal timetables, where they apply to taken modules, as soon as they are finalised by central administration. This will usually be after the initial publication of the teaching timetable for the relevant semester.

Reading list

https://readinglists.surrey.ac.uk
Upon accessing the reading list, please search for the module using the module code: EEE3042

Programmes this module appears in

Programme Semester Classification Qualifying conditions
Electronic Engineering with Computer Systems BEng (Hons) 2 Optional A weighted aggregate mark of 40% is required to pass the module
Electronic Engineering BEng (Hons) 2 Optional A weighted aggregate mark of 40% is required to pass the module
Computer and Internet Engineering BEng (Hons) 2 Optional A weighted aggregate mark of 40% is required to pass the module
Electronic Engineering with Computer Systems MEng 2 Optional A weighted aggregate mark of 40% is required to pass the module
Electronic Engineering MEng 2 Optional A weighted aggregate mark of 40% is required to pass the module
Computer and Internet Engineering MEng 2 Optional A weighted aggregate mark of 40% is required to pass the module
Biomedical Engineering MEng 2 Optional A weighted aggregate of 40% overall and a pass on the pass/fail unit of assessment is required to pass the module

Please note that the information detailed within this record is accurate at the time of publishing and may be subject to change. This record contains information for the most up to date version of the programme / module for the 2022/3 academic year.