Processing and Coding for Multimedia Information

Code:

EEC0051

Acronym:

PCIM

Keywords
Classification	Keyword
OFICIAL	Telecommunications

Instance: 2015/2016 - 2S

Active?	Yes
Web Page:	https://moodle.up.pt/course/view.php?id=1205
Responsible unit:	Department of Electrical and Computer Engineering
Course/CS Responsible:	Master in Electrical and Computers Engineering

Cycles of Study/Courses

Acronym	No. of Students	Study Plan	Curricular Years	Credits UCN	Credits ECTS	Contact hours	Total Time
MIEEC	14	Syllabus	4	-	6	56	162

Teaching language

Suitable for English-speaking students

Objectives

To motivate and provide students with application skills in the processing and coding of multimedia signals, with particular emphasis on speech, audio, image and video signals. Specific focus is given to the generation, perception and representation possibilities of multimedia information according to relevant international standards.

Learning outcomes and competences

Successful completion of this course will allow students to:

-know the nature of different types of multimedia information and corresponding representation formats,
-understand the nature of human systems of hearing and vision, as well as the importance of their characterization and modeling for the purposes of representation and efficient communication of speech signals, audio, image and video,
-explain the fundamentals of the main techniques of generic source coding, both lossless and lossy,
-identify the main international standards for the efficient representation and communication of speech and audio signals, explain the relevance of the underlying algorithmic structure, and understand its historical evolution and application contexts,
-identify the main international standards for the efficient representation and communication of image and video signals, explain the relevance of the underlying algorithmic structure, and understand its historical evolution and application contexts,
-apply digital processing techniques to speech, audio, image and video signals serving purposes of signal conversion or transformation, feature extraction, enhancement and compression,
-identify requirements and design systems allowing the access and communication of multimedia information, including all aspects from acquisition to system interoperability.

 

Working method

Presencial

Program

1- Introduction - multimedia information - digital representation of multimedia information - emphasis: speech, audio, image, video - review of the theory of sampling and reconstruction of signals

2- Generation and perception of multimedia information - speech production - characterization of audio (and musical) signals - human hearing perception - characterization of image and video information - human visual perception

3- Speech and audio coding - basic concepts of speech coding - wave encoders - vocoders - CELP, MBE, WI encoders - standards of speech coding - historical perspective of audio coding - quality and performance assessment of coding - standardized audio encoders: MPEG-1, MPEG-2, MPEG-4, AC-3 - proprietary audio encoders - applications

4- Image and video coding - lossy and lossless coding - basic techniques of coding: - motion compensation - DCT and wavelet transforms - Huffman coding and arithmetic coding - Image encoders JPEG, JPEG2000 - Historical perspective of video coding - video coders: MPEG-1, MPEG-2, MPEG-4, H.264/AVC - advanced format and video coding standards, 3D and multiview - Ultra High Definition and HEVC - standards quality and performance assessment of coding - applications

Mandatory literature

Aníbal Ferreita... [et al.] ; ed. Fernando Pereira; Comunicações audiovisuais. ISBN: 978-972-8469-81-8
Rafael C. Gonzalez, Richard E. Woods, Steven L. Eddins; Digital image processing using Matlab. ISBN: 0-13-008519-7

Complementary Bibliography

Andreas Spanias, Ted Painter, Venkatraman Att; Audio Signal Processing and Coding, Wiley-Interscience, 2007. ISBN: 978-0471791478
Barry G. Haskell, Atul Puri, Arun N. Netravali; Digital Video: An introduction to MPEG-2, Springer, 1997. ISBN: 978-0412084119

Teaching methods and learning activities

• Lectures

These classes will be based on the presentation of the themes of the course unit, problem solving and analysis and demonstration of real cases.

• Practical classes

These classes include the discussion and solving of practical exercises (conventional and Matlab-based) helping students to consolidate and apply knowledge reflecting the main topics of the course.

• Homework

Groups of two students will be given several assignments during the semester in order to reinforce autonomy, application and communication skills.

Software

Matlab

Evaluation Type

Distributed evaluation with final exam

Assessment Components

Designation	Weight (%)
Exame	50,00
Trabalho laboratorial	50,00
Total:	100,00

Amount of time allocated to each course unit

Designation	Time (hours)
Elaboração de relatório/dissertação/tese	14,00
Estudo autónomo	55,00
Frequência das aulas	63,00
Trabalho laboratorial	30,00
Total:	162,00

Eligibility for exams

In order to be admitted to exam, students cannot miss more classes than allowed by the applicable FEUP rules. In addition, students have to reach a minimum grade of 50% in the assignments.

Calculation formula of final grade

The Final Exam will be a written test which lasts less than 2.30h. The Final Grade (FG) will be based on the grade of the practical assignments (P) and on the grade of the written exam (E) using the following formula: FG= 0.5P + 0.5E, all components will be graded from 0 to 20.

Special assessment (TE, DA, ...)

Students who cannot attend classes as regular students, have to apply and develop a special practical assignment, which will be similar to ‘homework’.

Classification improvement

Improvement of final grade will be based on the same rules as final grade. The continuous assessment grade is not susceptible to improvement.