Coding of Multimedia Information

Code:

M.EEC045

Acronym:

CIM

Keywords
Classification	Keyword
OFICIAL	Telecommunications

Instance: 2021/2022 - 2S

Active?	Yes
Web Page:	https://moodle.up.pt/course/view.php?id=4230
Responsible unit:	Department of Electrical and Computer Engineering
Course/CS Responsible:	Master in Electrical and Computer Engineering

Cycles of Study/Courses

Acronym	No. of Students	Study Plan	Curricular Years	Credits UCN	Credits ECTS	Contact hours	Total Time
M.EEC	27	Syllabus	1	-	6	45,5

Teaching language

Suitable for English-speaking students

Objectives

This course unit aims to motivate and provide students with knowledge and skills allowing them to apply techniques and technologies that are relevant to the coding of multimedia signals, with particular emphasis on speech, audio, image and video signals. Meanwhile, students will be able to consolidate previous generic knowledge on signal processing and computer networks, which, together, will enable them to design, implement and manage multimedia applications and services according to different requirements and purposes, as well as under distinct resources availability. A special focus is given to aspects of audio-visual signal generation and perception, as well as to the possibilities of compressed representation of these signals in accordance with relevant international coding standards.

Learning outcomes and competences

Successful completion of this course will allow students to:

-know the nature of different types of multimedia information and corresponding representation formats,

-understand the nature of human systems of hearing and vision, as well as the importance of their characterization and modeling for the purposes of representation and efficient communication of speech signals, audio, image and video,

-explain the fundamentals of the main techniques of generic source coding, both lossless and lossy,

-identify the main international standards for the efficient representation and communication of speech and audio signals, and to explain the relevance of the underlying algorithmic structure, and understand its historical evolution and application contexts,

-identify the main international standards for the efficient representation and communication of image and video signals, and to explain the relevance of the underlying algorithmic structure, and understand its historical evolution and application contexts,

-apply digital processing techniques to speech, audio, image and video signals serving purposes of signal conversion or transformation, feature extraction, enhancement and compression,

-identify requirements and design systems allowing the access and communication of multimedia information, including all aspects from acquisition to system interoperability.

 

Working method

Presencial

Pre-requirements (prior knowledge) and co-requirements (common knowledge)

Signal processing.

Program

1-Introduction to multimedia information including aspects of sampling, quantization and reconstruction of signals

2-Generation and perception of audio-visual information with an emphasis on speech, audio, music, image and video

3-Techniques, standards and technologies for the coded representation of speech and audio

4- Techniques, standards and technologies for the coded representation of image and video

5- Aspects of quality evaluation and coding performance of multimedia coding algorithms

Mandatory literature

Aníbal Ferreita... [et al.] ; ed. Fernando Pereira; Comunicações audiovisuais. ISBN: 978-972-8469-81-8
Rafael C. Gonzalez, Richard E. Woods, Steven L. Eddins; Digital image processing using Matlab. ISBN: 0-13-008519-7

Complementary Bibliography

Andreas Spanias, Ted Painter, Venkatraman Att; Audio Signal Processing and Coding, Wiley-Interscience, 2007. ISBN: 978-0471791478
Barry G. Haskell, Atul Puri, Arun N. Netravali; Digital Video: An introduction to MPEG-2, Springer, 1997. ISBN: 978-0412084119

Teaching methods and learning activities

The teaching methodology is based on lectures and laboratory classes. Lectures are devoted to the explanation of the topics of the course unit, with illustration and analysis of specific cases, which may also include demonstration.

In laboratory classes, the resolution of exercises is motivated aiming at the practical application of the acquired knowledge. In these classes and during the semester, several mandatory Matlab-based work assignments are also proposed to be developed by groups of students, and that focus on the development and experimentation of multimedia processing and coding algorithms.

These assignments aim to promote the applied consolidation of the course topics, as well as to stimulate autonomy in the development of design skills.

The assessment in this course is based on distributed evaluation with final exam. The distributed evaluation results from the evaluation of the mandatory assignments that are developed in the laboratory classes and also in an extra-class regime. The final grade in the course unit is obtained by weighting 50% of the distributed evaluation and 50% of the grade obtained in the final exam.

Software

Matlab

Evaluation Type

Distributed evaluation with final exam

Assessment Components

Designation	Weight (%)
Exame	50,00
Trabalho prático ou de projeto	50,00
Total:	100,00

Amount of time allocated to each course unit

Designation	Time (hours)
Estudo autónomo	66,50
Frequência das aulas	45,50
Trabalho laboratorial	38,00
Trabalho escrito	12,00
Total:	162,00

Eligibility for exams

In order to obtain attendance in the UC, students cannot miss more classes than the maximum allowed by the applicable FEUP rules. In addition, students have to reach a minimum grade of 50% in the set of grades related to the assignments given throughout the semester and that represent the distributed evaluation.

Calculation formula of final grade

The Final Exam consists of a written test that lasts less than 90 minutes.

The Final Grade (FG) will be based on the grade of the practical assignments (P) and on the grade of the written exam (E) using the following formula:

FG= 0.5×P + 0.5×E, all components will be graded from 0 to 20. Approval in the course requires that the exam grade (E) is not less than 7 points.

 

All grades refer to the scale [0, 20] points.

Special assessment (TE, DA, ...)

Students who cannot attend classes as regular students, have to apply and develop a special practical assignment, which will be similar to the practical assignments given to regular students and will incorporate at least two of the themes of these assignments.

Classification improvement

Improvement of final grade complies with the FEUP rules and it applies only to the final exam component.