Processing and Coding for Multimedia Information

Code:

EEC0051

Acronym:

PCIM

Keywords
Classification	Keyword
OFICIAL	Telecommunications

Instance: 2011/2012 - 2S

Active?	Yes
Web Page:	https://moodle.fe.up.pt/1112/course/view.php?id=3285
Responsible unit:	Department of Electrical and Computer Engineering
Course/CS Responsible:	Master in Electrical and Computers Engineering

Cycles of Study/Courses

Acronym	No. of Students	Study Plan	Curricular Years	Credits UCN	Credits ECTS	Contact hours	Total Time
MIEEC	22	Syllabus (Transition) since 2010/2011	4	-	6	63	162
		Syllabus	4	-	6	63	162

Teaching language

Portuguese

Objectives

This course unit aims to familiar and endow students with application skills in the generation, perception, representation, processing and codification of multimedia signals. A special emphasis will be given to video, image, audio and speech signals, as well as the most relevant international norms.

Program

1- Introduction
- multimedia information
- digital representation of multimedia information
- emphasis: audio, image, video
- review of signal sampling and reconstruction

2- Generation and perception of multimedia information
- speech production
- characterization of audio (and musical) signals
- human hearing perception
- characterization of image information
- characterization of image information
- human visual perception

3- Speech and audio coding
- basic concepts of audio coding
- wave encoders
- vocoders
- CELP, MBE, WI encoders
- norms of speech coding
- historical perspective of audio coding
- quality and performance assessment of coding
- standardized audio encoders: MPEG-1, MPEG-2, MPEG-4, AC-3
- applications

4- Image and video coding
- lossy and lossless coding
- basic techniques of coding:
- motion compensation
- DCT and wavelet transforms
- Huffman coding and arithmetic coding
- Image encoders JPEG, JPEG2000
- Historical perspective of video coding
- video coders: MPEG-1, MPEG-2, MPEG-4, MPEG-7
- quality and performance assessment of coding
- applications

5- Multimedia information processing
- audio and voice processing, applications
- image and video processing, applications

Mandatory literature

Aníbal Ferreira, Carlos Salema, Fernando Pereira, Isabel Trancoso, Paulo Lobato Correia, Pedro Assunção, Sérgio Faria; Comunicações Audiovisuais – Tecnologias, Normas e Aplicações, Fernando Pereira (Editor), 2009. ISBN: 972-978-8469-81-8
Rafael C. Gonzalez, Richard E. Woods, Steven L. Eddins; Digital image processing using Matlab. ISBN: 0-13-008519-7

Complementary Bibliography

Andreas Spanias, Venkatraman Att; Audio Signal Processing and Coding, 2007
Barry G. Haskell, Atul Puri, Arun N. Netravali; Digital video. ISBN: 0-412-08411-2

Teaching methods and learning activities

• Theoretical classes
These classes will be based on the presentation of the themes of the course unit, resolution of problems and analysis and demonstration of real cases.

• Practical classes
These classes will be based on the resolution of exercises, which are necessary to understand the program. Also, students will have to exercises using Matlab.

• Homework
Students will be asked to do group assignments in order to consolidate their knowledge.

Software

The MathWorks - Matlab - Release 11

Evaluation Type

Distributed evaluation with final exam

Assessment Components

Description	Type	Time (hours)	Weight (%)	End date
Attendance (estimated)	Participação presencial	56,00
	Exame	6,00
	Trabalho escrito	65,00
	Total:	-	0,00

Amount of time allocated to each course unit

Description	Type	Time (hours)	End date
	Estudo autónomo	35
	Total:	35,00

Eligibility for exams

To be admitted to exams, students cannot miss more classes than allowed by the rules. Besides they have to reach a minimum grade of 50% in the assignments.

Calculation formula of final grade

Final Exam will be a written test which lasts around 2.30h.
Final Grade (FG) will be based on the grade of the practical assignments (P) and on the grade of the written exam (E) using the following formula:

FG= 0.5P + 0.5 E

All components will be graded from 0 to 20.

Special assessment (TE, DA, ...)

Students who cannot attend classes have to attend a practical exam, which will be similar to ‘homework’.

Classification improvement

Improvement of final grade will be based on the same rules as final grade
Students cannot improve continuous assessment grade.