Computer Vision

Code:

EIC0104

Acronym:

VCOM

Keywords
Classification	Keyword
OFICIAL	Interaction and Multimedia

Instance: 2020/2021 - 2S

Active?	Yes
Responsible unit:	Department of Informatics Engineering
Course/CS Responsible:	Master in Informatics and Computing Engineering

Cycles of Study/Courses

Acronym	No. of Students	Study Plan	Curricular Years	Credits UCN	Credits ECTS	Contact hours	Total Time
MIEIC	66	Syllabus since 2009/2010	4	-	6	42	162

Teaching language

Portuguese

Objectives

Computer vision is a subfield of computer science that focuses on extracting "useful information" from images and videos. The goal of computer vision is to "discover from images what is present in the world, where things are located, what actions are taking place" (Marr, 1982). Examples of "useful information" include, for example, recovering the 3D geometry of objects in an image, detection and identification of human faces and gestures, and tracking moving people or vehicles in a video sequence. Computer vision algorithms have found a wide range of applications in the industrial, military and medical fields, as well as in the ever-growing entertainment field.

This course is an introduction to basic concepts and methods in computer vision. It is mainly suited for MIEIC students who are interested in following research in this area. The covered topics include: image formation, basic image processing and analysis methods, as well as more advanced methods like 3D scene reconstruction, motion analysis, machine learning / deep learning, and object recognition. 

Learning outcomes and competences

Upon completion of this course, students will:

• understand and be able to explain the basic concepts of computer vision and the fundamental algorithms for manipulation of images and video sequences;

 

• have knowledge of existing methods for visual data analysis and be able to apply them in practical situations;

 

• acquire skills to use a library, like OpenCV, that implements some of the analyzed algorithms, and to implement novel algorithms described in the literature;

 

• be able to analyze and understand selected scientific papers in image processing and analysis, and computer vision.

 

Working method

Presencial

Pre-requirements (prior knowledge) and co-requirements (common knowledge)

Approval in the Programming, Algorithms and Data Stuctures, and Algebra courses (or equivalent) is advisable.

Program

Introduction to Computer Vision

Image acquisition

• intensity images (2D) and distance/position images (3D)
• geometric and radiometric model of a camera

Processing and analysis of intensity images

• filtering
• feature extraction
• segmentation

Geometric calibration of a camera and stereo

• calibration methods
• epipolar geometry
• point correspondence

Recognition

• feature selection
• description using local invariant features
• matching of features

Machine Learning

• clustering
• classification
• model generalization

Deep Learning

• neural networks
• convolutional neural networks (CNNs)
• detection and segmentation (R-CNN and YOLO models)
• visualization of CNNs
• image generation (GAN models)

Motion

• motion estimation

Case studies

Mandatory literature

Richard Szeliski; Computer vision, 2011. ISBN: 978-1848829350
Adrian Kaehler, Gary Bradski; Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library, O'Reilly Media, 2017. ISBN: 978-1491937990

Complementary Bibliography

David A. Forsyth, Jean Ponce; Computer vision. ISBN: 0-13-085198-1
Robert M. Haralick, Linda G. Shapiro; Computer and Robot Vision. ISBN: 0 201 10877 1(vol.1)
Mubarak Shah; Fundamentals of computer vision
ULL; Introductory techniques for 3 D computer vision

Teaching methods and learning activities

• Lectures: Presentation and discussion of the course topics, and resolution of exercises.

• Practical assignments: Development of projects where the studied computer vision methods must be applied.

Software

OpenCV

Evaluation Type

Distributed evaluation without final exam

Assessment Components

Designation	Weight (%)
Trabalho laboratorial	50,00
Teste	50,00
Total:	100,00

Amount of time allocated to each course unit

Designation	Time (hours)
Estudo autónomo	70,00
Frequência das aulas	42,00
Trabalho laboratorial	50,00
Total:	162,00

Eligibility for exams

Do not exceed the absence limit and obtain a minimum of 40% in the distributed evaluation classification.

Calculation formula of final grade

Distributed evaluation, including projects (PR) and minitests (MT)

PR - Two projects will be developed during the semester; these projects must be developed both during classes and at home. For the last project a report will be written and an oral presentation will be required. PR = PR1 * 0.5 + PR2 * 0.5

MT - Two written minitests will be done, covering the theoretical concepts presented during the course lectures. MT = MT1 * 0.5 + MT2 * 0.5

PR and MT are specified in a 0 to 20 scale.

Final Classification = PR * 0.5 + MT * 0.5

Oral examination: whenever needed, according to a decision of the teaching team, students may be submitted to an oral exam. In this situation the final classification will be given by the average of the classification calculated with the previous formula and the classification of the oral exam.

Second season exam: the second season exam replaces only the grade corresponding to the MT component.

Observations: 1- A minimum of 40% on the MT evaluation component is required to be approved in the course. 2- If the teaching team decides not to propose one of the projects, its weight will be redistributed to the other projects.

Examinations or Special Assignments

See PR, in Evaluation components.

Special assessment (TE, DA, ...)

Students with a special status will be assessed in the same way as ordinary students. They have to do all the assignments and deliver them on the scheduled dates.

Classification improvement

Students can only improve the mark of the distributed evaluation component in the following year. Students can improve the mark of the written minitests at the corresponding seasons (according to the rules).

Observations

Due to the limitations of the current context caused by COVID-19, if it is not possible to do the minitests, these will be replaced by one final exam. The calculation formula of the final classification would remain the same:

Final Classification = PR * 0.5 + Exam * 0.5