Virtual and Augmented Reality

Code:

EIC0070

Acronym:

RVAU

Keywords
Classification	Keyword
OFICIAL	Interaction and Multimedia

Instance: 2014/2015 - 1S

Active?	Yes
E-learning page:	https://moodle.fe.up.pt/
Responsible unit:	Department of Informatics Engineering
Course/CS Responsible:	Master in Informatics and Computing Engineering

Cycles of Study/Courses

Acronym	No. of Students	Study Plan	Curricular Years	Credits UCN	Credits ECTS	Contact hours	Total Time
MIEIC	19	Syllabus since 2009/2010	5	-	6	56	162

Teaching language

Suitable for English-speaking students

Objectives

Augmented reality is a technology which improves and augments the user’s vision of the real world with virtual images, using Computer Vision and Graphical Computing/ Virtual Reality techniques. The main aim of this course is to transmit to the students the basic knowledge of these techniques, allowing them to proceed more advanced studies in the emergent area of Augmented Reality. Furthermore, another aim is to provide the students with the capacity to do little assignments illustrating the methodologies studied. 

Learning outcomes and competences

At the end, the students must be able to:
- identify and characterize the components, structure and functions of a minimum system of augmented and/or virtual reality;
- describe the main algorithms used to implement each component;
- describe the interaction of several components;
- do the integration between real world and virtual object images;
- develop Augmented Reality Applications, by the use of an open source tool (AR Toolkit).

Working method

Presencial

Pre-requirements (prior knowledge) and co-requirements (common knowledge)

Computer graphics and OpenGL.

Program

INTRODUCTION TO AUGMENTED REALITY
- Concepts.
- Applications.
- Display technologies.
- Components of an Augmented Reality system.
- General Functioning of an Augmented Reality system.

INTRODUCTION TO COMPUTER VISION
- General structure of a computer vision system.
- Introduction to techniques of acquisition, processing and image analysis.
- Techniques of 3D information acquisition (short reference).
- Modeling and geometric calibration of a camera.

FUNCTIONNING OF AN AUGMENTED REALITY SYSTEM BASED ON THE TRACKING OF A PATTERN OBJECT
- Real and virtual images’ superposition.
- Description of the main processing phases: pattern recognition and tracking.
- Analysis of the main stages of the recognition phase.
- Analysis of the main stages of the tracking phase.

VIRTUAL ENVIRONMENTS PERCEPTION
- Visual and auditory perception and others.

TECHNOLOGIES USED IN AUGMENTED AND VIRTUAL REALITY
- Equipments and software

TECHNIQUES AND ALGORITHMS USED IN AUGMENTED AND VIRTUAL REALITY
- 3D Object modelling
- 3D Object display
- Acceleration techniques in 3D display
- Occlusion
- Collision detection

Mandatory literature

Rory Stuart; The Design of Virtual Environments, Barricade Books, 2001
Roy Kalowsky; The Science of Virtual Reality and Virtual Environments, Addison Weslley, 1994
E. Trucco, A. Verri; Introductory Techniques for 3-D Computer Vision, Prentice-Hall, 1998

Complementary Bibliography

Y. Ohta, H. Tamura; Mixed Reality - Merging Real and Virtual Worlds, Ohmsha Ltd. & Springer-Verlag, 1999
Foley, James D. 070; Introduction to computer graphics. ISBN: 0-201-60921-5
R. Gonzalez, R. E. Woods; Digital Image Processing, Prentice-Hall, 2002
Artigos de Revistas e Conferências, nomeadamente: "IEEE Transactions on Visualization and Computer Graphics", "SIGGRAPH Conference Proceedings", EUROGRAPHICS Forum, IEEE Computer Graphics and Applications, IWAR, ISMAR, ISMR e ISAR

Teaching methods and learning activities

THEORETICAL-PRACTICAL CLASSES:
- Exposition of the contents with presentation of illustrative problems.
- Short exercises illustrating the methods studied.

THEORETICAL-PRACTICAL/LAB CLASSES:
- Practical assignments involving the use of transmitted concepts.

Software

- ARToolkit
- OpenGL
- Sistema de desenvolvimento em C/C++ ou Java
- Sistemas operativos MS Windows/LINUX
- Matlab

keywords

Technological sciences > Technology > Graphic techniques > Computer graphics
Physical sciences > Computer science > 3 D modeling
Technological sciences > Technology > Interface technology > Virtual reality
Physical sciences > Computer science > Computer systems > Human computer interaction

Evaluation Type

Distributed evaluation with final exam

Assessment Components

Designation	Weight (%)
Exame	60,00
Trabalho laboratorial	40,00
Total:	100,00

Amount of time allocated to each course unit

Designation	Time (hours)
Estudo autónomo	68,00
Frequência das aulas	42,00
Trabalho laboratorial	52,00
Total:	162,00

Eligibility for exams

Not exceed the absence limit allowed and have a minimum of 40% in the evaluation assignments.

Calculation formula of final grade

CF = 40*CT + 60%*CE

CF: Final Classification
CT: Practical Assignment classification (average grade of 2 works)
CE: Exam Classification

The two practical assignments are evaluated in class at the end of the time estimated for their elaboration.

To pass, the student must have a minimum of 40% in each of the two evaluation components, distributed and final exam.

Examinations or Special Assignments

Special exams (end of graduation and others) are composed by a practical work and a written exam.

Special assessment (TE, DA, ...)

The distributed evaluation is for all the students, regardless of their enrollment regime. The students who cannot attend classes, must agree with professors dates for the presentation of the assignments evolution (subject to evaluation) during the period given for their elaboration, as well as do their presentation on the dates foreseen.

Classification improvement

The classification improvement of the distributed component can be done at the same time as the practical assignments in the following academic year.

Observations

Pre-requirements: basic knowledge of 3D Graphic Computing.