Virtual and Augmented Reality

Code:

M.EIC040

Acronym:

RVA

Keywords
Classification	Keyword
OFICIAL	Interaction and Multimedia

Instance: 2024/2025 - 1S

Active?	Yes
Responsible unit:	Department of Informatics Engineering
Course/CS Responsible:	Master in Informatics and Computing Engineering

Cycles of Study/Courses

Acronym	No. of Students	Study Plan	Curricular Years	Credits UCN	Credits ECTS	Contact hours	Total Time
M.EIC	24	Syllabus	2	-	6	39	162

Teaching language

English

Objectives

Augmented reality is a technology that improves and augments the user’s vision of the real world with virtual images using Computer Vision and Computer Graphics techniques. Conversely, Virtual Reality submerges the user in a totally virtual environment, making him/her believe s/he is in another world. The main aim of this course is to transmit to the students the basic knowledge of these techniques, allowing them to proceed to more advanced studies in the emergent area of Augmented Reality and Virtual Reality. Furthermore, another aim is to give the students the capacity to do little assignments illustrating the studied methodologies. 

Learning outcomes and competences

At the end, the students must be able to:
- identify and characterize the components, structure, and functions of a minimum system of augmented and/or virtual reality;
- describe the main algorithms used to implement each component;
- describe the interaction of several components;
- do the integration between real-world and virtual object images;
- develop Virtual and Augmented Reality applications using existing tools (AR Toolkit, Vuforia, Unity, Unreal...).

Working method

Presencial

Pre-requirements (prior knowledge) and co-requirements (common knowledge)

Computer graphics; OpenGL, WebGL or similar technology.

Program

Introduction to Extended Realities
- Definition and Concepts of Virtual Reality, Augmented Reality, Mixed Reality and Extended Reality
- History of Extended Realities
- Virtual and Augmented Reality Applications

Presence and Perception
- Concepts about immersion, perception, and presence
- Visual, auditory, and other perception types

Technologies for Virtual and Augmented Reality
- Components and general operation of Virtual and Augmented Reality systems
- Visualization technologies
- Virtual Reality Rendering
- Acceleration techniques in 3D visualization
- Equipment and Software

Tracking Techniques
- Concepts about registration, calibration, and tracking
- Tracking with and without marks
- Feature extraction

Interaction Techniques
- Natural, spatial, and tangible user interfaces
- Universal 3D interaction tasks
- Interaction techniques for selection, manipulation, and navigation in immersive virtual environments

Side Effects and Guidelines
- Motion Sickness, eye strain, and other side effects
- Latency challenges
- Guidelines for application design

Mandatory literature

Jason Jerald; The VR Book: Human-Centered Design for Virtual Reality, ACM, 2016. ISBN: 978-1-97000-112-9
Dieter Schmalstieg, Tobias Höllerer; Augmented Reality, Addison-Wesley, 2016. ISBN: 978-0-321-88357-5
Rory Stuart; The Design of Virtual Environments, Barricade Books, 2001
Roy Kalowsky; The Science of Virtual Reality and Virtual Environments, Addison Weslley, 1994
E. Trucco, A. Verri; Introductory Techniques for 3-D Computer Vision, Prentice-Hall, 1998

Complementary Bibliography

Y. Ohta, H. Tamura; Mixed Reality - Merging Real and Virtual Worlds, Ohmsha Ltd. & Springer-Verlag, 1999
Foley, James D. 070; Introduction to computer graphics. ISBN: 0-201-60921-5
R. Gonzalez, R. E. Woods; Digital Image Processing, Prentice-Hall, 2002
Artigos de Revistas e Conferências, nomeadamente: "IEEE Transactions on Visualization and Computer Graphics", "SIGGRAPH Conference Proceedings", EUROGRAPHICS Forum, IEEE Computer Graphics and Applications, IWAR, ISMAR, ISMR e ISAR

Teaching methods and learning activities

THEORETICAL-PRACTICAL CLASSES:
- Exposition of the contents with presentation of illustrative problems.
- Short exercises illustrating the methods studied.

THEORETICAL-PRACTICAL/LAB CLASSES:
- Practical assignments involving the use of transmitted concepts.

Software

- Vuforia
- OpenCV
- OpenGL
- ARToolkit
- Unity
- Sistema de desenvolvimento em C/C++, Python ou Java

keywords

Technological sciences > Technology > Graphic techniques > Computer graphics
Physical sciences > Computer science > 3 D modeling
Technological sciences > Technology > Interface technology > Virtual reality
Physical sciences > Computer science > Computer systems > Human computer interaction

Evaluation Type

Distributed evaluation with final exam

Assessment Components

Designation	Weight (%)
Exame	40,00
Trabalho laboratorial	60,00
Total:	100,00

Amount of time allocated to each course unit

Designation	Time (hours)
Estudo autónomo	63,00
Frequência das aulas	39,00
Trabalho laboratorial	60,00
Total:	162,00

Eligibility for exams

Not exceed the absence limit allowed and have a minimum of 40% in the evaluation assignments.

Calculation formula of final grade

CF = 60*CT + 40%*CE

CF: Final Classification
CT: Practical Assignment classification (average grade of 2 works)
CE: Final Exam Classification

The two practical assignments are evaluated in class at the end of the time estimated for their elaboration.

The final exam covers all the subjects and is CLOSED BOOK type.

To pass, the student must have a minimum of 40% in each of the two evaluation components, distributed and final exam.

Examinations or Special Assignments

Special exams (end of graduation and others) comprise a practical work and a written exam.

Special assessment (TE, DA, ...)

The distributed evaluation is for all the students, regardless of their enrollment regime. The students who cannot attend classes, must agree with professors dates for the presentation of the assignments evolution (subject to evaluation) during the period given for their elaboration, as well as do their presentation on the dates foreseen.

Classification improvement

The classification improvement of the distributed component can be done at the same time as the practical assignments in the following academic year.

Observations

Pre-requirements: basic knowledge of 3D Graphic Computing.