Machine Learning II

Code:

CC3043

Acronym:

CC3043

Level:

300

Keywords
Classification	Keyword
OFICIAL	Computer Science

Instance: 2022/2023 - 1S

Active?	Yes
Responsible unit:	Department of Computer Science
Course/CS Responsible:	Bachelor in Artificial Intelligence and Data Science

Cycles of Study/Courses

Acronym	No. of Students	Study Plan	Curricular Years	Credits UCN	Credits ECTS	Contact hours	Total Time
L:IACD	1	study plan from 2021/22	3	-	6	56	162

Teaching language

English

Objectives

Students should get to know some of the algorithmic and statistical foundations of machine learning, as well as concrete methods of machine learning from linear regression to deep and reinforcement learning. They should be able to fundamentedlly select the appropriate algorithms and their hyperparameters for each problem/data set. They should understand and know how to apply methods of evaluating approaches and estimating performance.

Learning outcomes and competences

- Understanding the fundamentals of machine learning algorithms and methodologies presented, in particular of deep and reinforement learning.
- Ability to justify the choice of a machine learning solution to a given problem
- Ability to apply the algorithms to new problems
- Ability to evaluate results

Working method

Presencial

Pre-requirements (prior knowledge) and co-requirements (common knowledge)

- Introductory knowledge of data science (for example, obtained in the courses Introduction to Data Science or Data Mining I).
- Programming knowledge preferably in R or Python. Experienced programmers in other languages should not have any problems.
- Knowledge of data processing with files and in SQL databases
- Knowledge of statistical inference
- Knowledge of basic matrix algebra and calculus in R and R^

Program

In this course we  will (re) visit fundamental concepts and algorithms for model learning and pattern discovery. There will be a focus on their justified application and example-driven experimentation.

Topics:

- Introduction to the area: what is machine learning
- Simple classification and regression models (linear models and nearest neighbor models) and their validation: learning paradigms, loss functions, bias error and variance.
- Foundations and methods for model Evaluation
- Inference methods of models: Search, Expectation-maximization, aggregation.
- Kernel Methods
- Neural networks, deep models and representation learning
- Reinforcement learning
- Unsupervised, semi-supervised and poorly supervised pattern discovery.

Mandatory literature

Hastie Trevor; The elements of statistical learning. ISBN: 0-387-95284-5
Bishop Christopher; Pattern recognition and machine learning. ISBN: 0-387-31073-8

Complementary Bibliography

Ian Goodfellow and Yoshua Bengio and Aaron Courville; Deep Learning, MIT Press, 2016

Teaching methods and learning activities

The classes will be partly expositive, with individual and group dynamics involving the students. Practical out-of-class work will be done with classroom support. Students will also be able to do writing and presentation work. There will be a test and a final exam.

Evaluation Type

Distributed evaluation with final exam

Assessment Components

designation	Weight (%)
Exame	30,00
Participação presencial	5,00
Trabalho prático ou de projeto	55,00
Teste	10,00
Total:	100,00

Amount of time allocated to each course unit

designation	Time (hours)
Estudo autónomo	86,00
Frequência das aulas	42,00
Elaboração de projeto	32,00
Total:	160,00

Eligibility for exams

- Active attendance at least 2/3 of classes (unless an exception is granted)
- Grade greater than 10 in the set of practical assignments.
- Score greater than 0 on the test

Calculation formula of final grade

F = min( 0,3*E + 0,1*T +0,55*P  + 0,05*A ; (0,75*E+0,25*T)*1,2 )

F: final grade
E: Exam
T: Test
P: Practical components / assignments
A: Effective Attendance

Special assessment (TE, DA, ...)

Students under special circumstances should describe their situation to the responsible.

Classification improvement

The exam grade and the test grade can be improved in the appeal season. The continuous evaliuation and assignments grade cannot be improved after submission.

Observations

All the materials of the UC are in moodle.

The materials will be all in English, including the exams. Classes will be taught in English if this is convenient. Students can participate / respond using Portuguese or English.