Kielellisen diversiteetin ja digitaalisten menetelmien maisteriohjelma
Tietoja viimeksi muutettu
This is an introduction to deep learning for students in language technology. The course is aimed at master's level students who already have some experience in machine learning.
It is recommended to take this course after LDA-T3105, Models and Algorithms in NLP-applications. However, all students who have a reasonable background in linear classifiers like the perceptron and logistic regression, as well as, the NumPy Python library can probably follow the course.
study track: language technology
modules: Studies in Language Technology (LDA-T3100), Essentials in Language Technology (LDA-TA500), Comprehensive specialization in Language Technology (LDA-TB500)
This is an optional course.
The course is available to students from other study tracks and degree programmes.
This course is suitable for 2nd year master's students.
After completing this course, students will:
understand the structured of neural networks
know the difference between linear and non-linear models
understand how neural networks are applied and trained
know the common neural models applied in language technology
be able to implement their own neural models using deep learning libraries.
The course will cover a selection from the following topics:
training linear classifiers using gradient methods
multi-layer feedforward networks
embeddings layers and the continuous bag-of-words model
recurrent networks including long-short term memory networks and gated recurrent units
the encoder-decoder architecture
mini-batch training and GPU's
The PyTorch Python library for deep learning
The course is going to be a lecture course with one weekly lecture and optional exercise sessions. We’ll have a final assignment but no exam.