CdSINFORMATICA
Codice651AA
CFU6
PeriodoSecondo semestre
LinguaItaliano
Moduli | Settore/i | Tipo | Ore | Docente/i | |
INTELLIGENT SYSTEMS FOR PATTERN RECOGNITION | INF/01 | LEZIONI | 48 |
|
The course introduces students to the analysis and design of advanced machine learning models for modern pattern recognition problems and discusses how to realize advanced applications exploiting computational intelligence techniques. The course also presents fundamentals of signal and image processing. Particular focus will be given to pattern recognition problems and models dealing with sequential and time-series data.
The course is targeted at students who are pursuing specializations in Artificial Intelligence and Machine Learning, but it is of interest for data scientist and information retrieval specialists, roboticists and those with a bioinformatics curricula.
Course examination for students attending the lectures is performed in 3 stages: midterm assignments, a final project and an oral presentation. Midterms provide bonus points for the final grade.
Midterm AssignmentMidterm assignments consist in a very short presentation (5 minutes per person) to be given in front of the class, presenting the key/most-interesting aspects of one of the following tasks:
- A quick and dirty (but working) implementation of a simple pattern recognition algorithm
- A report concerning the experience of installing and running a demo application realized using available deep learning and machine learning libraries
- A summary of a recent research paper on topics/models related to the course content.
Students might be given some amount of freedom in the choice of assignments, pending a reasonable choice of the topic. The assignments will roughly be scheduled every 1 month.
Final projectThe final project concerns preparing a presentation concerning a topic relevant to the course content or the realization of a software implementing a non-trivial learning model and/or a PR application relevant for the course.
Oral PresentationPrepare a seminar on the project to be discussed in front of the instructor and anybody interested. Students are expected to prepare slides for a 20 minutes presentation which should summarize the ideas, models and results in the report. The exposition should demonstrate a solid understanding of the main ideas in the report. The second part of the oral examination will test knowledge of the course contents (models, algorithms and applications).
Non attending studentsWorking students and those not attending course lectures will deliver an extended final project making up for the missing midterms. They will be subject to an oral examination like attending students. Contact the instructor by mail to arrange project topics and examination dates.
Students completing the course are expected
- to gain in-depth knowledge of advanced topics of machine learning and pattern recognition, understanding their theory and applications;
- to be able to individually read, understand and discuss research works in the field;
- to be able to implement pattern recognition applications and machine learning models using state of the art libraries and tools;
- to be able to make limited advancements and contributions to the research in the field.
Students will be given both programming and reading assignments (as part of the midterm or as final projects) to assess their development and research understanding skills.
Course prerequisites include
- knowledge of machine learning fundamentals ("Machine Learning" course);
- knowledge of elements of probability and statistics, calculus and optimization algorithms ("Computational mathematics for learning and data analysis" course).
Students following the "Parallel and distributed systems: paradigms and models" course will benefit of knowledge and programming experiences on GPU programming and distributed systems.
Synergies are to be expected with the "Human language technologies" course, concerning deep learning models that have applications to NLP. Further, the two courses can share programming experiences on the same (or closely related) deep learning and machine learning libraries.
Knowledge of models, techniques and programming libraries acquired as part of the present course may be considered prerequisites for the Smart Applications course.
Signal processing and vision applications might provide helpful knowledge for courses such as Robotics and Mobile and Cyber-physical systems.
Some of the models and techiniques presented as part of this course might provide helpful complements to the Information Retrieval and Computational Neuroscience courses.
The official language of the course is English: all materials, references and books are in English. Lecture slides will be made available, together with suggested readings, on the course website.
The topics covered as part of the course include:
- Bayesian learning
- Undirected graphical model
- Dynamic Bayesian networks
- Deep learning techniques (CNN, Autoencoders, DBN, etc.)
- Deep learning for machine vision and signal processing
- Advanced neural network models (recurrent, recursive, etc.)
- Reinforcement learning
- Advanced kernel methods
- Signal processing and time-series analysis
- Image processing, filters and visual feature detectors
- Pattern recognition applications: machine vision, bio-informatics, robotics, medical imaging, etc.
- ML and deep learning libraries
The course does not have an official textbook covering all its contents. However, reference books covering parts of the course are listed at the bottom of this section (note that some of them have an electronic version freely available for download).
David Barber, Bayesian Reasoning and Machine Learning, Cambridge University Press
Ian Goodfellow and Yoshua Bengio and Aaron Courville , Deep Learning, MIT Press
Working students and those not attending course lectures will handle a final project and will also be subject to an oral examination including both an oral presentation of the project as well as an examination on the course program.
Course examination for students attending the lectures is performed in three stages, including midterm assignments, a final project and an oral presentation. Midterms can be expected to provide waivers for oral examination of parts of the course or bonus points for the final grade.
The course is likely to host guest seminars by national and international researchers working on the field as well as by companies that are engaged into the development of advanced applications using artificial intelligence, pattern recognition and machine learning.