Instructor:
Dr. Musab Elkheir Salih
Dept. of Biomedical Engineering
Sudan University of Science and Technology
Phone: 0129065150
Email: 2yabaabobaba13@gmail.com
Main textbook:
Chris. Bishop. Pattern Recognition and Machine Learning. Springer, 2006.
Continue
Objectives:
Grading:
• Classwork: 10% short quizzes testing the understanding of basic
concepts from previous lectures
• Homework: 40% (weekly)
• Final project: 20%, Written report + Oral presentation (weekly). *
As scientific format Team work groups
• Exam:30%
Lecture 1 outline
Why learn
Machine learning perform the learning tasks and are concerned with the
computer efficiency. By using training data, then the computer infer the rules
itself and make the correct predictions
In machine learning, one of the approaches to deal with data is to learn the
representation of the most informative structures of the data matrix
• Human genome is become data base of un thinkable scale. How to come with
the theory of how biology works and make sense of the data automatically
• Genome: all the genes that make an organism. Huge collection of genes inside
each of your cell
The ability to process huge databases allows machine learning programs to detect
patterns that are outside the scope of human perception.
Complex task
• Tom Mitchell:
A computer program is set to learn from an experience E
with respect to some task T and some performance
measure P if its performance on T as measured by P
improves with experience E.
• What are
Reinforcement learning
• Make a sequence of decisions over time, using
reward function
The main topics are listed below
Supervised learning: The data had the right answers
• Regression
• Classification
Unsupervised learning
• Clustering (k-means)
Learning Representation
• Dimension reduction (SVD)
• Higher dimensional representation (Kernel methods)
Regression
(a) (b)
Examples of image regions corresponding to (a) class A and (b) class B
• Genes clustering
• Medical imaging
• Remote sensing
• Social network analysis
• Market segmentation
Clustering: Remote sensing
• Points that correspond to the same ground
cover type, such as water.
Learning Representation
In machine learning, one of the approaches
to deal with data is to learn the representation
of the most informative structures of the data
matrix
• size 200×320
• number of bytes we need: 200×320= 640000 bytes
• Using we need: SVD 20×200+20+20×320=1024 bytes
Visualization
• Kernel-based SVM
• Super-resolution image
kernel based SVM classifier
Applying mapping into higher dimensional feature space using the kernel
trick is a way to construct a separating hyperplane there
Reinforcement learning
Make helicopter
Teach a car how to drive
• Application
Application
Pattern recognition is in the center of a number of application areas, including: