Computer Vision Group

Prof. Daniel Cremers

Current Trends in
Machine Learning

Preparation Meeting
Jan Sthmer, Christina Lichtenthler,
Jrgen Sturm, Daniel Cremers

What You Shall Learn In The Seminar

Get an overview on current trends in machine
learning
Read and understand scientific publications
Write a scientific report
Prepare and give a talk

Current Trends in Machine Learning

Computer Vision Group, TUM

Important Dates
Choose your topic until 17.10.2012 (First come
first Serve!)
Deadline for the report: 01.03.2012
Dates for the talks:

10.01.2013
17.01.2013
24.01.2013
31.01.2013

First Meeting: 18.10.2012 (mandatory!)

Fixed assignment of topic and date
Current Trends in Machine Learning

Computer Vision Group, TUM

Preparation
Please do not work on your topic completely alone
Meet at least twice with your supervisor
Recommended schedule
1 month before your talk: Meet your supervisor and discuss
paper
1 week before your talk: Meet your supervisor to discuss
your slides
[optional] after the talk: Feedback of your supervisor
regarding the talk
1 week before 01.03.13: Submit a draft of your report
Current Trends in Machine Learning

Computer Vision Group, TUM

Report and Talk

Send PDF (not PPTX, not DOC) via email to your
supervisor, Latex template available on the
web-page
Recommended length: 6-8 pages
Required: Minimum 6, Maximum 10 pages
Language: English or German

Current Trends in Machine Learning

Computer Vision Group, TUM

Hints for Your Talk

20 min. + 510 min. for discussion
Dont put too much information on one slide
1-2 min. per slide 10-20 slides

Recommended structure

Introduction, Problem Motivation, Outline

Approach
Experimental results
Discussion
Summary of (scientific) contributions

Current Trends in Machine Learning

Computer Vision Group, TUM

Evaluation Criterions

Gained expertise in the topic

Quality of your talk
Quality of the report
Active participation in the seminar is required
(ask questions, comment talks)

Current Trends in Machine Learning

Computer Vision Group, TUM

Regular Attendance Is Required

Attendance at each appointment is necessary
In case of absence:
Medical attest
Or: One-sided abstract of the presented papers

Current Trends in Machine Learning

Computer Vision Group, TUM

Overview of availabe Topics

Current Trends in Machine Learning

Computer Vision Group, TUM

Human motion recognition using

support vector machines
[Cao, Masoud,Boley,Papanikolopoulos; CVIU 07]

Recognition of human motions in videoclips

Motion is represented as a set of filtered
images
ML Method: Support vector Machines

Current Trends in Machine Learning

10

Computer Vision Group, TUM

Online Action Recognition with Wrapped

Boosting
[Nejigane, Shimosaka, Mori, Sato; IROS07]

Recognition of motions like

running and walking in
motion capture data
gathered by a magnetic
motion capturing system
ML Methods: Wrapped
Boosting
Current Trends in Machine Learning

11

Computer Vision Group, TUM

BPR: Bayesian Personalized Ranking from

Implicit Feedback
[Rendle, Freudenthaler,Gantner, Schmidt-Thieme; UAI 09]

Calculating personalized
product recommendation
from implicit feedback
Learn a personalized
ranking of products
ML Methods: Matrix
Factorization
Current Trends in Machine Learning

12

Computer Vision Group, TUM

Semantic Place Classification of Indoor Environments

with Mobile Robots using Boosting
[Rottmann,Mozos, Stachniss, Burgard; AI 05]

Classification of places, which enables for a

robot to regognize the place where it is located
ML Methods: Boosting and Hidden Markov
Model HMM

Current Trends in Machine Learning

13

Computer Vision Group, TUM

Probabilistic Pointing Target Prediction

via Inverse Optimal Control
[Ziebart, Dey, Bagnell; IUI 2012]

Learn to predict the target of the motion of a

computer mouse
Features: Velocity profile, user preferences,
Inverse reinforcement learning

Current Trends in Machine Learning

14

Computer Vision Group, TUM

Real-Time Human Pose Recognition in

Parts from Single Depth Images
[Shotton, Fitzgibbon, Cook, Sharp, Finocchio, Moore,
Kipman, Blake; CVPR 2011]

Recognize pose from depth images (Kinect)

Learn good features for depth images
Learn decision trees to recognize body parts

Current Trends in Machine Learning

15

Computer Vision Group, TUM

Building High-level Features

Using Large Scale Unsupervised Learning
[Le, Ranzato, Monga, Devin, Chen, Corrado, Dean, Ng; ICML 2012]

Learn high-level feature detectors

Autoencoder network
10 million unlabeled images from Google
Discovery: Specific neurons for faces, cats,

Current Trends in Machine Learning

16

Computer Vision Group, TUM

Machine Learning That Matters

[Wagstaff, ICML 2012]

Claim: Machine learning research has lost its

connection to real problems
Inspiring discussion on the future of ML research

Current Trends in Machine Learning

17

Computer Vision Group, TUM

Blind Source Separation Techniques for the Decomposition

of Multiply Labeled Fluorescence Images
[Neher et al.; Biophysical Journal 2009]
In microscopy, images of different fluorescent molecules that have a distinct
characteristic spectrum of the emmited light need to be processed
Because the spectra of the molecules are overlapping, the signals of the
different molecules lead to a superimposed image of the different sources
Blind source seperation, a machine learning techinque based on Nonnegative Matrix Factorization, can be used to seperate the signals of the
different molecules

Current Trends in Machine Learning

18

Computer Vision Group, TUM

Variational Message Passing

[Winn, Bishop; Journal of Machine Learning Research 2005]
Graphical models are a powerful tool to model knowledge in a probabilistic
fashion
This paper describes a variational message passing algorithm for inference
in Bayesian networks based on factorization of the graph, that can handle
more general problems than classic belief propagation

Current Trends in Machine Learning

19

Computer Vision Group, TUM

Boosting classifiers for drifting concepts

[Scholz, Klinkenberg; Intelligent Data Analysis 2007]
Time-Varying data recently attracted a lot of interest in the machine
learning community
This work introduces a boosting-like method, that can train an ensemble of
classifiers from a data stream
This concept drift allows to handle data, which underlying distribution is
changing over time

Current Trends in Machine Learning

20

Computer Vision Group, TUM

Gaussian Processes in Machine Learning

[Rassmussen; Advanced Lectures in Machine Learning 2004]
Gaussian Process models can be used to formulate a Bayesian framework
for regression
This paper is a short tutorial and explaines the stochastic process, how
gaussian processes are used in supervised learning and the role of
hyperparameters in the covariance function
It is a good starting point for an interested student for further research

Current Trends in Machine Learning

21

Computer Vision Group, TUM

Enjoy the seminar!

Current Trends in Machine Learning

22

Computer Vision Group, TUM