The Science of Managing Data Scientists: Kate Matsudaira

The Science of
Managing Data Scientists

Kate Matsudaira
Tuesday, February 26, 13

What are they
doing all day?

Data science is dierent
http://data.whicdn.com/images/29273643/funny-science-news-experiments-memes-super-science_large.jpg

Research doesnt t
the traditional SDLC
image src:http://laurajul.dk/wp-content/uploads/2011/10/Screen-shot-2011-10-06-at-00.03.57.png

Good help
is hard to nd
(and keep)
image src: legoexpress.tumblr.com

What are they
doing all day?

Bring transparency
image src: www.ideachampions.com

Communication
Logistics
Trust

Communication

Do you speak the same language?
image src: abclang.livejournal.com

What does it mean to be nished?
image source: ladywhodoesntlunch.blogspot.com

Dene
quality
image source: http://www.sodahead.com/fun/

R
Give them
a lesson in
P
semantics
What do precision
and recall mean?

Before
Precision: 80%
Recall 25%

After
For the top search terms* accessories appear
25% of the time on the rst page.
For top search terms the head products are

present 90% of the time in the top 3 results,
98% of the time in the top5.
Top search terms are the 1000 most popular queries on our website
over the last 30 days.

Measure with data that matters
image source: http://www.freepatentsonline.com/6971185-0-large.jpg

This is a really hard
problem.

We know it is hard...

We know it is hard...
but we dont know
why it is hard.

Use analogies
& examples

Use analogies
& examples
The dandelion swayed in the gentle breeze like

an oscillating electric fan set on medium.

Constructing model lineages for
products is really dicult.

Macbook Pro Bravia
EX523 LCD
Macbook
? Bravia
?
EX500 LCD
Bravia
EX620 LED
Macbook Air
Be specic
Take it up a level
We are
building a
lineage
Product Evolution

Show
before
image src: www.clarkgriswoldcollection.com

Show
before
and
after
image src: www.clarkgriswoldcollection.com

Logistics

How do
you create
a sense of
urgency?
image source: http://favim.com/image/503182/

What are
the reasons
behind it?
image source: http://dailyfailcenter.com/sites/default/les/fail/explain-this-shit.jpg

Deadlines in
research?

They dont
call it
research
for nothin
image source: http://sausagetails.com/2012/07/

You cant predict the future
image source: maxseesmovies.blogspot.com

Applying agile to R&D
image source:http://mousebreath.com/wp-content/uploads/2011/08/funny-farmers.jpg
Backlog of
Trips to Hawaii experiments
Thats doesnt
sound agile....
Regular Demos
Backlog of
Thats doesnt
sound agile....
Regular Demos Dened workow

with iterations
Backlog of
Thats doesnt
sound agile....
No Start Here
Collect
Data Ye
Do we have the s
right data?
Data
No
Do we have the
Are we
infrastructure to
nished or do Build it...
analyze the
we need
Re data?
more.....? se
arc
h
e s
Y
Get results Run experiments

Experiments can take a while...

image source: www.wallpapermay.com

Take tools out of the equation
image source: http://www.holesinyoursocks.com/2011/02/14/funny-monday-tool-love-happy-valentines-day/

Focus on feeds and les
Image source: http://carcat.les.wordpress.com/2009/03/funny-pictures-cat-searches-for-a-le.jpg

Format & storage standards
/prices
/full
/date=2012-07-01
price-obs.2012-07-01.csv.gz
/date=2012-07-02
/inc
/date=2012-07-01
2012-07-01T00-10-00.csv.gz
2012-07-01T00-20-00.csv.gz

Where is your golden set?
image source: ads/2011/09/4bc2dd714ecb9eebb3a66d074638.jpeg

Trust

What are they
doing all day?

Building trust
image source: http://writealoud.com/funny-dinosaur-pictures/

Their motivations
image src: http://www.fredhoogervorst.com/oni.app/local/upload/03897400db.jpg

Their motivations
Hard problems
to solve

Their motivations
Hard problems
to solve
My work in the wild

serving customers

Their motivations
Hard problems
to solve
Recognition for a
job well done
Being GOLD!
My work in the wild
serving customers

Their motivations
Hard problems
to solve
Recognition for a
job well done
Open the door to

higher-ups
Being GOLD!
My work in the wild
serving customers

Minimize
time-to-ship
image source: : http://2smallerwheels.blogspot.com/2011/09/speedy-delivery.html

Let them own the data
image source: http://www.cloudproviderusa.com/weekly-dose-of-humor-mo-data-mo-problems/

Let me write a program
image src: http://funnylez.funnypart.com/pictures/FunnyPart-com-geek_on_the_go.jpg

Algorithms cant solve
everything

Algorithms cant solve
everything
Even though we
wish they could!

Manual data can be awesome
image source: http://www.funnyjunk.com/funny_pictures/4416618/LOOK+AT+DE+PUPPY/

Can you do the
impossible?
image source: anybody-want-a-peanut.blogspot.com

Data
Miners
arent
magicians
image source: http://1.bp.blogspot.com/_zmT48r8jfbE/S1z4t5L7JxI/AAAAAAAAAJU/1vYZmc5lhBU/s400/steve-brooks-magician.jpg

You CAN make failure look good
image source: http://ghtthebees.com/wp-content/uploads/2011/11/cow-fail.jpg

Your challenge:

Your challenge:
Should you choose

to accept it....

Your challenge:
Take a dicult problem and
transform it into a feature
Should you choose

to accept it....

HARD: Value Estimation
1.7GHz dual-core
Intel Core i5 $300
256GB ash storage $250
Intel HD Graphics $100

4000
8GB SDRAM $200
Apple premium $200
Estimated Value: $1050

EASIER: Comparing Products

Think with your business hat
image source: memegenerator.net

How do you surface
ideas & insights?
image source: http://static.someecards.com/someecards/usercards/1327680406361_4248272.png

Show em
image source: neslihandurmusoglu.edublogs.org

And
show em
often
image source: http://www.social-science.co.uk/research/

Negative results happen
image source: http://www.theofrak.com/2012/09/existential-star-wars.html

The journey is the reward
image source: failblog.org

Communication

Communication
Logistics

Communication
Logistics
Trust

Questions
http://katemats.com
@katemats

May the forces of evil
get lost on the way to
your doorstep.
Questions
http://katemats.com
@katemats

The Science of Managing Data Scientists: Kate Matsudaira

Diunggah oleh

Informasi Dokumen

Deskripsi Asli:

Judul Asli

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

The Science of Managing Data Scientists: Kate Matsudaira

Diunggah oleh

Hak Cipta:

Format Tersedia

The Science of

Managing Data Scientists

Tuesday, February 26, 13

Tuesday, February 26, 13

Tuesday, February 26, 13

Tuesday, February 26, 13

image src: legoexpress.tumblr.com

Tuesday, February 26, 13

Tuesday, February 26, 13

image src: www.ideachampions.com

Tuesday, February 26, 13

Tuesday, February 26, 13

Tuesday, February 26, 13

image src: abclang.livejournal.com

Tuesday, February 26, 13

image source: ladywhodoesntlunch.blogspot.com

Tuesday, February 26, 13

image source: http://www.sodahead.com/fun/

Tuesday, February 26, 13

Tuesday, February 26, 13

Tuesday, February 26, 13

For top search terms the head products are

Tuesday, February 26, 13

image source: http://www.freepatentsonline.com/6971185-0-large.jpg

Tuesday, February 26, 13

Tuesday, February 26, 13

Tuesday, February 26, 13

Tuesday, February 26, 13

The dandelion swayed in the gentle breeze like

Tuesday, February 26, 13

Tuesday, February 26, 13

Tuesday, February 26, 13

image src: www.clarkgriswoldcollection.com

Tuesday, February 26, 13

Tuesday, February 26, 13

Tuesday, February 26, 13

image source: http://favim.com/image/503182/

Tuesday, February 26, 13

image source: http://dailyfailcenter.com/sites/default/les/fail/explain-this-shit.jpg

Tuesday, February 26, 13

Tuesday, February 26, 13

image source: http://sausagetails.com/2012/07/

Tuesday, February 26, 13

image source: maxseesmovies.blogspot.com

Regular Demos Dened workow

Get results Run experiments

Tuesday, February 26, 13

Tuesday, February 26, 13

image source: http://www.holesinyoursocks.com/2011/02/14/funny-monday-tool-love-happy-valentines-day/

Tuesday, February 26, 13

Image source: http://carcat.les.wordpress.com/2009/03/funny-pictures-cat-searches-for-a-le.jpg

Tuesday, February 26, 13

Tuesday, February 26, 13

image source: ads/2011/09/4bc2dd714ecb9eebb3a66d074638.jpeg

Tuesday, February 26, 13

Tuesday, February 26, 13

Tuesday, February 26, 13

image source: http://writealoud.com/funny-dinosaur-pictures/

Tuesday, February 26, 13

image src: http://www.fredhoogervorst.com/oni.app/local/upload/03897400db.jpg

Tuesday, February 26, 13

image src: http://www.fredhoogervorst.com/oni.app/local/upload/03897400db.jpg