Page 1 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
What is data? What is data?
Jeffrey Leek, Assistant Professor of Biostatistics
Johns Hopkins Bloomberg School of Public Health
1/22/13 3:24 PM What is data?
Page 2 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Definition of data Definition of data
Data are values of qualitative or
quantitative variables, belonging to a
set of items.
http://en.wikipedia.org/wiki/Data
2/19
1/22/13 3:24 PM What is data?
Page 3 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Definition of data Definition of data
Data are values of qualitative or
quantitative variables, belonging to a
set of items.
http://en.wikipedia.org/wiki/Data
Set of items: Sometimes called the population; the set of objects you are interested in
3/19
1/22/13 3:24 PM What is data?
Page 4 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Definition of data Definition of data
Data are values of qualitative or
quantitative variables, belonging to a
set of items.
http://en.wikipedia.org/wiki/Data
Variables: A measurement or characteristic of an item.
4/19
1/22/13 3:24 PM What is data?
Page 5 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Definition of data Definition of data
Data are values of qualitative or
quantitative variables, belonging to a
set of items.
http://en.wikipedia.org/wiki/Data
Qualitative: Country of origin, sex, treatment
Quantitative: Height, weight, blood pressure
5/19
1/22/13 3:24 PM What is data?
Page 6 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Raw versus processed data Raw versus processed data
Raw data
http://en.wikipedia.org/wiki/Raw_data
Processed data
http://en.wikipedia.org/wiki/Computer_data_processing
The original source of the data
Often hard to use for data analyses
Data analysis includes processing
Raw data may only need to be processed once
6/19
1/22/13 3:24 PM What is data?
Page 7 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
An example of a processing pipeline An example of a processing pipeline
http://www.illumina.com.cn/support/sequencing/sequencing_instruments/hiseq_1000.asp
7/19
1/22/13 3:24 PM What is data?
Page 8 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
An example of a processing pipeline An example of a processing pipeline
http://www.cbcb.umd.edu/~hcorrada/CMSC858B/lectures/lect22_seqIntro/seqIntro.pdf
8/19
1/22/13 3:24 PM What is data?
Page 9 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
What do raw data look like? What do raw data look like?
http://brianknaus.com/software/srtoolbox/s_4_1_sequence80.txt
9/19
1/22/13 3:24 PM What is data?
Page 10 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
What do raw data look like? What do raw data look like?
https://dev.twitter.com/docs/api/1/get/blocks/blocking
10/19
1/22/13 3:24 PM What is data?
Page 11 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
What do raw data look like? What do raw data look like?
http://blue-button.github.com/challenge/
11/19
1/22/13 3:24 PM What is data?
Page 12 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
What do processed data look like? What do processed data look like?
http://vita.had.co.nz/papers/tidy-data.pdf
Leek, Taub, and Pineda 2011 PLoS One
1. Each variable forms a column
2. Each observation forms a row
3. Each table/file stores data about one kind of observation (e.g. people/hospitals).
12/19
1/22/13 3:24 PM What is data?
Page 13 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
How much is there? How much is there?
http://mashable.com/2011/06/28/data-infographic/
13/19
1/22/13 3:24 PM What is data?
Page 14 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
So what about big data? So what about big data?
14/19
1/22/13 3:24 PM What is data?
Page 15 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Depends on your perspective Depends on your perspective
15/19
1/22/13 3:24 PM What is data?
Page 16 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Why big data now? Why big data now?
Travers and Milgram (1969) Sociometry
16/19
1/22/13 3:24 PM What is data?
Page 17 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Why big data now? Why big data now?
Leskovec and Horvitz WWW '08
17/19
1/22/13 3:24 PM What is data?
Page 18 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Big or small - you need the right data Big or small - you need the right data
The data may not contain the answer.
The combination of some data and an
aching desire for an answer does not
ensure that a reasonable answer can
be extracted from a given body of
data...
Tukey
18/19
1/22/13 3:24 PM What is data?
Page 19 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Big or small - you need the right data Big or small - you need the right data
...no matter how big the data are.
Leek
19/19