Anda di halaman 1dari 19

1/22/13 3:24 PM What is data?

Page 1 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
What is data? What is data?
Jeffrey Leek, Assistant Professor of Biostatistics
Johns Hopkins Bloomberg School of Public Health
1/22/13 3:24 PM What is data?
Page 2 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Definition of data Definition of data
Data are values of qualitative or
quantitative variables, belonging to a
set of items.
http://en.wikipedia.org/wiki/Data

2/19
1/22/13 3:24 PM What is data?
Page 3 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Definition of data Definition of data
Data are values of qualitative or
quantitative variables, belonging to a
set of items.
http://en.wikipedia.org/wiki/Data
Set of items: Sometimes called the population; the set of objects you are interested in

3/19
1/22/13 3:24 PM What is data?
Page 4 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Definition of data Definition of data
Data are values of qualitative or
quantitative variables, belonging to a
set of items.
http://en.wikipedia.org/wiki/Data
Variables: A measurement or characteristic of an item.

4/19
1/22/13 3:24 PM What is data?
Page 5 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Definition of data Definition of data
Data are values of qualitative or
quantitative variables, belonging to a
set of items.
http://en.wikipedia.org/wiki/Data
Qualitative: Country of origin, sex, treatment
Quantitative: Height, weight, blood pressure

5/19
1/22/13 3:24 PM What is data?
Page 6 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Raw versus processed data Raw versus processed data
Raw data
http://en.wikipedia.org/wiki/Raw_data
Processed data
http://en.wikipedia.org/wiki/Computer_data_processing
The original source of the data
Often hard to use for data analyses
Data analysis includes processing
Raw data may only need to be processed once

Data that is ready for analysis


Processing can include merging, subsetting, transforming, etc.
There may be standards for processing
All steps should be recorded

6/19
1/22/13 3:24 PM What is data?
Page 7 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
An example of a processing pipeline An example of a processing pipeline
http://www.illumina.com.cn/support/sequencing/sequencing_instruments/hiseq_1000.asp
7/19
1/22/13 3:24 PM What is data?
Page 8 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
An example of a processing pipeline An example of a processing pipeline
http://www.cbcb.umd.edu/~hcorrada/CMSC858B/lectures/lect22_seqIntro/seqIntro.pdf
8/19
1/22/13 3:24 PM What is data?
Page 9 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
What do raw data look like? What do raw data look like?
http://brianknaus.com/software/srtoolbox/s_4_1_sequence80.txt
9/19
1/22/13 3:24 PM What is data?
Page 10 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
What do raw data look like? What do raw data look like?
https://dev.twitter.com/docs/api/1/get/blocks/blocking
10/19
1/22/13 3:24 PM What is data?
Page 11 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
What do raw data look like? What do raw data look like?
http://blue-button.github.com/challenge/
11/19
1/22/13 3:24 PM What is data?
Page 12 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
What do processed data look like? What do processed data look like?
http://vita.had.co.nz/papers/tidy-data.pdf
Leek, Taub, and Pineda 2011 PLoS One
1. Each variable forms a column
2. Each observation forms a row
3. Each table/file stores data about one kind of observation (e.g. people/hospitals).
12/19
1/22/13 3:24 PM What is data?
Page 13 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
How much is there? How much is there?
http://mashable.com/2011/06/28/data-infographic/
13/19
1/22/13 3:24 PM What is data?
Page 14 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
So what about big data? So what about big data?
14/19
1/22/13 3:24 PM What is data?
Page 15 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Depends on your perspective Depends on your perspective
15/19
1/22/13 3:24 PM What is data?
Page 16 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Why big data now? Why big data now?
Travers and Milgram (1969) Sociometry
16/19
1/22/13 3:24 PM What is data?
Page 17 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Why big data now? Why big data now?
Leskovec and Horvitz WWW '08
17/19
1/22/13 3:24 PM What is data?
Page 18 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Big or small - you need the right data Big or small - you need the right data
The data may not contain the answer.
The combination of some data and an
aching desire for an answer does not
ensure that a reasonable answer can
be extracted from a given body of
data...
Tukey

18/19
1/22/13 3:24 PM What is data?
Page 19 of 19 file:///Users/jtleek/Dropbox/Jeff/teaching/2013/coursera/week1/003whatIsData/index.html#1
Big or small - you need the right data Big or small - you need the right data
...no matter how big the data are.
Leek

19/19

Anda mungkin juga menyukai