id/didi/
Data Mining
Pengklasifikasian: Rule-based Classifier
Rule-Based Classifier
z
Aturan/Rule:
4/18/2004
human
python
salmon
whale
frog
komodo
bat
pigeon
cat
leopard shark
turtle
penguin
porcupine
eel
salamander
gila monster
platypus
owl
dolphin
eagle
Blood Type
warm
cold
cold
warm
cold
cold
warm
warm
warm
cold
cold
warm
warm
cold
cold
cold
warm
warm
warm
warm
Give Birth
yes
no
no
yes
no
no
yes
no
yes
yes
no
no
yes
no
no
no
no
no
yes
no
Can Fly
no
no
no
no
no
no
yes
yes
no
no
no
no
no
no
no
no
no
yes
no
yes
Live in Water
no
no
yes
yes
sometimes
no
no
no
no
yes
sometimes
sometimes
no
yes
sometimes
no
no
no
yes
no
Tan,Steinbach, Kumar
4/18/2004
Class
mammals
reptiles
fishes
mammals
amphibians
reptiles
mammals
birds
mammals
fishes
reptiles
birds
mammals
fishes
amphibians
reptiles
mammals
birds
mammals
birds
dialihbahasakan oleh
Tim Pengajar Konsep Data Mining
Universitas Gunadarma
Tan,Steinbach, Kumar
(Kondisi) y
dimana
4/18/2004
hawk
grizzly bear
Blood Type
warm
warm
Give Birth
Can Fly
Live in Water
Class
no
yes
yes
no
no
no
?
?
Tan,Steinbach, Kumar
4/18/2004
Tan,Steinbach, Kumar
Taxable
Income Class
Yes
Single
125K
No
No
Married
100K
No
No
Single
70K
No
Yes
Married
120K
No
No
Divorced 95K
Yes
No
Married
No
Yes
Divorced 220K
No
Single
85K
Yes
No
Married
75K
No
10
No
Single
90K
Yes
60K
No
Give Birth
Can Fly
Live in Water
Class
yes
no
yes
no
no
no
no
sometimes
yes
?
?
?
4/18/2004
Tan,Steinbach, Kumar
4/18/2004
Aturan Exhaustive
Classifier memiliki lingkupan exhaustive jika mencatat
untuk setiap kemungkinan kombinasi nilai atribut
Setiap record paling sedikit dilingkupi oleh satu aturan
Blood Type
warm
cold
cold
(Status=Single) No
Tan,Steinbach, Kumar
Name
lemur
turtle
dogfish shark
10
Aturan Pengklasifikasian
(Refund=Yes) ==> No
Refund
Yes
No
NO
Marita l
Status
{Single,
Divorced}
{Married}
NO
NO
Taxable
Income
< 80K
> 80K
YES
Tan,Steinbach, Kumar
4/18/2004
Taxable
Income Cheat
Yes
Single
125K
No
No
Married
100K
No
No
Single
70K
No
Yes
Married
120K
No
No
Divorced 95K
No
Married
Yes
Divorced 220K
No
No
Single
85K
Yes
No
Married
75K
No
10
No
Single
90K
Yes
Refund
Yes
No
NO
Marita l
Status
{Single,
Divorced}
{Married}
NO
Taxable
Income
< 80K
> 80K
NO
YES
No
10
(Refund=No) (Status=Married) No
Aturan Awal:
Yes
60K
4/18/2004
4/18/2004
10
Tan,Steinbach, Kumar
turtle
Tan,Steinbach, Kumar
Blood Type
cold
Give Birth
Can Fly
Live in Water
Class
no
no
sometimes
4/18/2004
11
Tan,Steinbach, Kumar
4/18/2004
12
1.
2.
3.
z
Tan,Steinbach, Kumar
4/18/2004
4.
13
Tan,Steinbach, Kumar
4/18/2004
14
R1
R1
R2
Tan,Steinbach, Kumar
(iii) Langkah 2
(ii) Langkah 1
4/18/2004
15
Tan,Steinbach, Kumar
(iv) Langkah 3
4/18/2004
16
Instance Elimination
Tan,Steinbach, Kumar
Rule Growing
z
4/18/2004
17
Tan,Steinbach, Kumar
Algoritma CN2 :
18
4/18/2004
4/18/2004
20
4/18/2004
Algoritma RIPPER:
Tan,Steinbach, Kumar
Instance Elimination
19
Tan,Steinbach, Kumar
Rule Evaluation
z
Metrik:
Accuracy
Laplace
n
= c
n
M-estimate
Tan,Steinbach, Kumar
nc + 1
n+k
nc + kp
n+k
n : Number of instances
covered by rule
Stopping criterion
Menghitung hasil yang didapat (gain)
Jika gain tidak signifikan, maka jangan perhatikan
aturan yang bar
Rule Pruning
Serupa dengan pasca pemangkasan (post-pruning)
pada pohon keputusan
Mereduksi Error Pruning:
nc : Number of instances
covered by rule
k : Number of classes
p : Prior probability
4/18/2004
21
Tan,Steinbach, Kumar
4/18/2004
22
Tan,Steinbach, Kumar
4/18/2004
23
Tan,Steinbach, Kumar
4/18/2004
24
Mengembangkan aturan:
Mulai dari aturan hampa
Tambah konjungsi apabila dapat merubah FOILs
information gain
Berhenti ketika aturan tidak lagi melingkupi conothcontoh negatif
Pangkas aturan segera, menggunakan incremental
reduced error pruning
Mengukur nilai pruning: v = (p-n)/(p+n)
4/18/2004
25
Tan,Steinbach, Kumar
4/18/2004
26
4/18/2004
28
Tan,Steinbach, Kumar
4/18/2004
27
Tan,Steinbach, Kumar
Tan,Steinbach, Kumar
4/18/2004
29
Contoh
Name
human
python
salmon
whale
frog
komodo
bat
pigeon
cat
leopard shark
turtle
penguin
porcupine
eel
salamander
gila monster
platypus
owl
dolphin
eagle
Tan,Steinbach, Kumar
Tan,Steinbach, Kumar
4/18/2004
30
yes
no
no
yes
no
no
yes
no
yes
yes
no
no
yes
no
no
no
no
no
yes
no
Lay Eggs
no
yes
yes
no
yes
yes
no
yes
no
no
yes
yes
no
yes
yes
yes
yes
yes
no
yes
Can Fly
no
no
no
no
no
no
yes
yes
no
no
no
no
no
no
no
no
no
yes
no
yes
no
no
yes
yes
sometimes
no
no
no
no
yes
sometimes
sometimes
no
yes
sometimes
no
no
no
yes
no
yes
no
no
no
yes
yes
yes
yes
yes
no
yes
yes
yes
no
yes
yes
yes
yes
no
yes
Class
4/18/2004
C4.5rules:
Give
Birth?
mammals
reptiles
fishes
mammals
amphibians
reptiles
mammals
birds
mammals
fishes
reptiles
birds
mammals
fishes
amphibians
reptiles
mammals
birds
mammals
birds
Yes
No
Live In
Water?
( ) Amphibians
Mammals
Yes
RIPPER:
No
Sometimes
Fishes
Yes
Birds
31
Tan,Steinbach, Kumar
Can
Fly?
Amphibians
No
() Mammals
Reptiles
4/18/2004
32
PREDICT ED CLASS
Amphibians Fishes Reptiles Birds
2
0
0
ACT UAL Amphibians
0
2
0
CLASS Fishes
1
0
3
Reptiles
1
0
0
Birds
0
0
1
M ammals
0
0
0
3
0
M ammals
0
1
0
0
6
0
0
0
2
0
M ammals
2
0
1
1
4
RIPPER:
PREDICT ED CLASS
Amphibians Fishes Reptiles Birds
0
0
0
ACT UAL Amphibians
0
3
0
CLASS Fishes
0
0
3
Reptiles
0
0
1
Birds
0
2
1
M ammals
Tan,Steinbach, Kumar
4/18/2004
33
Tan,Steinbach, Kumar
4/18/2004
34