Scribd Logo
Unggah

Selamat datang di Scribd!

  • Techniques for handling missing values in datasets including prediction, imputation and more

    Diunggah oleh

    Chanpreet Singh
    14 tayangan10 halaman
    The document discusses techniques for handling missing values in data. It describes common techniques for imputing missing values based on the variable type, whether categorical or numeric, and whether the associated variable is also categorical or numeric. Some key techniques mentioned include decision trees, naive Bayesian classification, logistic regression, k-nearest neighbors classification, and regression models. It notes assumptions of different techniques, such as decision trees requiring no assumptions while regression assumes normality and homoscedasticity.

    Deskripsi Asli:

    How to handle missing values

    Judul Asli

    Missing Values

    Hak Cipta

    © © All Rights Reserved

    Format Tersedia

    PPTX, PDF, TXT atau baca online dari Scribd

    Apakah menurut Anda dokumen ini bermanfaat?

    Apakah konten ini tidak pantas?

    Laporkan Dokumen Ini
    The document discusses techniques for handling missing values in data. It describes common techniques for imputing missing values based on the variable type, whether categorical or numeric, and whether the associated variable is also categorical or numeric. Some key techniques mentioned include decision trees, naive Bayesian classification, logistic regression, k-nearest neighbors classification, and regression models. It notes assumptions of different techniques, such as decision trees requiring no assumptions while regression assumes normality and homoscedasticity.

    Hak Cipta:

    © All Rights Reserved
    Unduh sebagai PPTX, PDF, TXT atau baca online dari Scribd
    Tandai sebagai konten tidak pantas
    14 tayangan10 halaman

    Techniques for handling missing values in datasets including prediction, imputation and more

    Diunggah oleh

    Chanpreet Singh
    The document discusses techniques for handling missing values in data. It describes common techniques for imputing missing values based on the variable type, whether categorical or numeric, and whether the associated variable is also categorical or numeric. Some key techniques mentioned include decision trees, naive Bayesian classification, logistic regression, k-nearest neighbors classification, and regression models. It notes assumptions of different techniques, such as decision trees requiring no assumptions while regression assumes normality and homoscedasticity.

    Hak Cipta:

    © All Rights Reserved
    Unduh sebagai PPTX, PDF, TXT atau baca online dari Scribd
    Tandai sebagai konten tidak pantas
    dari 10

    Missing values

    Data

    Less outliers
    Large
    dataset

    numeric

    Mean

    Median

    Categori
    cal

    Mode

    Missing value through prediction


    Missing
    variable

    Associat
    ed
    variable

    Type of
    technique

    Categorical

    Categori
    cal

    Categorical

    Numeric

    Remarks

    Assumptions

    Decision
    tree
    Nave
    Bayesian

    Decesion tree
    need no
    assumption

    Nave bayes
    assume
    independent
    variables

    Logistic
    regression
    K-NN
    classifier

    K-NN
    CLASSIFIER
    need no
    assumption

    Regression
    assumption of
    normality,
    homoscedasticity
    etc
    Regression
    assumption of
    normality,
    homoscedasticity
    etc

    Numeric

    Numeric

    Regression
    model
    Clustering

    Clustering
    need no
    assumption

    Numeric

    Categori
    cal

    Clustering

    No
    assumption

    Categorical

    Both

    Decision

    No

    Regression

    K-NN Classifier

    3-NN
    classifier

    K-NN Classifier

    K-NN Classifier

    K-NN Classifier

    If k is too small, sensitive to noise points


    If k is too large, neighborhood may include points
    from other classes

    K-NN Classifier
    Attributes may have to be scaled to prevent distance measures from being
    dominated by one of the attributes

    Knn classifier is a lazy


    learner because
    It does not build models
    explicitly

    Testing with different k

    Nave Bayesian
    Classifier
    P(A|B) = P(B|A) *P(A) / P(B)
    theorem )

    (Bayes

    P(Spam|free)=P(free|spam)* P(Spam) /
    P(free)
    Since P(Spam|free) > P(ham|free) ,
    hence with this word, the message is
    classified as spam

    Step 4 : Applying the classifier


    library(e1071)
    sms_classifier <- naiveBayes(sms_train, sms_raw_train$type)

    How it works
    1

    If output eqn 1 is greater then eqn 2 ,


    its classified as spam o/w ham

    Anda mungkin juga menyukai