UUM ETD | Universiti Utara Malaysian Electronic Theses and Dissertation
FAQs | Feedback | Search Tips | Sitemap

Winsorize tree algorithm for handling outliers in classification problem

Ch’ng, Chee Keong (2016) Winsorize tree algorithm for handling outliers in classification problem. PhD. thesis, Universiti Utara Malaysia.

[img] Text
depositpermission_s92068.pdf
Restricted to Repository staff only

Download (270kB)
[img]
Preview
Text
s92068_01.pdf

Download (9MB) | Preview

Abstract

Classification and Regression Tree (CART) is designed to predict or classify the objects in the predetermined classes from a set of predictors. However, having outliers could affect the structures of CART, purity and predictive accuracy in classification. Some researchers opt to perform pre-pruning or post-pruning of the CART in handling the outliers. This study proposes a modified classification tree algorithm called Winsorize tree based on the distribution of classes in the training dataset. The Winsorize tree investigates all possible outliers from node to node before checking the potential splitting point to gain the node with the highest purity of the nodes. The upper fence and lower fence of a boxplot are used to detect potential outliers whose values exceeding the tail of Q ± (1.5×Interquartile range). The identified outliers are neutralized using the Winsorize method whilst the Winsorize Gini index is then used to compute the divergences among probability distributions of the target predictor’s values until stopping criteria are met. This study uses three stopping rules: node achieved the minimum 10% of total training set,

Item Type: Thesis (PhD.)
Uncontrolled Keywords: Classification tree, Outliers, Winsorize Gini index, Winsorize tree algorithm
Subjects: Q Science > QA Mathematics > QA273-280 Probabilities. Mathematical statistics
Divisions: Awang Had Salleh Graduate School of Arts & Sciences
Depositing User: Mr. Badrulsaman Hamid
Date Deposited: 08 Aug 2016 10:50
Last Modified: 03 Jun 2018 07:21
URI: http://etd.uum.edu.my/id/eprint/5780

Actions (login required)

View Item View Item