UUM Electronic Theses and Dissertation
UUM ETD | Universiti Utara Malaysian Electronic Theses and Dissertation
FAQs | Feedback | Search Tips | Sitemap

A study of feature exraction techniques for classifying topics and sentiments from news posts

Al-Dyani, Wafa Zubair Abdullah (2014) A study of feature exraction techniques for classifying topics and sentiments from news posts. Masters thesis, Universiti Utara Malaysia.

[thumbnail of s814383_01.pdf]

Download (4MB) | Preview
[thumbnail of s814383_02.pdf]

Download (1MB) | Preview


Recently, many news channels have their own Facebook pages in which news posts have been released in a daily basis. Consequently, these news posts contain temporal opinions about social events that may change over time due to external factors as well as may use as a monitor to the significant events happened around the world. As a result, many text mining researches have been conducted in the area of Temporal Sentiment Analysis, which one of its most challenging tasks is to detect and extract
the key features from news posts that arrive continuously overtime. However, extracting these features is a challenging task due to post’s complex properties, also posts about a specific topic may grow or vanish overtime leading in producing imbalanced datasets. Thus, this study has developed a comparative analysis on feature extraction Techniques which has examined various feature extraction techniques (TF-IDF, TF, BTO, IG, Chi-square) with three different n-gram features (Unigram, Bigram, Trigram), and using SVM as a classifier. The aim of this study is to discover the optimal Feature Extraction Technique (FET) that could achieve optimum accuracy results for both topic and sentiment classification. Accordingly, this analysis is conducted on three news channels’ datasets. The experimental results for topic classification have shown that Chi-square with unigram have proven to be the best FET compared to other techniques. Furthermore, to overcome the problem of imbalanced data, this study has combined the best FET with OverSampling
technology. The evaluation results have shown an improvement in classifier’s performance and has achieved a higher accuracy at 93.37%, 92.89%, and 91.92 for BBC, Al-Arabiya, and Al-Jazeera, respectively, compared to what have been obtained on original datasets. Similarly, same combination (Chi-square+Unigram) has been used for sentiment classification and obtained accuracies at rates of 81.87%, 70.01%, 77.36%. However, testing the recognized optimal FET on unseen randomly selected news posts has shown a relatively very low accuracies for both topic and sentiment classification due to the changes of topics and sentiments over time.

Item Type: Thesis (Masters)
Supervisor : Kabir Ahmad, Farzana
Item ID: 5618
Uncontrolled Keywords: Text mining, Text classification, Temporal Sentiment analysis, Feature extraction techniques, News channels, Social events, Imbalanced data
Subjects: T Technology > T Technology (General) > T58.5-58.64 Information technology
Divisions: Awang Had Salleh Graduate School of Arts & Sciences
Date Deposited: 16 May 2016 09:35
Last Modified: 09 Apr 2022 23:28
Department: Awang Had Salleh Graduate School of Arts and Sciences
Name: Kabir Ahmad, Farzana
URI: https://etd.uum.edu.my/id/eprint/5618

Actions (login required)

View Item
View Item