文件列表:

SentimentAnalysisofSinhalaNewsComments.pdf (1202121, 2022-05-14)
application.properties (24, 2022-05-14)
corpus (0, 2022-05-14)
corpus\analyzed (0, 2022-05-14)
corpus\analyzed\comments_all.csv (77148753, 2022-05-14)
corpus\analyzed\comments_tagged.csv (1321499, 2022-05-14)
corpus\kappa (0, 2022-05-14)
corpus\kappa\1 (0, 2022-05-14)
corpus\kappa\1\100204.txt (17169, 2022-05-14)
corpus\kappa\1\100475.txt (15028, 2022-05-14)
corpus\kappa\1\101559.txt (14897, 2022-05-14)
corpus\kappa\1\101944.txt (40327, 2022-05-14)
corpus\kappa\1\102756.txt (16047, 2022-05-14)
corpus\kappa\1\103990.txt (15587, 2022-05-14)
corpus\kappa\1\105789.txt (16550, 2022-05-14)
corpus\kappa\1\105812.txt (31859, 2022-05-14)
corpus\kappa\1\107019.txt (22381, 2022-05-14)
corpus\kappa\1\107342.txt (16339, 2022-05-14)
corpus\kappa\1\107507.txt (43970, 2022-05-14)
corpus\kappa\1\108192.txt (21109, 2022-05-14)
corpus\kappa\1\108684.txt (17710, 2022-05-14)
corpus\kappa\1\113922.txt (18603, 2022-05-14)
corpus\kappa\1\114780.txt (14183, 2022-05-14)
corpus\kappa\1\115652.txt (13924, 2022-05-14)
corpus\kappa\1\118450.txt (25185, 2022-05-14)
corpus\kappa\1\121120.txt (17224, 2022-05-14)
corpus\kappa\1\122150.txt (19113, 2022-05-14)
corpus\kappa\1\122704.txt (21187, 2022-05-14)
corpus\kappa\1\123076.txt (18006, 2022-05-14)
corpus\kappa\1\124564.txt (39804, 2022-05-14)
corpus\kappa\1\124680.txt (16199, 2022-05-14)
corpus\kappa\1\125388.txt (17656, 2022-05-14)
corpus\kappa\1\44969.txt (17467, 2022-05-14)
corpus\kappa\1\44974.txt (13098, 2022-05-14)
corpus\kappa\1\44992.txt (17015, 2022-05-14)
corpus\kappa\1\45272.txt (26787, 2022-05-14)
corpus\kappa\1\45483.txt (22393, 2022-05-14)
... ...

Sentiment Analysis of Sinhala News Comments ============================================ ## Summary This project contains all submodules for building a sentiment classification workflow for Sinhala news comments. Project contains both Java and Python source code, where, data acquisition process is developed in Java and data analysis and classification processes are developed in python. Project also contains the dataset used for the analysis. Sentiment classification process involves following steps. 1. Crawling and collecting data 2. Initial data filtering and preparing for data labeling process 3. Labeling data (comments) on its sentiment value 4. Further pre-processing data and preparing for classification 5. Classification and result interpretation ## Details ### Downloading Word2Vec Models Since Word2Vec models are larger than 100MB, they can't be stored in git as ordinary files. Previously, they were stored using git-lfs. But due to free limits, now you can find these models including code to generate them in [this Google Drive directory](https://drive.google.com/drive/folders/0B2X9V68JgvRCUGNrVXZOWlh6REU?resourcekey=0-GW3r-eg3VTZJSDys54jpTg&usp=sharing). Copy models into `$PROJECT/corpus/analyzed/saved_models/` directory. ### Directory Structure and Files ``` +-- corpus - data files and generated models | +-- analyzed | | +-- saved_models | +-- raw_data | +-- tagged +-- src/main/java - Java source code (data collection, tagging and cleaning) +-- src/main/python - Python source code (pre-processing, analysis/classification) +-- src/main/resources - static resource (html, properties) +-- README.md +-- pom.xml ``` #### Dataset ##### Summary of dataset - Number of articles: 16840 - Number of comments: 290189 - Total number of article words: 4310193 - Total number of comment words: 4587547 - Number of unique words in articles: 262016 - Number of unique words in comments: 237775 ```corpus``` directory contains dataset and analysed models. ```raw_data```: This directory contains news articles with associating comments. These files contains original news articles before any of the preprocessing steps. ```analyzed```: This directory contains the pre-processed file and generated models ```saved_models```: Holds generated models (eg. word2wec model) ##### Word2Vec Models Generated Word2Vec models can be found under ```/corpus/analyzed/saved_models```. These models were generated using only the comments of the articles (article content was not used for generating models). ### Results ``` +---------------------+----------------+----------------+----------------+----------------+ | Algorithm | Accuracy | Precision | Recall | F1_Score | +---------------------+----------------+----------------+----------------+----------------+ | Naive Bayes | 0.776946107784 | 0.840740740741 | 0.690690690691 | 0.752902155887 | | Random Forest | 0.859281437126 | 0.91159586682 | 0.794794794795 | 0.849197860963 | | Logistic Regression | 0.8677***471058 | 0.916099773243 | 0.808808808809 | 0.859117490696 | | SVM | 0.869261477046 | 0.923076923077 | 0.804804804805 | 0.85***93048128 | | RNN LSTM | 0.8***583331347 | 0.891712707182 | 0.853146853147 | 0.861719167111 | +---------------------+----------------+----------------+----------------+----------------+ ``` #### Note Dataset used in this project is collected by crawling Sinhala online news sites, mainly www.lankadeepa.lk. ### contact Please contact us if you need more information. - Surangika Ranathunga - Isuru Liyanage ### cite If you use this data, code, or the trained models, please cite this work Ranathunga, S., & Liyanage, I. U. (2021). Sentiment Analysis of Sinhala News Comments. Transactions on Asian and Low-Resource Language Information Processing, 20(4), 1-23.

近期下载者：

相关文件：

评论：[我要评论] [举报此文件]

收藏者：