Research Article

Sentiment Analysis for Software Engineering Domain in Turkish

Volume: 3 Number: 3 December 30, 2020
EN

Sentiment Analysis for Software Engineering Domain in Turkish

Abstract

The focus of this study is to provide a model to be used for the identification of sentiments of comments about education and profession life of software engineering in social media and microblogging sites. Such a pre-trained model can be useful to evaluate students’ and software engineers’ feedbacks about software engineering. This problem is considered as a supervised text classification problem, which thereby requires a dataset for the training process. To do so, a survey is conducted among students of a software engineering department. In the classification phase, we represent the corpus by using conventional and word-embedding text representation schemes and yield accuracy, recall and precision results by using conventional supervised machine learning classifiers and well-known deep learning architectures. In the experimental analysis, first we focus on achieving classification results by using three conventional text representation schemes and three N-gram models in conjunction with five classifiers (i.e., naïve bayes, k-nearest neighbor algorithm, support vector machines, random forest and logistic regression). In addition, we evaluate the performances of three ensemble learners and three deep learning architectures (i.e. convolutional neural network, recurrent neural network, and long short-term memory). The empirical results indicate that deep learning architectures outperform conventional supervised machine learning classifiers and ensemble learners.

Keywords

References

  1. B. Pang and L. Lee, “Opinion mining and sentiment analysis,” Found. Trends Inf. Retr., pp.1–135, 2008.
  2. E. Fersini, E. Messina, and F. A. Pozzi, “Sentiment analysis: Bayesian Ensemble Learning,” Decis. Support Syst., vol. 68, pp.26–38, 2014.
  3. B. Lin, F. Zampetti, G. Bavota, M. Di Penta, M. Lanza, and R. Oliveto, “Sentiment Analysis for Software Engineering: How Far CanWe Go?”, Proc. - 40th International Conference on Software Engineering, pp. 94–104, 2018.
  4. E. Guzman, D. Azócar, and Y. Li, “Sentiment Analysis of Commit Comments in GitHub: An Empirical Study,” Proc. - 11thWorking Conference on Mining Software Repositories, pp. 352–355, 2014.
  5. M. Goul, O. Marjanovic, S. Baxley, and K. Vizecky, “Managing the Enterprise Business Intelligence App Store: Sentiment Analysis Supported Requirements Engineering,” Proc. - 45th Hawaii International Conference on System Sciences, pp. 4168–4177, 2012.
  6. M. Ortu, B. Adams, G. Destefanis, P. Tourani, M. Marchesi, and R. Tonelli, “Are Bullies More Productive? Empirical Study of Affectiveness vs. Issue Fixing Time,” Proc. - 12th Working Conference on Mining Software Repositories, pp. 303–313, 2015.
  7. F. Calefato, F. Lanubile, and N. Novielli, “EmoTxt: A Toolkit for Emotion Recognition from Text,” Proc. - 7th International Conference on Affective Computing and Intelligent Interaction, pp. 79–80, 2017.
  8. M. Goul, O. Marjanovic, S. Baxley, and K. Vizecky, “Managing the Enterprise Business Intelligence App Store: Sentiment Analysis Supported Requirements Engineering,” Proc. - 45th Hawaii International Conference on System Sciences, pp. 4168–4177, 2012.

Details

Primary Language

English

Subjects

Artificial Intelligence , Software Engineering

Journal Section

Research Article

Publication Date

December 30, 2020

Submission Date

July 15, 2020

Acceptance Date

December 7, 2020

Published in Issue

Year 1970 Volume: 3 Number: 3

APA
Toçoğlu, M. A. (2020). Sentiment Analysis for Software Engineering Domain in Turkish. Sakarya University Journal of Computer and Information Sciences, 3(3), 296-308. https://doi.org/10.35377/saucis.03.03.769969
AMA
1.Toçoğlu MA. Sentiment Analysis for Software Engineering Domain in Turkish. SAUCIS. 2020;3(3):296-308. doi:10.35377/saucis.03.03.769969
Chicago
Toçoğlu, Mansur Alp. 2020. “Sentiment Analysis for Software Engineering Domain in Turkish”. Sakarya University Journal of Computer and Information Sciences 3 (3): 296-308. https://doi.org/10.35377/saucis.03.03.769969.
EndNote
Toçoğlu MA (December 1, 2020) Sentiment Analysis for Software Engineering Domain in Turkish. Sakarya University Journal of Computer and Information Sciences 3 3 296–308.
IEEE
[1]M. A. Toçoğlu, “Sentiment Analysis for Software Engineering Domain in Turkish”, SAUCIS, vol. 3, no. 3, pp. 296–308, Dec. 2020, doi: 10.35377/saucis.03.03.769969.
ISNAD
Toçoğlu, Mansur Alp. “Sentiment Analysis for Software Engineering Domain in Turkish”. Sakarya University Journal of Computer and Information Sciences 3/3 (December 1, 2020): 296-308. https://doi.org/10.35377/saucis.03.03.769969.
JAMA
1.Toçoğlu MA. Sentiment Analysis for Software Engineering Domain in Turkish. SAUCIS. 2020;3:296–308.
MLA
Toçoğlu, Mansur Alp. “Sentiment Analysis for Software Engineering Domain in Turkish”. Sakarya University Journal of Computer and Information Sciences, vol. 3, no. 3, Dec. 2020, pp. 296-08, doi:10.35377/saucis.03.03.769969.
Vancouver
1.Mansur Alp Toçoğlu. Sentiment Analysis for Software Engineering Domain in Turkish. SAUCIS. 2020 Dec. 1;3(3):296-308. doi:10.35377/saucis.03.03.769969

Cited By

 

INDEXING & ABSTRACTING & ARCHIVING

 

31045 31044   ResimLink - Resim Yükle  31047 

31043 28939 28938 34240
 

 

29070    The papers in this journal are licensed under a Creative Commons Attribution-NonCommercial 4.0 International License