EN
Sentiment Analysis for Software Engineering Domain in Turkish
Abstract
The focus of this study is to provide a model to be used for the identification of sentiments of comments about education and profession life of software engineering in social media and microblogging sites. Such a pre-trained model can be useful to evaluate students’ and software engineers’ feedbacks about software engineering. This problem is considered as a supervised text classification problem, which thereby requires a dataset for the training process. To do so, a survey is conducted among students of a software engineering department. In the classification phase, we represent the corpus by using conventional and word-embedding text representation schemes and yield accuracy, recall and precision results by using conventional supervised machine learning classifiers and well-known deep learning architectures. In the experimental analysis, first we focus on achieving classification results by using three conventional text representation schemes and three N-gram models in conjunction with five classifiers (i.e., naïve bayes, k-nearest neighbor algorithm, support vector machines, random forest and logistic regression). In addition, we evaluate the performances of three ensemble learners and three deep learning architectures (i.e. convolutional neural network, recurrent neural network, and long short-term memory). The empirical results indicate that deep learning architectures outperform conventional supervised machine learning classifiers and ensemble learners.
Keywords
References
- B. Pang and L. Lee, “Opinion mining and sentiment analysis,” Found. Trends Inf. Retr., pp.1–135, 2008.
- E. Fersini, E. Messina, and F. A. Pozzi, “Sentiment analysis: Bayesian Ensemble Learning,” Decis. Support Syst., vol. 68, pp.26–38, 2014.
- B. Lin, F. Zampetti, G. Bavota, M. Di Penta, M. Lanza, and R. Oliveto, “Sentiment Analysis for Software Engineering: How Far CanWe Go?”, Proc. - 40th International Conference on Software Engineering, pp. 94–104, 2018.
- E. Guzman, D. Azócar, and Y. Li, “Sentiment Analysis of Commit Comments in GitHub: An Empirical Study,” Proc. - 11thWorking Conference on Mining Software Repositories, pp. 352–355, 2014.
- M. Goul, O. Marjanovic, S. Baxley, and K. Vizecky, “Managing the Enterprise Business Intelligence App Store: Sentiment Analysis Supported Requirements Engineering,” Proc. - 45th Hawaii International Conference on System Sciences, pp. 4168–4177, 2012.
- M. Ortu, B. Adams, G. Destefanis, P. Tourani, M. Marchesi, and R. Tonelli, “Are Bullies More Productive? Empirical Study of Affectiveness vs. Issue Fixing Time,” Proc. - 12th Working Conference on Mining Software Repositories, pp. 303–313, 2015.
- F. Calefato, F. Lanubile, and N. Novielli, “EmoTxt: A Toolkit for Emotion Recognition from Text,” Proc. - 7th International Conference on Affective Computing and Intelligent Interaction, pp. 79–80, 2017.
- M. Goul, O. Marjanovic, S. Baxley, and K. Vizecky, “Managing the Enterprise Business Intelligence App Store: Sentiment Analysis Supported Requirements Engineering,” Proc. - 45th Hawaii International Conference on System Sciences, pp. 4168–4177, 2012.
Details
Primary Language
English
Subjects
Artificial Intelligence , Software Engineering
Journal Section
Research Article
Authors
Publication Date
December 30, 2020
Submission Date
July 15, 2020
Acceptance Date
December 7, 2020
Published in Issue
Year 1970 Volume: 3 Number: 3
APA
Toçoğlu, M. A. (2020). Sentiment Analysis for Software Engineering Domain in Turkish. Sakarya University Journal of Computer and Information Sciences, 3(3), 296-308. https://doi.org/10.35377/saucis.03.03.769969
AMA
1.Toçoğlu MA. Sentiment Analysis for Software Engineering Domain in Turkish. SAUCIS. 2020;3(3):296-308. doi:10.35377/saucis.03.03.769969
Chicago
Toçoğlu, Mansur Alp. 2020. “Sentiment Analysis for Software Engineering Domain in Turkish”. Sakarya University Journal of Computer and Information Sciences 3 (3): 296-308. https://doi.org/10.35377/saucis.03.03.769969.
EndNote
Toçoğlu MA (December 1, 2020) Sentiment Analysis for Software Engineering Domain in Turkish. Sakarya University Journal of Computer and Information Sciences 3 3 296–308.
IEEE
[1]M. A. Toçoğlu, “Sentiment Analysis for Software Engineering Domain in Turkish”, SAUCIS, vol. 3, no. 3, pp. 296–308, Dec. 2020, doi: 10.35377/saucis.03.03.769969.
ISNAD
Toçoğlu, Mansur Alp. “Sentiment Analysis for Software Engineering Domain in Turkish”. Sakarya University Journal of Computer and Information Sciences 3/3 (December 1, 2020): 296-308. https://doi.org/10.35377/saucis.03.03.769969.
JAMA
1.Toçoğlu MA. Sentiment Analysis for Software Engineering Domain in Turkish. SAUCIS. 2020;3:296–308.
MLA
Toçoğlu, Mansur Alp. “Sentiment Analysis for Software Engineering Domain in Turkish”. Sakarya University Journal of Computer and Information Sciences, vol. 3, no. 3, Dec. 2020, pp. 296-08, doi:10.35377/saucis.03.03.769969.
Vancouver
1.Mansur Alp Toçoğlu. Sentiment Analysis for Software Engineering Domain in Turkish. SAUCIS. 2020 Dec. 1;3(3):296-308. doi:10.35377/saucis.03.03.769969
Cited By
Evaluation of Ensemble Algorithms and Deep Learning Transformers in Medical Sentiment Prediction
European Journal of Science and Technology
https://doi.org/10.31590/ejosat.1010241A Virtual Assistant Design and Application on Industrial Database
Uluslararası Yönetim Bilişim Sistemleri ve Bilgisayar Bilimleri Dergisi
https://doi.org/10.33461/uybisbbd.952310
