Deep learning-based sentiment classification in Amharic using multi-lingual datasets

Senait Gebremichael Tesfagergish¹, Robertas Damaševičius¹ and Jurgita Kapočiūtė-Dzikienė²

Department of Software Engineering
Kaunas University of Technology, Kaunas 51368, Lithuania
sengeb@ktu.lt, robertas.damasevicius@ktu.lt
Department of Applied Informatics
Vytautas Magnus University, Kaunas 44404, Lithuania
jurgita.kapociute-dzikiene@vdu.lt

Abstract

The analysis of emotions expressed in natural language text, also known as sentiment analysis, is a key application of natural language processing (NLP). It involves assigning a positive, negative (sometimes also neutral) value to opinions expressed in various contexts such as social media, news, blogs, etc. Despite its importance, sentiment analysis for under-researched languages like Amharic has not received much attention in NLP yet due to the scarcity of resources required to train such methods. This paper examines various deep learning methods such as CNN, LSTM, FFNN, BiLSTM, and transformers, as well as memory-based methods like cosine similarity, to perform sentiment classification using the word or sentence embedding techniques. This research includes training and comparing mono-lingual or cross-lingual models using social media messages in Amharic on Twitter. The study concludes that the lack of training data in the target language is not a significant issue since the training data 1) can be machine translated from other languages using machine translation as a data augmentation technique [33], or 2) cross-lingual models can capture the semantics of the target language, even when trained on another language (e.g., English). Finally, the FFNN classifier, which combined the sentence transformer and the cosine similarity method, proved to be the best option for both 3-class and 2-class sentiment classification tasks, achieving 62.0% and 82.2% accuracy, respectively.

Key words

sentiment analysis, monolingual vs. cross-lingual approaches, deep learning, sentence transformers, Amharic

Digital Object Identifier (DOI)

https://doi.org/10.2298/CSIS230115042T

Publication information

Volume 20, Issue 4 (September 2023)
Year of Publication: 2023
ISSN: 2406-1018 (Online)
Publisher: ComSIS Consortium

Full text

Download Available in PDF
Portable Document Format

How to cite

Tesfagergish, S. G., Damaševičius, R., Kapočiūtė-Dzikienė, J.: Deep learning-based sentiment classification in Amharic using multi-lingual datasets. Computer Science and Information Systems, Vol. 20, No. 4. (2023), https://doi.org/10.2298/CSIS230115042T