Traditional and Deep Learning Approaches for Sentiment Analysis: A Survey
Volume 6, Issue 5, Page No 01–07, 2021
Adv. Sci. Technol. Eng. Syst. J. 6(5), 01–07 (2021);
DOI: 10.25046/aj060501
Keywords: Sentiment Analysis, Opinion Mining, Deep learning, Neural network, Natural language processing
Presently, individuals generate tremendous volumes of information on the internet. As a result, sentiment analysis is a critical tool for automating a deep understanding of user-generated information. Of late, deep learning algorithms have shown endless promises for a variety of sentiment analysis. The purpose of sentiment analysis is to categorize different descriptions as good, bad, or impartial based on context data. Numerous studies have been concentrated on sentiment analysis in addition to the ability to examine thoughts, views, and reactions. In this paper, we review classical and deep learning approaches that have been applied to various sentiment analysis tasks and their evolution over last years and provide performance analysis of different sentiment analysis models on particular datasets. In the end, we will highlight current challenges and suggested solutions that can be considered in future work to achieve better performance.
1. Introduction
Nowadays, the number of web 2.0 resources where every one of us is comfortable sharing our views and suggestions is growing exponentially such as e-commerce websites and social media. As a result of this growth, massive volumes of data are generated. Hence, sentiment analysis was developed to extract relevant information from this large data size automatically. Sentiment analysis is a subfield of natural language processing (NLP) which gets considerable attention from researchers, industry, and government organizations worldwide. Sentiment Analysis, also referred as view mining, which is a procedure that assists in defining the emotional tone of a collection of words; this analysis enables us to determine the impression, viewpoint or conveyed emotion. According to Liu’s concept, an opinion consists of a target, an object or a feature of an entity, and a mood (positive, negative, or neutral) [1].
Additionally, it may include the originator of the view and the day and time at which the opinion was given [2]. Sentiments are categorized into numerous groups based on the classification purpose. Authors in [3] and [4] divided tweets into favorable, unfavorable, and neutral tweets. Sites like Twitter media platforms where only a vast number of tweets are posted, many of which include helpful information. As stated, [5] active Arabic users sent over 20 million tweets each day in March 2014. Each minute, millions of tweets are posted, many of them in the original languages. Health-related issues are frequently trending on Twitter.
Numerous approaches to sentiment analysis have been introduced. Traditional techniques are categorized into two types: lexicon-based and machine learning-based. Lexicon-based methods, in which the alignment of a document is determined founded on the sentiment polarity of phrases also words in the sentiment [6], and machine learning methods, in which models are constructed from labeled examples of readers or sentences, for instance, The paper in [7] categorize text documents containing film reviews using machine learning techniques to evaluate the statement’s feelings.
While traditional methods have achieved a high degree of precision, the feature engineering required is time-consuming and complex. Today’s massive amount of user-generated data necessitates complete knowledge and reliable ways for its management. Thus, deep learning methods facilitate the development of computational models under their ability to learn from data sets without requiring a manual attribute selection process. Recent research indicates that deep learning techniques outperform standard machine learning techniques in sentiment analysis [8].
2. Levels of sentiment analysis
Sentiment Analysis can be conducted at three granularity levels: the document level, sentence level, and aspect level [9]. Its application is a highly demanding area of investigate that entails a numerous of complex tasks. Subjectivity identification, sentiment analysis, lexicon construction, component extraction, aspect sentiment analysis, and viewpoint fraud detection are the most investigated tasks [10]. Sentiment analysis techniques are confronted with numerous issues relating to traditional sentiment analysis, autonomous natural language processing, and also new and challenging hurdles in this novel communication situation. This difficulty is mainly due to variant signals’ properties, which are typically brief but dense with semantic information [11], unstructured, thrashed in variant languages, and involve clutter. Amongst the features discussed previously, natural language text study is a critical component on which the sentiment analysis community bases its work.
Individuals and organizations/governments alike are incredibly interested in sentiment analysis. Before purchasing a product, we examine the ratings and reviews on the internet, while businesses utilize these reviews to understand their consumers’ preferences better and improve their products. Numerous attempts have been made to incorporate sentiment analysis into customer feedback. Governments use the same technologies to gauge public sentiment, for example, in response to new tactics or during polls.
3. Sentiment analysis approaches
Before As mentioned above, traditional approaches were the first ones that have merged to deal with sentiment analysis. Globally we have two categories in traditional approaches: the lexicon based and machine learning approaches.
3.1. Lexicon based approaches
Before, As indicated previously, traditional methodologies were the first to converge on sentiment analysis. Globally, traditional methods fall into two categories: lexicon-based approaches and machine learning approaches. Lexicographical techniques classify a given text into its appropriate class by utilizing precompiled sentiment lexicons with various words and their orientation (positive, negative, etc.) [12]. The terms contained in a particular document or sentence can be retrieved using the bag of words technique and classified using a lexicon. A merging method such as the average of each class established can consolidate the data and form a judgment about the overall sentiment of the phrase.
The majority of ways for producing sentiment lexicons are either dictionary-based or corpus-based: the first category relies on a lexicon in which words are labeled with their past polarity (seed words). WordNet is an example of a lexicon in this area, as is WordNet-Affect [13], which associates adaptive synsets (a collection of synonyms) with inspirational ideas. SentiNet [14] annotates each WordNet synset based on three numerical sentiment scores (positivity, negativity, and neutrality). At the same time, MPQA [14] offers a list of words, together with their PO Stagging, labeled with polarity (positive, negative, and neutral) and intensity (strong, weak). The sensations of a new document / phrase can be examined by comparing synonyms of names, verbs, adjectives and adverbs to the seed words previously labeled in the vocabulary. The second category mines a domain corpus for sentiment terms and their polarity. For instance, considering the co-occurrence likelihood of positive and negative phrases from search engines [15]. The corpus-based approaches address domain independence and provide a more accurate sentiment analysis [16]. The authors of [17] began by establishing a similarity between each pair of words in the corpus by generating a word graph with nodes representing words and reinforced edges representing similarities. The unidentified words are then automatically formed lexicons by attributing their polarity based on the graph. Certain lexicons feature non-words as well, such as emoticons [18]. SentiStrength is a hybrid sentiment analysis software suggested by [19] for extracting sentiment strength from the informal English text. Between 1 and 5, a score for negative or positive sentiment is assigned. It is built on a manual sentiment word list that was improved using a training algorithm, followed by a spelling correction algorithm, a booster and negation word list, and popular emoticons.
It is worth noting that developing or even maintaining a sentiment lexicon is a challenging effort in the modern era due to the rise of current data that is unstructured mainly and user-generated, such as social media. Rather than relying solely on the sentiment values included in the lexicon, the background and other characteristics of the words must be considered; this is accomplished through a process known as feature engineering. Bag of Words is one of the NLP’s preparation techniques. It separates the different words from a text [20]. This technique will be unable to distinguish between “I like you,” where “like” is a positive verb, and “I am like you,” where “like” is a neutral proposition. To address this, Part of Speech POS enables the assignment of a word in a corpus to the appropriate part of the speech tag (verbs, nouns, adjectives, and adverbs) depending on its context and definition. Adjectives and adverbs are mainly employed to describe entities that exhibit emotional characteristics.
Apart from using individual words (unigrams) as features, classic text classification algorithms weight the words within a sentence using Word Positions and Frequency. For instance, a movie review may begin with an overall sentiment statement, move to a conversation, and close with a summary of the author’s opinions [1], indicating that position can be used to change sentiment weights. The term frequency can be used to highlight terms that may be significant because they appear in many publications. For example, the TF-IDF (Term Frequency – Inverse Document Frequency) approach [21] enables this to be calculated by comparing the frequency of occurrence of a given term in a document to the number of documents containing that word. Another strategy is to hunt for the most uncommon words rather than the most common ones. In [7] , the authors optimize their system’s performance by referring to it as “presence” rather than “frequency.” Rather than weighing all words equally, some approaches favor terms that reflect or imply thoughts and opinions, such as excellent, great, wrong, incorrect, natural, like, agree, hate, trust, conceive, and so forth [22].
Another factor to consider when interpreting the context of a word is negation. To ascertain the negation’s scope and flip the polarity of terms affected by a negation [23]. Negation phrases include the following: not, no, never, cannot, should not, and would not. The dependency-based aspects of word words were derived from Dependency trees provide a simple tree-based method to express the structural relationships between the sentence’s words. These relationships are denoted by triplets that contain the name of the relationship type, the relationship’s governor, and the relationship’s dependent [24]. While these systems do not require training datasets, they strain to adapt to new data trends caused by the changing nature of language, the growth in high-dimensional data, the structural and cultural intricacies of brief text such as tweets, and the usage of emoticons and abbreviations [22]. To address the challenge of rapidly assessing these new data types, machine learning algorithms have demonstrated their superiority over lexicon-based methods.
3.2. Machine learning approaches
Machine Learning methods are based on machine learning algorithms that classify annotated data into its intended category. They can be classified into three broad categories: supervised, semi-supervised, and unsupervised learning methods. When humans do not annotate data, individuals opt for lexicon-based approaches. The machine learning approach is fully automated, convenient, and capable of handling extensive collections of data. These methods require a training dataset to assist in automating the Classifier; it is used to develop a classification model that classifies feature vectors [25] and a test dataset to predict the class label of unseen feature vectors.
On numerous sentiment analysis jobs, machine learning is used; however, the two classical tactics to sentiment analysis can be merged to maximize each benefit. In [26], the authors demonstrated promising results when they combined machine learning and lexicon-based practices. Several machine learning approaches are used to categorize data, including Naive Bayes (NB), Maximum Entropy (ME), and Support Vector Machines (SVM). Sentiment classification studies on polarity determination, utilizing the Support Vector Machine SVM algorithm and a variety of characteristics selection methods, including word frequency, binary occurrence, and term occurrence [27].
In [28], the authors created a method for text categorization that combined a genetic algorithm and a Random forests classifier and achieved extremely high accuracy. Crawford et al. investigated opinion spam detection using SVM and Naive Bayes [29]. They created a collection of unfavorable deceptive opinions that included both genuine and misleading reviews. They illustrate that linear SVM produced results more than 80% of the time. In [30], authors published a new technique for sentiment analysis that is based on Bayesian network classifiers. The authors employed the Bayes factor approach to reduce the number of edges during the training procedure automatically. The proposed technique was evaluated using two Spanish datasets. The evaluation’s outcome demonstrated the superiority of the submitted work above previously published efforts.
A hybrid technique combining machine learning (SVM classifier) and semantic orientation was proposed [31]. We applied content-neutral, content-specific, and sentiment-based features. Senti WordNet was used to derive the weights for the sentiment characteristics. These methodologies strive to keep up with the new data trend of a dynamic language, the growth of high-dimensional data, and the structural and cultural intricacies of short text such as tweets. To address the challenge of efficiently processing this type of data, deep learning algorithms have demonstrated their superiority over more traditional methods.
3.3. Deep learning approaches
Deep learning is a rapidly growing subfield of machine learning techniques based on artificial neural networks (ANNs) built based on the biological brain and capable of self-learning. The web comprises dozens to hundreds of neurons referred to as layers; each layer receives and interprets data from the preceding layer, allowing for multiple processing. For instance, the program will learn to detect letters before targeting words in a text or identify whether a photo has a face before determining who it belongs to. Deep learning algorithms have been primarily used in sentiment analysis due to their ability to automatically learn and generate input models from datasets [32].
Recent studies present numerous ways to sentiment analysis based on deep learning, including supervised and unsupervised algorithms. We will start by reviewing word embedding approaches as the basic data processing layer of deep learning and then examine many different deep learning approaches; We recommend to read [31] for mathematical details.
3.3.1. Word embedding
Word embedding is a collection of machine learning approaches aiming to express words in a text using vectors of real numbers, with similar vectors representing words with similar interpretations. These new forms of textual data have increased the efficiency of systems for automatic language processing. The first approach to word embedding dates back to the 1960s and is based on dimensionality reduction techniques. Recent advances in performance have been facilitated by innovative methods based on probabilistic models and neural networks, such as Word2Vec [33]. The following sections will discuss various word embeddings that are frequently utilized in sentiment analysis. Words having comparable semantic and contextual properties form a class. Authors in [34] describe a language model that simultaneously learns both distributed representations and the probability function for word sequences. Numerous studies have been conducted to strengthen this work. For instance, in [35] authors Suggested a classifier word embedding based on convolutional neural networks that can learn the characteristics associated with a particular task without basic info.
Authors in [33] proposed Word2vec which is a common pre-trained word embedding technique that uses two-layer neural networks to learn the vector representations of the words in a text so that similar numerical vectors express words with related comments. Word2Vec utilizes two neural architectures: CBOW and Skip-Gram. BOW takes the setting of a word as input and make efforts to identify the word in question. Skip-Gram, on the other hand, accepts a word as data and tries to guess its circumstances. In both situations, the network is trained by parsing the text and adjusting the neural weights to lower the algorithm’s model complexity.
Glove2 is another popular term for embedding; it provides a global neural network and local context. In [36] authors presented a method for fast text word embedding in which n-grams encode words. Notably, the NLP Branch earned a millstone, Bidirectional encoder representation from transformers (Bert) language model [8]. This is an utterly fascinating work. The authors detail a masked LM (MLM) that enables bidirectional training in models and subsequent acquisition of a strong sense of language context. In [3], authors obtained impressive findings by improving the Bert algorithm utilizing the lion method, in which the weights of the network of the BERT encoder were optimized using standard LA and also the sequence number length of the BERT encoder.
3.3.2. Convolution neural networks
A convolutional neural network (CNN) is a feedforward neural network established in 1989 and is the most widely used in computer vision. The visual cortex of animals inspires it. Each neuron in the visual brain has a small receptive area, which overlaps to perceive the complete object; these convolutional layers operate as local filters. In essence, CNN consists of three types of coatings: input, feature selection, and classification [37]. The input layer embeds raw data, the convolution layer learns and produces a feature map, and the neural network extracts practical attributes. Finally, these features are fed into a fully integrated categorization layer [2].
CNN has gotten perfect results in different domains, the same as in NLP and so sentiment analysis, and thus for the additional benefits. CNN utilizes few variables that don’t need a lot of time to train the model. They have achieved good popularity in sentiment analysis since they can acquire contextual characteristics but are constrained in long-term connections. CNN’s gets satisfactory accuracy when prepared in many samples, which is not always satisfied, where the development of Recurrent neural networks (RNNs) can manage the challenge of long-term dependencies.
3.3.3. Recurrent neural networks
RNNs are invented by ELMAN in 1990 [38], they have neural networks in which information can propagate in both directions, including from deep layers to early layers. They are closer to the true functioning of the nervous system, which is not one-way direction. These networks have recurrent connections in the sense that they keep information in memory: they can take into account a certain number of past states at a given moment t. For this reason, RNNs are particularly well suited to applications involving the context. Indeed, “classical” RNNs (simple recurrent neural networks or Vanilla RNNs) are only able to memorize the so called near past, and begin to “forget” after about fifty iterations. This two-way transfer of information makes their training much more complicated, and it is only recently that effective methods such as LSTM (Long Short-Term Memory) have been developed. Authors in [39] proposed long short-term memory network which is a special type of RNNs able of learning long term dependencies via the forget gate that allows the memory cell to keep information for a long time. GRU (Gated recurrent unit) is another type of RNNs to LSTM that have only two layers instead of three layers as in LSTM, it is a simplified version of LSTM that is more efficient computationally then Vanilla RNNs and LSTM.
A new technique called attention mechanism was introduced in 2015, which simulates the human reading capability of gaze-fixations by prioritizing relevant parts of data based on its weighted representation. Since then, more researches apply this technique [40]. RNNs approaches have been widely applied in sentiment analysis field, A neural network was proposed in [41] which is capable of learning document representation taking into consideration the sentence relationship. First it learns sentence representation with CNN and then a GRU is used to encode semantics.
3.3.4. Recursive neural networks
RecNNs are a generalization of RNNs, a form of neural network used to train a graph-based classification model from data and is familiar with structured inputs of any structure [42]. RecNN produces parent representations underside from the structural term of a sentence by merging tokens to obtain representations for phrases and soon the entire sentence. The representation at the sentence level can then be utilized to perform the final classification on the input text.
3.3.5. Deep Reinforcement Learning
Deep reinforcement learning (DRL) is a relatively new subfield of deep learning. It is a way of artificial intelligence that is not widely used but opens up entirely new possibilities for automation. The DRL enables the development of software capable of matching or exceeding human intellect in various domains. The most well-known system based on DRL is Deep Mind (Google’s AI Platform) [43]. DRL employs validation learning algorithms, the most widely used of temporal difference learning (TD Learning) and Q-learning (QL). These learning models are described as the human (and animal) process of information acquiring through trial and error to learn from multiple exposures. To ensure that the action taken by the machine is in an intended way, these algorithms use a reward system to evaluate the machine’s selections. The method is comparable to animal training. DRL, which is under the domain of automatic (or unsupervised) machine learning, integrates learning algorithms with neural networks to successfully estimate the validity of a “complex” strategy that incorporates a substantial percentage of decision criteria. The primary problem is to develop a system that promotes specific behaviors while avoiding adverse effects. The objective is to maximize rewards inside a simulation environment in which the computer acts and then receives feedback. The software agent is not informed in advance about the most probable activity and must select its strategy on its own through a process of interpretation.
DRL models are built on the Markov decision process (MDP), enabling an intelligent agent to be trained [2] by contact with the environment. They have demonstrated efficacy in improving structure, which is beneficial in NLP, particularly sentiment analysis. In [44], authors presented a reinforcement learning (RL) method for automatically learning phrase representation by discovering optimum structures. The reward in this research is the chance of correctly classifying the input sentence based on its structured presentation. The results demonstrate the algorithm’s efficacy. However, developing a model that learns a function of rewards remains challenging.
3.3.6. Generative adversarial network
GANs are an unsupervised pre-trained network architecture first proposed by Good-fellow and colleagues in 2014 [45]. GANs enable pretraining the network layers with large datasets. We asynchronously train two models: a generative model G that discovers the distribution of the data and a discriminative model D that indicates the likelihood that a compiled piece of data is from the classification model or the generative model. A GAN aims to analyze real data sets and develop its inventions that must resemble so natural that they cannot be identified as machine images without human interaction. The generative and discriminative models are perpetually in conflict with one another. When the discriminative network detects an error, it returns it to the other network. In this situation, the generative network has not yet reached its optimal state and must keep learning. Simultaneously, the discriminatory network has grown in sophistication. The generative network aims at generating data sets that appear to be so real that they are accepted as confirmed by the discriminative. On the other hand, the discriminative approach aims to thoroughly evaluate and comprehend real-world examples to eliminate the possibility of fraud being detected as accurate. In sentiment analysis, GAN models are the starting point.
3.3.7. Hybrid deep neural networks
Deep learning models have been extensively employed in the natural language processing sector and have shown impressive results, particularly sentiment analysis. Numerous researchers have advocated for merging models to maximize the performance of each kind. Multiple hybrid models have been supported for sentiment analysis; for example, [46] implemented a hybrid deep learning architecture for sentiment estimates based on a convolutional neural network for word embedding and a backing vector machine for sentiment classification; evaluation reveals that the proposed mechanism is exceptionally efficient. Authors in [47] created a model that needs to be extracted from several deep learning word embedding methods, mixes them, and classifies texts according to their sentiments.
4. Works on different sentiment analysis datasets
The table below summarizes and compares the performance of various Deep Learning techniques for sentiment analysis tasks.
Table 1: Performance and applications of DL approaches on various SA tasks.
| References | Approach | Features | Dataset | Accuracy |
| [3] | Customized BERT based lion algorithm | – | Sentiment 120 | 92.2 % |
| [8] | Bidirectional Encoder Representations from transformers | – | CoNLL-2003 | 86.7% |
| [19]
|
SentiStrength + spelling correction, booster and negation word list + common emoticons | – | MySpace comments | 66.7% |
| [25] | Dictionary based lexicon (SentiWordNet) + SVM | Lexical and syntactic features + unigrams and bigrams + POS | Online product reviews | 84.15% for kitchen appliances
And 78.85% for books |
| [26] | SentiWordNet Lexicon + semantic rules + fuzzy set | Word features | Twitter Dataset, Movie review | 88.02% for twitter and 75.85% for movie |
| [27] | SVM | Trigram and Binary Occurrence | Movie review | 84.90% |
| [28] | Genetic algorithm + random forest | Business documents | 98.7% | |
| [30] | SVM | BOW | Spanish Twitter Dataset | 85.8% |
| [33] | Recurrent neural network + skip-gram model | 6-word window around the target word | Microsoft sentence completion challenge | 58.9% |
| [34] | Neural network | Word features | AP News corpus | |
| [35] | Convolutional neural network | Prop Bank dataset | 85.7% | |
| [36] | Global logbilinear regression model (conditional random field) | Discrete feature from Stanford NER model + five word context | word analogy
task |
75% |
| [41] | Recurrent neural network (CNN/LSTM) | – | IMDB | 45.3% |
| [44] | Reinforcement learning (HS-LSTM) | – | Subjectivity dataset | 93.7% |
| [46] | Category sentence GAN with Reinforcement learning + generative adversarial networks + recurrent neural networks | – | Subset of Amazon review dataset and Emotion dataset | 41.52% for Emotion and 86.4% for Amazon |
5. Current issues and possible directions
Numerous approaches to sentiment analysis have been presented. The majority of the proposed technique for sentiment analysis is static. As a result, one of the significant obstacles in applying deep learning algorithms for sentiment analysis is dynamic sentiment analysis and tracking. For instance, on the Twitter social network, the dataset, vocabulary, and user count might change at any time, making dynamic analysis a problematic process. On the other hand, dealing with language structure, which includes slang, is a significant difficulty. Additionally, heterogeneous information (i.e., short or long phrases) necessitates in-depth examination and specialized processing [48]. We recommend that researchers employ cutting-edge deep learning techniques to address these issues, such as the Bert algorithm for context representation learning [8], deep reinforcement learning (DRL), and generative adversarial networks (GANs), which are incredibly efficient at resolving complex problems.
6. Conclusion
Sentiment analysis is critical for decision-making in a variety of domains, including economics, business development, and social phenomenon research. Owing to its large use in potential implementation, there has been a meteoric rise in academic research and industrial applications. Recently, a significant number of academics have become interested in sentiment analysis utilizing deep learning algorithms; consequently, large varieties of efficient approaches for various tasks have been developed. We began this subject by discussing the history of sentiment analysis and its different degrees. There has been discussion of both traditional and machine learning methodologies, emphasizing deep learning approaches and their applications. We offered an application and performance analysis on a variety of real-world sentiment analysis datasets. Lastly, we outline existing issues that require attention and make some recommendations for change.
Conflict of Interest
The authors declare no conflict of interest.
- B. Liu, “Sentiment analysis and opinion mining,” Synthesis Lectures on Human Language Technologies, 5(1), 1–167, 2012.
- O. Habimana, Y. Li, R. Li, X. Gu, G. Yu, “Sentiment analysis using deep learning approaches: an overview,” Science China Information Sciences, 63(1), 1–36, 2020.
- F. LAGRARI, Y. ELKETTANI, “Customized BERT with Convolution Model : A New Heuristic Enabled Encoder for Twitter Sentiment Analysis”,2020
- S.C. Rachiraju, M. Revanth, “Feature Extraction and Classification of Movie Reviews using Advanced Machine Learning Models,” in 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS), 814–817, 2020.
- A.M. Alayba, V. Palade, M. England, R. Iqbal, “Arabic language sentiment analysis on health services,” in 2017 1st international workshop on arabic script analysis and recognition (asar), 114–118, 2017.
- S. Trinh, L. Nguyen, M. Vo, P. Do, Lexicon-based sentiment analysis of Facebook comments in Vietnamese language, Springer: 263–276, 2016.
- R. Alhajj, J. Rokne, Encyclopedia of social network analysis and mining, Springer, 2014.
- J. Devlin, M.-W. Chang, K. Lee, K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” ArXiv Preprint ArXiv:1810.04805, 2018
- Y. Ma, H. Peng, E. Cambria, “Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM,” in Thirty-second AAAI conference on artificial intelligence, 2018.
- M.H. Arif, J. Li, M. Iqbal, K. Liu, “Sentiment analysis and spam detection in short informal text using learning classifier systems,” Soft Computing, 22(21), 7281–7291, 2018
- M. Al-Smadi, M. Al-Ayyoub, Y. Jararweh, O. Qawasmeh, “Enhancing aspect-based sentiment analysis of Arabic hotels’ reviews using morphological, syntactic and semantic features,” Information Processing \& Management, 56(2), 308–319, 2019.
- I.P. Windasari, D. Eridani, “Sentiment analysis on travel destination in Indonesia,” in 2017 4th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE), 276–279, 2017.
- C. Fellbaum, “WordNet: An electronic lexical resource,” The Oxford Handbook of Cognitive Science, 301–314, 2017.
- E.M. Alshari, A. Azman, S. Doraisamy, N. Mustapha, M. Alkeshr, “Effective method for sentiment lexical dictionary enrichment based on Word2Vec for sentiment analysis,” in 2018 Fourth International Conference on Information Retrieval and Knowledge Management (CAMP), 1–5, 2018.
- K. Ravi, V. Ravi, “A survey on opinion mining and sentiment analysis: tasks, approaches and applications,” Knowledge-Based Systems, 89, 14–46, 2015.
- M. del P. Salas-Zárate, J. Medina-Moreira, K. Lagos-Ortiz, H. Luna-Aveiga, M.A. Rodriguez-Garcia, R. Valencia-Garcia, “Sentiment analysis on tweets about diabetes: an aspect-level approach,” Computational and Mathematical Methods in Medicine, 2017.
- A. Bittar, S. Velupillai, A. Roberts, R. Dutta, “Using General-purpose Sentiment Lexicons for Suicide Risk Assessment in Electronic Health Records: Corpus-Based Analysis,” JMIR Medical Informatics, 9(4), e22397, 2021.
- J. Zhang, C. Zhao, F. Xu, P. Zhang, “SVM-Based Sentiment Analysis Algorithm of Chinese Microblog Under Complex Sentence Pattern,” in International Conference in Communications, Signal Processing, and Systems, 801–809, 2016.
- M.R. Islam, M.F. Zibran, “SentiStrength-SE: Exploiting domain specificity for improved sentiment analysis in software engineering text,” Journal of Systems and Software, 145, 125–146, 2018.
- M.K. Sohrabi, F. Hemmatian, “An efficient preprocessing method for supervised sentiment analysis by converting sentences to numerical vectors: a twitter case study,” Multimedia Tools and Applications, 78(17), 24863–24882, 2019.
- S. Jabri, A. Dahbi, T. Gadi, A. Bassir, “Ranking of text documents using TF-IDF weighting and association rules mining,” in 2018 4th international conference on optimization and applications (ICOA), 1–6, 2018.
- A. Krouska, C. Troussas, M. Virvou, Deep learning for twitter sentiment analysis: the effect of pre-trained word embedding, Springer: 111–124, 2020.
- M. Ghio, K. Haegert, M.M. Vaghi, M. Tettamanti, “Sentential negation of abstract and concrete conceptual categories: a brain decoding multivariate pattern analysis study,” Philosophical Transactions of the Royal Society B: Biological Sciences, 373(1752), 20170124, 2018.
- M. Xiao, Y. Guo, “Annotation projection-based representation learning for cross-lingual dependency parsing,” in Proceedings of the Nineteenth Conference on Computational Natural Language Learning, 73–82, 2015.
- B.M. Hopkinson, A.C. King, D.P. Owen, M. Johnson-Roberson, M.H. Long, S.M. Bhandarkar, “Automated classification of three-dimensional reconstructions of coral reefs using convolutional neural networks,” PloS One, 15(3), e0230671, 2020.
- O. Appel, F. Chiclana, J. Carter, H. Fujita, “Cross-ratio uninorms as an effective aggregation mechanism in sentiment analysis,” Knowledge-Based Systems, 124, 16–22, 2017.
- A. Alsaeedi, M.Z. Khan, “A study on sentiment analysis techniques of Twitter data,” International Journal of Advanced Computer Science and Applications, 10(2), 361–374, 2019.
- F.-E. Lagrari, H. Ziyati, Y. El Kettani, “An efficient model of text categorization based on feature selection and random forests: case for business documents,” in International Conference on Advanced Intelligent Systems for Sustainable Development, 465–476, 2018.
- M. Crawford, T.M. Khoshgoftaar, J.D. Prusa, A.N. Richter, H. Al Najada, Survey of review spam detection using machine learning techniques. J Big Data 2 (1): 23, 2015.
- G.A. Ruz, P.A. Henr\’\iquez, A. Mascareño, “Sentiment analysis of Twitter data during critical events through Bayesian networks classifiers,” Future Generation Computer Systems, 106, 92–104, 2020.
- Shoukry, A., & Rafea, A.,” A hybrid approach for sentiment classification of Egyptian dialect tweets,” 2015 First International Conference on Arabic Computational Linguistics (ACLing). https://doi.org/10.1109/acling.2015.18,(2015)
- L. Zhang, S. Wang, B. Liu, “Deep learning for sentiment analysis: A survey,” Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 8(4), e1253, 2018.
- N. Alami, M. Meknassi, N. En-nahnahi, “Enhancing unsupervised neural networks based text summarization with word embedding and ensemble learning,” Expert Systems with Applications, 123, 195–211, 2019.
- F. Hill, K. Cho, A. Korhonen, “Learning distributed representations of sentences from unlabelled data,” ArXiv Preprint ArXiv:1602.03483, 2016.
- E. Mansouri-Benssassi, J. Ye, “Synch-graph: Multisensory emotion recognition through neural synchrony via graph convolutional networks,” in Proceedings of the AAAI Conference on Artificial Intelligence, 1351–1358, 2020.
- Z. Rahimi, M.M. Homayounpour, “TensSent: a tensor based sentimental word embedding method,” Applied Intelligence, 1–16, 2021.
- M.F. Burg, S.A. Cadena, G.H. Denfield, E.Y. Walker, A.S. Tolias, M. Bethge, A.S. Ecker, “Learning divisive normalization in primary visual cortex,” PLOS Computational Biology, 17(6), e1009028, 2021.
- S.Seker, E. Ayaz, E. Türkcan, “Elman’s recurrent neural network applications to condition monitoring in nuclear power plant and rotating machinery,” Engineering Applications of Artificial Intelligence, 16(7–8), 647–656, 2003.
- L. Mou, Z. Jin, General Framework of Tree-Based Convolutional Neural Networks (TBCNNs), Springer: 37–40, 2018.
- D. Cazzato, M. Leo, C. Distante, H. Voos, “When i look into your eyes: A survey on computer vision contributions for human gaze estimation and tracking,” Sensors, 20(13), 3739, 2020.
- N. Capuano, L. Greco, P. Ritrovato, M. Vento, “Sentiment analysis for customer relationship management: An incremental learning approach,” Applied Intelligence, 51(6), 3339–3352, 2021.
- P. Tino, L. Benuskova, A. Sperduti, Artificial neural network models, Springer: 455–471, 2015.
- L. Lei, Y. Tan, K. Zheng, S. Liu, K. Zhang, X. Shen, “Deep reinforcement learning for autonomous internet of things: Model, applications and challenges,” IEEE Communications Surveys \& Tutorials, 22(3), 1722–1760, 2020.
- Z. Zhang, P. Cui, W. Zhu, “Deep learning on graphs: A survey,” IEEE Transactions on Knowledge and Data Engineering, 2020.
- I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, Y. Bengio, “Generative adversarial nets,” Advances in Neural Information Processing Systems, 27, 2014.
- K. Pasupa, T.S.N. Ayutthaya, “Hybrid deep learning models for thai sentiment analysis,” Cognitive Computation, 1–27, 2021.
- S.U. Hegde, A.S. Zaiba, Y. Nagaraju, others, “Hybrid CNN-LSTM Model with GloVe Word Vector for Sentiment Analysis on Football Specific Tweets,” in 2021 International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies (ICAECT), 1–8, 2021.
- J. Tang, M. Qu, Q. Mei, “Pte: Predictive text embedding through large-scale heterogeneous text networks,” in Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, 1165–1174, 2015.
- Hanan Hassan Ali Adlan, Elsadig Ahmed Mohamed Babiker, "Efficient Pattern Recognition Resource Utilization Neural Network ", Advances in Science, Technology and Engineering Systems Journal, vol. 11, no. 1, pp. 44–50, 2026. doi: 10.25046/aj110105
- Kohinur Parvin, Eshat Ahmad Shuvo, Wali Ashraf Khan, Sakibul Alam Adib, Tahmina Akter Eiti, Mohammad Shovon, Shoeb Akter Nafiz, "Computationally Efficient Explainable AI Framework for Skin Cancer Detection", Advances in Science, Technology and Engineering Systems Journal, vol. 11, no. 1, pp. 11–24, 2026. doi: 10.25046/aj110102
- David Degbor, Haiping Xu, Pratiksha Singh, Shannon Gibbs, Donghui Yan, "StradNet: Automated Structural Adaptation for Efficient Deep Neural Network Design", Advances in Science, Technology and Engineering Systems Journal, vol. 10, no. 6, pp. 29–41, 2025. doi: 10.25046/aj100603
- Jenna Snead, Nisa Soltani, Mia Wang, Joe Carson, Bailey Williamson, Kevin Gainey, Stanley McAfee, Qian Zhang, "3D Facial Feature Tracking with Multimodal Depth Fusion", Advances in Science, Technology and Engineering Systems Journal, vol. 10, no. 5, pp. 11–19, 2025. doi: 10.25046/aj100502
- François Dieudonné Mengue, Verlaine Rostand Nwokam, Alain Soup Tewa Kammogne, René Yamapi, Moskolai Ngossaha Justin, Bowong Tsakou Samuel, Bernard Kamsu Fogue, "Explainable AI and Active Learning for Photovoltaic System Fault Detection: A Bibliometric Study and Future Directions", Advances in Science, Technology and Engineering Systems Journal, vol. 10, no. 3, pp. 29–44, 2025. doi: 10.25046/aj100305
- Stephen Obare, Kennedy Ogada, "A Review of Natural Language Processing Techniques in Under-Resourced Languages", Advances in Science, Technology and Engineering Systems Journal, vol. 10, no. 2, pp. 35–41, 2025. doi: 10.25046/aj100204
- Surapol Vorapatratorn, Nontawat Thongsibsong, "AI-Based Photography Assessment System using Convolutional Neural Networks", Advances in Science, Technology and Engineering Systems Journal, vol. 10, no. 2, pp. 28–34, 2025. doi: 10.25046/aj100203
- Abhishek Shrestha, Jürgen Großmann, "On Adversarial Robustness of Quantized Neural Networks Against Direct Attacks", Advances in Science, Technology and Engineering Systems Journal, vol. 9, no. 6, pp. 30–46, 2024. doi: 10.25046/aj090604
- Win Pa Pa San, Myo Khaing, "Advanced Fall Analysis for Elderly Monitoring Using Feature Fusion and CNN-LSTM: A Multi-Camera Approach", Advances in Science, Technology and Engineering Systems Journal, vol. 9, no. 6, pp. 12–20, 2024. doi: 10.25046/aj090602
- Joshua Carberry, Haiping Xu, "GPT-Enhanced Hierarchical Deep Learning Model for Automated ICD Coding", Advances in Science, Technology and Engineering Systems Journal, vol. 9, no. 4, pp. 21–34, 2024. doi: 10.25046/aj090404
- Nguyen Viet Hung, Tran Thanh Lam, Tran Thanh Binh, Alan Marshal, Truong Thu Huong, "Efficient Deep Learning-Based Viewport Estimation for 360-Degree Video Streaming", Advances in Science, Technology and Engineering Systems Journal, vol. 9, no. 3, pp. 49–61, 2024. doi: 10.25046/aj090305
- Sami Florent Palm, Sianou Ezéckie Houénafa, Zourkalaïni Boubakar, Sebastian Waita, Thomas Nyachoti Nyangonda, Ahmed Chebak, "Solar Photovoltaic Power Output Forecasting using Deep Learning Models: A Case Study of Zagtouli PV Power Plant", Advances in Science, Technology and Engineering Systems Journal, vol. 9, no. 3, pp. 41–48, 2024. doi: 10.25046/aj090304
- Henry Toal, Michelle Wilber, Getu Hailu, Arghya Kusum Das, "Evaluation of Various Deep Learning Models for Short-Term Solar Forecasting in the Arctic using a Distributed Sensor Network", Advances in Science, Technology and Engineering Systems Journal, vol. 9, no. 3, pp. 12–28, 2024. doi: 10.25046/aj090302
- Marco I. Bonelli, Jiahao Liu, "Revolutionizing Robo-Advisors: Unveiling Global Financial Markets, AI-Driven Innovations, and Technological Landscapes for Enhanced Investment Decisions", Advances in Science, Technology and Engineering Systems Journal, vol. 9, no. 2, pp. 33–44, 2024. doi: 10.25046/aj090205
- Toya Acharya, Annamalai Annamalai, Mohamed F Chouikha, "Enhancing the Network Anomaly Detection using CNN-Bidirectional LSTM Hybrid Model and Sampling Strategies for Imbalanced Network Traffic Data", Advances in Science, Technology and Engineering Systems Journal, vol. 9, no. 1, pp. 67–78, 2024. doi: 10.25046/aj090107
- Toya Acharya, Annamalai Annamalai, Mohamed F Chouikha, "Optimizing the Performance of Network Anomaly Detection Using Bidirectional Long Short-Term Memory (Bi-LSTM) and Over-sampling for Imbalance Network Traffic Data", Advances in Science, Technology and Engineering Systems Journal, vol. 8, no. 6, pp. 144–154, 2023. doi: 10.25046/aj080614
- Afrodite Papagiannopoulou, Chrissanthi Angeli, "Social Media Text Summarization: A Survey Towards a Transformer-based System Design", Advances in Science, Technology and Engineering Systems Journal, vol. 8, no. 6, pp. 26–36, 2023. doi: 10.25046/aj080604
- Nizar Sakli, Chokri Baccouch, Hedia Bellali, Ahmed Zouinkhi, Mustapha Najjari, "IoT System and Deep Learning Model to Predict Cardiovascular Disease Based on ECG Signal", Advances in Science, Technology and Engineering Systems Journal, vol. 8, no. 6, pp. 08–18, 2023. doi: 10.25046/aj080602
- Zobeda Hatif Naji Al-azzwi, Alexey N. Nazarov, "MRI Semantic Segmentation based on Optimize V-net with 2D Attention", Advances in Science, Technology and Engineering Systems Journal, vol. 8, no. 4, pp. 73–80, 2023. doi: 10.25046/aj080409
- Kohei Okawa, Felix Jimenez, Shuichi Akizuki, Tomohiro Yoshikawa, "Investigating the Impression Effects of a Teacher-Type Robot Equipped a Perplexion Estimation Method on College Students", Advances in Science, Technology and Engineering Systems Journal, vol. 8, no. 4, pp. 28–35, 2023. doi: 10.25046/aj080404
- Yu-Jin An, Ha-Young Oh, Hyun-Jong Kim, "Forecasting Bitcoin Prices: An LSTM Deep-Learning Approach Using On-Chain Data", Advances in Science, Technology and Engineering Systems Journal, vol. 8, no. 3, pp. 186–192, 2023. doi: 10.25046/aj080321
- Kitipoth Wasayangkool, Kanabadee Srisomboon, Chatree Mahatthanajatuphat, Wilaiporn Lee, "Accuracy Improvement-Based Wireless Sensor Estimation Technique with Machine Learning Algorithms for Volume Estimation on the Sealed Box", Advances in Science, Technology and Engineering Systems Journal, vol. 8, no. 3, pp. 108–117, 2023. doi: 10.25046/aj080313
- Mario Cuomo, Federica Massimi, Francesco Benedetto, "Detecting CTC Attack in IoMT Communications using Deep Learning Approach", Advances in Science, Technology and Engineering Systems Journal, vol. 8, no. 2, pp. 130–138, 2023. doi: 10.25046/aj080215
- Temsamani Khallouk Yassine, Achchab Said, Laouami Lamia, Faridi Mohammed, "Hybrid Discriminant Neural Networks for Performance Job Prediction", Advances in Science, Technology and Engineering Systems Journal, vol. 8, no. 2, pp. 116–122, 2023. doi: 10.25046/aj080213
- Ivana Marin, Sven Gotovac, Vladan Papić, "Development and Analysis of Models for Detection of Olive Trees", Advances in Science, Technology and Engineering Systems Journal, vol. 8, no. 2, pp. 87–96, 2023. doi: 10.25046/aj080210
- Víctor Manuel Bátiz Beltrán, Ramón Zatarain Cabada, María Lucía Barrón Estrada, Héctor Manuel Cárdenas López, Hugo Jair Escalante, "A Multiplatform Application for Automatic Recognition of Personality Traits in Learning Environments", Advances in Science, Technology and Engineering Systems Journal, vol. 8, no. 2, pp. 30–37, 2023. doi: 10.25046/aj080204
- Anh-Thu Mai, Duc-Huy Nguyen, Thanh-Tin Dang, "Transfer and Ensemble Learning in Real-time Accurate Age and Age-group Estimation", Advances in Science, Technology and Engineering Systems Journal, vol. 7, no. 6, pp. 262–268, 2022. doi: 10.25046/aj070630
- Fatima-Zahra Elbouni, Aziza EL Ouaazizi, "Birds Images Prediction with Watson Visual Recognition Services from IBM-Cloud and Conventional Neural Network", Advances in Science, Technology and Engineering Systems Journal, vol. 7, no. 6, pp. 181–188, 2022. doi: 10.25046/aj070619
- Brahim Zraibi, Mohamed Mansouri, Salah Eddine Loukili, Said Ben Alla, "Hybrid Neural Network Method for Predicting the SOH and RUL of Lithium-Ion Batteries", Advances in Science, Technology and Engineering Systems Journal, vol. 7, no. 5, pp. 193–198, 2022. doi: 10.25046/aj070520
- Bahram Ismailov Israfil, "Deep Learning in Monitoring the Behavior of Complex Technical Systems", Advances in Science, Technology and Engineering Systems Journal, vol. 7, no. 5, pp. 10–16, 2022. doi: 10.25046/aj070502
- Nosiri Onyebuchi Chikezie, Umanah Cyril Femi, Okechukwu Olivia Ozioma, Ajayi Emmanuel Oluwatomisin, Akwiwu-Uzoma Chukwuebuka, Njoku Elvis Onyekachi, Gbenga Christopher Kalejaiye, "BER Performance Evaluation Using Deep Learning Algorithm for Joint Source Channel Coding in Wireless Networks", Advances in Science, Technology and Engineering Systems Journal, vol. 7, no. 4, pp. 127–139, 2022. doi: 10.25046/aj070417
- Tiny du Toit, Hennie Kruger, Lynette Drevin, Nicolaas Maree, "Deep Learning Affective Computing to Elicit Sentiment Towards Information Security Policies", Advances in Science, Technology and Engineering Systems Journal, vol. 7, no. 3, pp. 152–160, 2022. doi: 10.25046/aj070317
- Kaito Echizenya, Kazuhiro Kondo, "Indoor Position and Movement Direction Estimation System Using DNN on BLE Beacon RSSI Fingerprints", Advances in Science, Technology and Engineering Systems Journal, vol. 7, no. 3, pp. 129–138, 2022. doi: 10.25046/aj070315
- Jayan Kant Duggal, Mohamed El-Sharkawy, "High Performance SqueezeNext: Real time deployment on Bluebox 2.0 by NXP", Advances in Science, Technology and Engineering Systems Journal, vol. 7, no. 3, pp. 70–81, 2022. doi: 10.25046/aj070308
- Hanae Naoum, Sidi Mohamed Benslimane, Mounir Boukadoum, "Encompassing Chaos in Brain-inspired Neural Network Models for Substance Identification and Breast Cancer Detection", Advances in Science, Technology and Engineering Systems Journal, vol. 7, no. 3, pp. 32–43, 2022. doi: 10.25046/aj070304
- Bougar Marieme, Ziyati El Houssaine, "Analysis Methods and Classification Algorithms with a Novel Sentiment Classification for Arabic Text using the Lexicon-Based Approach", Advances in Science, Technology and Engineering Systems Journal, vol. 7, no. 3, pp. 12–18, 2022. doi: 10.25046/aj070302
- Sreela Sreekumaran Pillai Remadevi Amma, Sumam Mary Idicula, "A Unified Visual Saliency Model for Automatic Image Description Generation for General and Medical Images", Advances in Science, Technology and Engineering Systems Journal, vol. 7, no. 2, pp. 119–126, 2022. doi: 10.25046/aj070211
- Idir Boulfrifi, Mohamed Lahraichi, Khalid Housni, "Video Risk Detection and Localization using Bidirectional LSTM Autoencoder and Faster R-CNN", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 6, pp. 145–150, 2021. doi: 10.25046/aj060619
- Giuseppe Spampinato, Arcangelo Ranieri Bruna, Ivana Guarneri, Davide Giacalone, "Neural Network for 2D Range Scanner Navigation System", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 5, pp. 348–355, 2021. doi: 10.25046/aj060539
- Seok-Jun Bu, Hae-Jung Kim, "Ensemble Learning of Deep URL Features based on Convolutional Neural Network for Phishing Attack Detection", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 5, pp. 291–296, 2021. doi: 10.25046/aj060532
- Osaretin Eboya, Julia Binti Juremi, "iDRP Framework: An Intelligent Malware Exploration Framework for Big Data and Internet of Things (IoT) Ecosystem", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 5, pp. 185–202, 2021. doi: 10.25046/aj060521
- Nasrin Dehbozorgi, Mary Lou Maher, Mohsen Dorodchi, "Emotion Mining from Speech in Collaborative Learning", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 5, pp. 90–100, 2021. doi: 10.25046/aj060512
- Baida Ouafae, Louzar Oumaima, Ramdi Mariam, Lyhyaoui Abdelouahid, "Survey on Novelty Detection using Machine Learning Techniques", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 5, pp. 73–82, 2021. doi: 10.25046/aj060510
- Radwan Qasrawi, Stephanny VicunaPolo, Diala Abu Al-Halawa, Sameh Hallaq, Ziad Abdeen, "Predicting School Children Academic Performance Using Machine Learning Techniques", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 5, pp. 08–15, 2021. doi: 10.25046/aj060502
- Liang Chen, Mo-How Herman Shen, "A New Topology Optimization Approach by Physics-Informed Deep Learning Process", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 4, pp. 233–240, 2021. doi: 10.25046/aj060427
- Saichon Sinsomboonthong, "Efficiency Comparison in Prediction of Normalization with Data Mining Classification", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 4, pp. 130–137, 2021. doi: 10.25046/aj060415
- Valerii Dmitrienko, Serhii Leonov, Aleksandr Zakovorotniy, "New Neural Networks for the Affinity Functions of Binary Images with Binary and Bipolar Components Determining", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 4, pp. 91–99, 2021. doi: 10.25046/aj060411
- Anjali Banga, Pradeep Kumar Bhatia, "Optimized Component based Selection using LSTM Model by Integrating Hybrid MVO-PSO Soft Computing Technique", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 4, pp. 62–71, 2021. doi: 10.25046/aj060408
- Kwun-Ping Lai, Jackie Chun-Sing Ho, Wai Lam, "Exploiting Domain-Aware Aspect Similarity for Multi-Source Cross-Domain Sentiment Classification", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 4, pp. 01–12, 2021. doi: 10.25046/aj060401
- Svetlana Segarceanu, George Suciu, Inge Gavăt, "Environmental Acoustics Modelling Techniques for Forest Monitoring", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 3, pp. 15–26, 2021. doi: 10.25046/aj060303
- Nadia Jmour, Slim Masmoudi, Afef Abdelkrim, "A New Video Based Emotions Analysis System (VEMOS): An Efficient Solution Compared to iMotions Affectiva Analysis Software", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 2, pp. 990–1001, 2021. doi: 10.25046/aj0602114
- Bakhtyar Ahmed Mohammed, Muzhir Shaban Al-Ani, "Follow-up and Diagnose COVID-19 Using Deep Learning Technique", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 2, pp. 971–976, 2021. doi: 10.25046/aj0602111
- Showkat Ahmad Dar, S Palanivel, "Performance Evaluation of Convolutional Neural Networks (CNNs) And VGG on Real Time Face Recognition System", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 2, pp. 956–964, 2021. doi: 10.25046/aj0602109
- Kenza Aitelkadi, Hicham Outmghoust, Salahddine laarab, Kaltoum Moumayiz, Imane Sebari, "Detection and Counting of Fruit Trees from RGB UAV Images by Convolutional Neural Networks Approach", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 2, pp. 887–893, 2021. doi: 10.25046/aj0602101
- Binghan Li, Yindong Hua, Mi Lu, "Advanced Multiple Linear Regression Based Dark Channel Prior Applied on Dehazing Image and Generating Synthetic Haze", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 2, pp. 790–800, 2021. doi: 10.25046/aj060291
- Abraham Adiputra Wijaya, Inten Yasmina, Amalia Zahra, "Indonesian Music Emotion Recognition Based on Audio with Deep Learning Approach", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 2, pp. 716–721, 2021. doi: 10.25046/aj060283
- Shahnaj Parvin, Liton Jude Rozario, Md. Ezharul Islam, "Vehicle Number Plate Detection and Recognition Techniques: A Review", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 2, pp. 423–438, 2021. doi: 10.25046/aj060249
- Md. Ashfaqul Islam, Maisha Hasnin, Nayeem Iftakhar, Md. Mushfiqur Rahman, "Super Resolution Based Underwater Image Enhancement by Illumination Adjustment and Color Correction with Fusion Technique", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 2, pp. 36–42, 2021. doi: 10.25046/aj060205
- Prasham Shah, Mohamed El-Sharkawy, "A-MnasNet and Image Classification on NXP Bluebox 2.0", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 1, pp. 1378–1383, 2021. doi: 10.25046/aj0601157
- Byeongwoo Kim, Jongkyu Lee, "Fault Diagnosis and Noise Robustness Comparison of Rotating Machinery using CWT and CNN", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 1, pp. 1279–1285, 2021. doi: 10.25046/aj0601146
- Basavaraj Madagouda, R. Sumathi, "Artificial Neural Network Approach using Mobile Agent for Localization in Wireless Sensor Networks", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 1, pp. 1137–1144, 2021. doi: 10.25046/aj0601127
- Arwa A. Al Shamsi, Sherief Abdallah, "Text Mining Techniques for Sentiment Analysis of Arabic Dialects: Literature Review", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 1, pp. 1012–1023, 2021. doi: 10.25046/aj0601112
- Alisson Steffens Henrique, Anita Maria da Rocha Fernandes, Rodrigo Lyra, Valderi Reis Quietinho Leithardt, Sérgio D. Correia, Paul Crocker, Rudimar Luis Scaranto Dazzi, "Classifying Garments from Fashion-MNIST Dataset Through CNNs", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 1, pp. 989–994, 2021. doi: 10.25046/aj0601109
- Reem Bayari, Ameur Bensefia, "Text Mining Techniques for Cyberbullying Detection: State of the Art", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 1, pp. 783–790, 2021. doi: 10.25046/aj060187
- Imane Jebli, Fatima-Zahra Belouadha, Mohammed Issam Kabbaj, Amine Tilioua, "Deep Learning based Models for Solar Energy Prediction", Advances in Science, Technology and Engineering Systems Journal, vol. 6, no. 1, pp. 349–355, 2021. doi: 10.25046/aj060140
- Arwa Alshamsi, Reem Bayari, Said Salloum, "Sentiment Analysis in English Texts", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 1683–1689, 2020. doi: 10.25046/aj0506200
- Karamath Ateeq, Manas Ranjan Pradhan, Beenu Mago, "Elasticity Based Med-Cloud Recommendation System for Diabetic Prediction in Cloud Computing Environment", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 1618–1633, 2020. doi: 10.25046/aj0506193
- Revanna Sidamma Kavitha, Uppara Eranna, Mahendra Nanjappa Giriprasad, "A Computational Modelling and Algorithmic Design Approach of Digital Watermarking in Deep Neural Networks", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 1560–1568, 2020. doi: 10.25046/aj0506187
- Xianxian Luo, Songya Xu, Hong Yan, "Application of Deep Belief Network in Forest Type Identification using Hyperspectral Data", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 1554–1559, 2020. doi: 10.25046/aj0506186
- Majdouline Meddad, Chouaib Moujahdi, Mounia Mikram, Mohammed Rziza, "Optimization of Multi-user Face Identification Systems in Big Data Environments", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 762–767, 2020. doi: 10.25046/aj050691
- Yohei Yamauchi, Mitsuyuki Saito, "Adaptive Identification Method of Vehicle Model for Autonomous Driving Robust to Environmental Disturbances", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 710–717, 2020. doi: 10.25046/aj050685
- Marcel Nicola, Marian Duță, Maria-Cristina Nițu, Ancuța-Mihaela Aciu, Claudiu-Ionel Nicola, "Improved System Based on ANFIS for Determining the Degree of Polymerization", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 664–675, 2020. doi: 10.25046/aj050680
- Azani Cempaka Sari, Natashia Virnilia, Jasmine Tanti Susanto, Kent Anderson Phiedono, Thea Kevin Hartono, "Chatbot Developments in The Business World", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 627–635, 2020. doi: 10.25046/aj050676
- Khalid Chennoufi, Mohammed Ferfra, "Fast and Efficient Maximum Power Point Tracking Controller for Photovoltaic Modules", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 606–612, 2020. doi: 10.25046/aj050674
- Kin Yun Lum, Yeh Huann Goh, Yi Bin Lee, "American Sign Language Recognition Based on MobileNetV2", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 481–488, 2020. doi: 10.25046/aj050657
- Miroslav Kratky, Vaclav Minarik, Michal Sustr, Jan Ivan, "Electronic Warfare Methods Combatting UAVs", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 447–454, 2020. doi: 10.25046/aj050653
- Gede Putra Kusuma, Jonathan, Andreas Pangestu Lim, "Emotion Recognition on FER-2013 Face Images Using Fine-Tuned VGG-16", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 315–322, 2020. doi: 10.25046/aj050638
- Lubna Abdelkareim Gabralla, "Dense Deep Neural Network Architecture for Keystroke Dynamics Authentication in Mobile Phone", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 307–314, 2020. doi: 10.25046/aj050637
- Helen Kottarathil Joy, Manjunath Ramachandra Kounte, "A Comprehensive Review of Traditional Video Processing", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 274–279, 2020. doi: 10.25046/aj050633
- Kailerk Treetipsounthorn, Thanisorn Sriudomporn, Gridsada Phanomchoeng, Christian Dengler, Setha Panngum, Sunhapos Chantranuwathana, Ali Zemouche, "Vehicle Rollover Detection in Tripped and Untripped Rollovers using Recurrent Neural Networks", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 228–238, 2020. doi: 10.25046/aj050627
- Andrea Generosi, Silvia Ceccacci, Samuele Faggiano, Luca Giraldi, Maura Mengoni, "A Toolkit for the Automatic Analysis of Human Behavior in HCI Applications in the Wild", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 185–192, 2020. doi: 10.25046/aj050622
- Fei Gao, Jiangjiang Liu, "Effective Segmented Face Recognition (SFR) for IoT", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 36–44, 2020. doi: 10.25046/aj050605
- Pamela Zontone, Antonio Affanni, Riccardo Bernardini, Leonida Del Linz, Alessandro Piras, Roberto Rinaldo, "Supervised Learning Techniques for Stress Detection in Car Drivers", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 6, pp. 22–29, 2020. doi: 10.25046/aj050603
- Sherif H. ElGohary, Aya Lithy, Shefaa Khamis, Aya Ali, Aya Alaa el-din, Hager Abd El-Azim, "Interactive Virtual Rehabilitation for Aphasic Arabic-Speaking Patients", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 1225–1232, 2020. doi: 10.25046/aj0505148
- Daniyar Nurseitov, Kairat Bostanbekov, Maksat Kanatov, Anel Alimova, Abdelrahman Abdallah, Galymzhan Abdimanap, "Classification of Handwritten Names of Cities and Handwritten Text Recognition using Various Deep Learning Models", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 934–943, 2020. doi: 10.25046/aj0505114
- Zahra Jafari, Saman Rajebi, Siyamak Haghipour, "Using the Neural Network to Diagnose the Severity of Heart Disease in Patients Using General Specifications and ECG Signals Received from the Patients", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 882–892, 2020. doi: 10.25046/aj0505108
- Khalid A. AlAfandy, Hicham Omara, Mohamed Lazaar, Mohammed Al Achhab, "Using Classic Networks for Classifying Remote Sensing Images: Comparative Study", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 770–780, 2020. doi: 10.25046/aj050594
- Gökalp Çınarer, Bülent Gürsel Emiroğlu, Recep Sinan Arslan, Ahmet Haşim Yurttakal, "Brain Tumor Classification Using Deep Neural Network", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 765–769, 2020. doi: 10.25046/aj050593
- Khalid A. AlAfandy, Hicham, Mohamed Lazaar, Mohammed Al Achhab, "Investment of Classic Deep CNNs and SVM for Classifying Remote Sensing Images", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 652–659, 2020. doi: 10.25046/aj050580
- Lana Abdulrazaq Abdullah, Muzhir Shaban Al-Ani, "CNN-LSTM Based Model for ECG Arrhythmias and Myocardial Infarction Classification", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 601–606, 2020. doi: 10.25046/aj050573
- Chigozie Enyinna Nwankpa, "Advances in Optimisation Algorithms and Techniques for Deep Learning", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 563–577, 2020. doi: 10.25046/aj050570
- Jajam Haerul Jaman, Rasdi Abdulrohman, Aries Suharso, Nina Sulistiowati, Indah Purnama Dewi, "Sentiment Analysis on Utilizing Online Transportation of Indonesian Customers Using Tweets in the Normal Era and the Pandemic Covid-19 Era with Support Vector Machine", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 389–394, 2020. doi: 10.25046/aj050549
- Sathyabama Kaliyapillai, Saruladha Krishnamurthy, "Differential Evolution based Hyperparameters Tuned Deep Learning Models for Disease Diagnosis and Classification", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 253–261, 2020. doi: 10.25046/aj050531
- Hicham Moujahid, Bouchaib Cherradi, Oussama El Gannour, Lhoussain Bahatti, Oumaima Terrada, Soufiane Hamida, "Convolutional Neural Network Based Classification of Patients with Pneumonia using X-ray Lung Images", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 167–175, 2020. doi: 10.25046/aj050522
- Mohsine Elkhayati, Youssfi Elkettani, "Towards Directing Convolutional Neural Networks Using Computational Geometry Algorithms: Application to Handwritten Arabic Character Recognition", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 137–147, 2020. doi: 10.25046/aj050519
- Nghia Duong-Trung, Luyl-Da Quach, Chi-Ngon Nguyen, "Towards Classification of Shrimp Diseases Using Transferred Convolutional Neural Networks", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 4, pp. 724–732, 2020. doi: 10.25046/aj050486
- Tran Thanh Dien, Nguyen Thanh-Hai, Nguyen Thai-Nghe, "Deep Learning Approach for Automatic Topic Classification in an Online Submission System", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 4, pp. 700–709, 2020. doi: 10.25046/aj050483
- Adonis Santos, Patricia Angela Abu, Carlos Oppus, Rosula Reyes, "Real-Time Traffic Sign Detection and Recognition System for Assistive Driving", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 4, pp. 600–611, 2020. doi: 10.25046/aj050471
- Amar Choudhary, Deependra Pandey, Saurabh Bhardwaj, "Overview of Solar Radiation Estimation Techniques with Development of Solar Radiation Model Using Artificial Neural Network", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 4, pp. 589–593, 2020. doi: 10.25046/aj050469
- Mohammed Qbadou, Intissar Salhi, Hanaâ El fazazi, Khalifa Mansouri, Michail Manios, Vassilis Kaburlasos, "Human-Robot Multilingual Verbal Communication – The Ontological knowledge and Learning-based Models", Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 4, pp. 540–547, 2020. doi: 10.25046/aj050464