Its ubiquity emerges from extensible regions of potential applications. Recently, automatic recognition of emotion has become a popular research field involving researchers from the industry, as well as academia, specializing in artificial consciousness, computer vision, brain computing, physiology, and, more recently, deep learning. Recognizing emotions is highly usable in artificially intelligent systems, to enable such systems in recognizing and predicting human emotions to enhance productivity and effectiveness of working with computers. The proposed integrated DNN outperforms the state-of-the-art approaches.Īn emotion is a physiological state of mind that is subjective and is constituted by associated thoughts, feelings, and behavioral responses that are homogeneous. In our study, to classify emotions, VGG 16 outperforms others with an accuracy of 96% and F1 score of 0.85. The approach utilizes Mask R-CNN for character detection and state-of-the-art deep learning models, namely ResNet-50, MobileNetV2, InceptionV3, and VGG 16 for emotion classification. The proposed integrated DNN approach, trained on a large dataset consisting of animations for both the characters ( Tom and Jerry), correctly identifies the character, segments their face masks, and recognizes the consequent emotions with an accuracy score of 0.96. Since state-of-works do not have large amount of data, we collected a dataset of size 8 K from two cartoon characters: ‘Tom’ & ‘Jerry’ with four different emotions, namely happy, sad, angry, and surprise.

Therefore, in this paper, we present an integrated Deep Neural Network (DNN) approach that deals with recognizing emotions from cartoon images.

However, the emotion recognition from cartoon images has not been extensively covered.

Existing works have mostly focused well on recognizing basic emotions from human faces. Since emotions vary over time, it is important to understand and analyze them appropriately. It varies over time, since it is a natural instinctive state of mind deriving from one’s circumstances, mood, or relationships with others. Emotion is an instinctive or intuitive feeling as distinguished from reasoning or knowledge.

Cartoon facial expressions