Can artificial intelligence understand our emotions? Deep learning applications with face recognition

ObjectiveThe aim of this study is to evaluate the ability to detect emotions from human facial expressions via facial recognition technologies and analyze the effectiveness of deep learning models in this process.MethodThis research was conducted between 01.04 and 01.07.2024. The data of the study were taken from the open access site https://www.kaggle.com/datasets/msambare/fer2013 (Kaggle, 2024). Python 3.8 is used in this study. The FER-2013 (Facial Expression Recognition 2013) dataset is a comprehensive collection of facial images labeled with various emotions. The dataset contains 35,887 grayscale facial images. Each image has a size of 48 x 48 pixels. The dataset consists of images belonging to 7 emotion categories: anger, disgust, fear, happy, sad, confused, and neutral.ResultsIn our experiments on the FER2013 dataset, we evaluated the performance of three different models: MobileNetV3-L, EfficientNetV2-L, and our proposed EfficientMobileNet. The evaluation criteria were based on sensitivity, specificity, accuracy, and F1 scores to assess the effectiveness of each model comprehensively. The EfficientMobileNet model outperformed MobileNetV3-L and EfficientNetV2-L in all measured performance metrics. EfficientMobileNet was the most successful model for predicting emotions, with an accuracy of 77.6%.ConclusionThe impressive results obtained by EfficientMobileNet on the Fer2013 dataset show potential for wider application, especially in image classification tasks involving low-quality or small-scale images. This performance supports the idea of the potential for further improvements in neural network architecture and model efficiency and accuracy. Future work should focus on optimizing the model for more challenging datasets, studying the impact of different architectural adjustments, and investigating the scalability of EfficientMobileNet across various domains and applications.