SEVENEBASIC: DETECTION AND ANALYSIS OF FACIAL EXPRESSIONS ASSOCIATED WITH THE SEVEN BASIC EMOTIONS OF PAUL EKMAN
DOI:
https://doi.org/10.56238/levv17n58-033Keywords:
Facial Expressions, Emotions, MediaPipe, TensorFlowAbstract
SevenEBasic is a Python application for analyzing facial expressions in real time, based on Paul Ekman's seven basic emotions. It uses MediaPipe and TensorFlow to help interviewers identify predominant emotions in real time and better understand candidates' emotional responses. Developed using the Waterfall model, which encompasses requirements gathering, followed by detailed system design, code implementation, and extensive testing to ensure compliance with requirements. SevenEBasic meets its objectives and is useful in a variety of scenarios, although it faces challenges due to filtering issues in the dataset used, lighting and user position.
Downloads
References
ACHEAMPONG, F. A., Nunoo-Mensah, H., & Chen, W. N. (2023). A comprehensive review of emotion detection through multimodal data fusion and deep learning techniques. Neural Computing and Applications, 35, 13455-13480.
ALAVI, A., & Ahuja, S. (2023). Advances in emotion recognition technology: Applications in healthcare, education, and entertainment. Journal of Biomedical Informatics, 131, 104158.
CHEN, Y., Zhang, K., & Liu, Z. (2022). Emotion recognition in mental health: A comprehensive review. Journal of Biomedical Informatics, 126, 103964.
CORONEL, C., Morris, S., & Rob, P. (2016). Database Systems: Design, Implementation, and Management. Cengage Learning.
DENNIS, A., Wixom, B. H., y Tegarden, D. (2019). Systems analysis and design (6th ed.). John Wiley y Sons.
EKMAN, P. (1992). An Argument for Basic Emotions. Cognition y Emotion, 6(3-4), 169- 200.
EKMAN, P. E.; Davidson, R. J. (1994c). The nature of emotion: Fundamental questions. Oxford University Press.
EKMAN, P.; Friesen, W. V. (1971). Constants across cultures in the face and emotion. Journal of Personality and Social Psychology, 17(2), 124-129.
FOX NETWORK. (2009). Lie To Me [Image of facial expressions].
FRIJDA, N. (1995). Las leyes de la emoción. En MD Avia y MLS Bernardo (Comps), La personalidad: aspectos cognitivos y sociales. Madrid: Pirámide.
GOOGLE. Google AI Developers: MediaPipe Solutions guide. Disponible en https://ai.google.dev/edge/mediapipe/solutions/guide. Acceso el: 15 de abril de 2024.
LANDA, M. (2018). The principles of beautiful web design (4th ed.). SitePoint.
LÓPEZ, J. A., Álvarez, M. A., & Sánchez, R. E. (2022). Real-time emotion recognition using MediaPipe and deep learning techniques. Journal of Real-Time Image Processing, 19(5), 1571-1580.
MORO, A., & Cavalcante, F. (2021). Use of MediaPipe for emotional assessment in educational environments. Electronics, 10(12), 1384.
NORRIS, C. (2023). Managing your emotions during an interview. Wicklander-Zulawski. Disponible en: https://www.w-z.com/2017/03/15/managing-your-emotions-during-an- interview. Acceso el: 17 de octubre de 2024.
PINHEIRO, Eduardo Felipe Santos. (2023). Sistema para Avaliação de Interfaces a Partir das Emoções dos Usuários. Centro Paula Souza, Faculdade De Tecnologia De São Paulo. São Paulo, 2023.
PYTHON. Python: An Informal Introduction to Python. Disponible en https://docs.python.org/3/tutorial/introduction.html. Acceso el: 28 de abril de 2024.
SENDRA G., Alejandro. (2022). Aplicación web para fomentar el aprendizaje emocional en personas con trastorno del espectro autista. Escola Tècnica Superior d’Enginyeria Informàtica, Universitat Politècnica de València. Valencia, 2022.
SEGAL, N. (2022). Facial Expressions Training Data. Kaggle. Disponible en https://www.kaggle.com/datasets/noamsegal/affectnet-training-data. Acceso el: 12 de agosto de 2024.
SOOD, P. (2020). Google FER Image Format. Kaggle. Disponible en https://www.kaggle.com/datasets/prajwalsood/google-fer-image-format. Acceso el: 15 de agosto de 2024.
SOMMERVILLE, I. (2011). Software Engineering (9th ed.). Pearson Education.
TENSORFLOW. Learn: Introduction to TensorFlow. Disponible en https://www.tensorflow.org/learn. Acceso el: 28 de mayo de 2024.
TKINTER. Python: Graphical User Interfaces with Tk. Disponible en https://docs.python.org/3/library/tk.html. Acceso el: 6 de junio de 2024.
VÁZQUEZ S., Karla Itzel. (2021). Sistema de percepción de estados afectivos a través de cámara web para actividades no presenciales. Universidad Veracruzana Facultad Estadística E Informática. Xalapa, Veracruz a 26 de mayo del 2021.
WANG, X., Ren, Y., Luo, Z., He, W., Hong, J., & Huang, Y. (2023). Deep learning-based EEG emotion recognition: Current trends and future perspectives. Frontiers in Psychology, 14, 1126994.