Real-time facial emotion recognition and mood correction with Spotify integration / Adam Zikri Zailani

This project presents the development of a mobile application aimed at enhancing driver well-being through real-time facial emotion recognition and mood correction. The application utilizes deep learning-based emotion recognition, employing the MobileNetV2 convolutional neural network, to identify f...

Full description

Saved in:
Bibliographic Details
Main Author: Zailani, Adam Zikri
Format: Thesis
Language:English
Published: 2023
Subjects:
Online Access:https://ir.uitm.edu.my/id/eprint/88974/1/88974.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This project presents the development of a mobile application aimed at enhancing driver well-being through real-time facial emotion recognition and mood correction. The application utilizes deep learning-based emotion recognition, employing the MobileNetV2 convolutional neural network, to identify four primary emotions - sad, happy, angry, and neutral - in drivers. Upon recognizing negative emotional states, such as anger and sadness, the app responds by playing music from Spotify to uplift the driver's mood. The successful implementation of the mobile app showcases its potential to mitigate negative emotions in drivers, providing a novel approach to promote emotional well-being during driving experiences. Accuracy obtained from controlled environment testing using python coding snippets proved promising with over 90% accuracy across all four emotions. However, the paper also acknowledges certain limitations, including the app's limited emotional spectrum, individual variability in emotional expression, and the challenge of distinguishing genuine anger from naturally angry resting faces. Additionally, technical constraints related to CNN architecture and hardware requirements are discussed.