Towards real-time tracking of persons in distress phase situations using emotional physiological signals

Abstract

This research work investigates physiological signals based human emotion and its incorporation in an affective system architecture for real-time tracking of persons in distress phase situations to prevent the occurrence of casualties. In a casualty situation, a mishap has already occurred leading to life, limb and valuables being in a state of peril. However, in a distress phase situation, there is a high likelihood that a tragedy is about to occur unless an immediate assistance is rendered. The distress phase situations include the spate of kidnapping, human trafficking and terrorism related crimes that could lead to casualty such as loss of lives, properties, finances and destruction of infrastructure. These situations are of global concern and worldwide phenomenon that necessitate a system that could mitigate the alarming trend of social crimes. The novel idea of deploying a combination of data and knowledge driven approaches using wearable sensor devices supported by machine learning methods could prove useful as a preventive mechanism in a distress phase situation. Such a system could be achieved through modelling human emotion recognition, including the harvesting and recognising human emotion physiological signals. Different methods have been applied in emotion recognition domain because the extraction of relevant discriminating features has been identified as an unresolved and one of the most daunting aspects of physiological signals based human emotion recognition system. In this thesis, emotion physiological signals, image processing technique and shallow learning based on radial basis function neural network were used to construct a system for real-time tracking of persons in distress phase situations. The system was tested using the Database for Emotion Analysis using Physiological Signal (DEAP) to ascertain the recognition performance that could be achieved. Emotion representations such as Arousal, Valence, Dominance and Liking have been creatively mapped to different conditions of human safety and survival state like happy phase, distress phase and casualty phase in a real-time system for tracking of persons. The constructed system can practically benefit security agencies, emergency services, rescue teams and restore confidence to both the potential victims and their family by proactively providing assistance in an emergency event of a distress phase situation. Moreover, the system would prove beneficial in stemming the tide of the identified societal crimes and tragedies by thwarting the successful progress of a distress phase situation through an application of information communication technology to address critical societal challenges. The performance of the recognition algorithmic component of the constructed system gives accuracy that outperforms the state of the art results based on deep learning techniques.