Projects Description
Decoding Olfactory Cognition
Objective brain-based assessment of olfactory response to different odors holds the potential to minimize inconsistencies between screening consumer tests and actual, in-use tests, or market performance of odor products. Particularly, the use of electroencephalogram (EEG)-based technologies in developing such objective assessment solutions is attractive due to the fact that it provides a fast, non-invasive strategy for probing olfactory perception. To capture the complex nature of brain function involved in olfaction we are developing approaches for integrating different levels of information contained in the brain response to odor stimuli: local information scrutinized at different frequency bands and global functional information by means of interdependencies in the activity of different brain regions (brain networks), which reflects how information is processed and transferred across the brain.
Goals
The main goals of this project are: a) feasibility assessment for the objective categorization of the olfactory response to odor stimuli of different levels of perceived pleasantness and reward value of samples; b) development of portable (out-of-the lab) EEG-based systems for real-time assessment of neural response to olfactory stimuli; and c) development of next generation consumer testing platforms that enable objective brain-based assessment and provide support for behavioral experimental designs. To achieve these goals, our machine learning framework is used to decode brain signals and extract relevant information from EEG data in real time. The developed software platforms are used in pre-market consumer research by our industry partners.
Restoring Sensation to Amputees
Can an upper-limb amputee reach out and touch a soft, warm hand and feel it? Can a human-like, or a humanoid, robotic hand safely grasp a hot kitchen appliance (or, in a human-like reflex, react) ? How are multiple sensory streams - touch, temperature, force - integrated for sensory perception? How and where does the sensory embodiment and integration occur? Our work focuses on building computational models that explain how multiple sensory inputs are integrated by humans to enable our dream of giving a range of sensory perceptions and enabling control of prosthesis. This work is a collaboration between the Cognitive Engineering group at NUS and teams at Johns Hopkins University (JHU) and at the Technical University of Munich (TUM). We utilize our advanced sensor and robotics research and prosthesis technologies to conduct experiments and develop computer models of sensory processing in the brain. Our collaboration is focused on how a wide dynamic range of sensory stimuli, from innocuous to noxious, can be perceived and classified through the brain’s rhythms. We build computational models of the sensory networks to explain how multiple sensory streams are integrated in the brain and how multiple sensations, from innocuous (mild tactile) to noxious (painful), are accommodated.
Complex Brain Networks in Health and Diseases
The cognitive engineering program focuses on studying mental functions and how and where brain encodes information. We develop computational and analytical tools to analyze brain rhythms, mainly the EEG signal and functional MIR (fMRI) images. We develop network and graph models of the brain signals from different areas, study their interactions and connectivity. The goal is to use brain monitoring to assess mental workload, fatigue, alertness and arousal. This would have application in activities like driving and flying where both monotony or alertness can be a problem, and in human-machine interactions such as in autonomous driving. For elderly, we may be able to study onset of dementia, while in children we may be able study autism spectrum disorder.
Mental Fatigue Prediction Using Brain Connectivity (Brainteaser project)
Fatigue is a complex state, manifesting in general in the form drowsiness, deterioration in the vigilance level and reduced mental or physical performance, which may result in car crashes. Therefore, we developed a driving simulator system for driving fatigue tracking in order to prevent mental fatigue-related accidents. We developed two parallel analysis frameworks, which are power spectrum density based metrics for driving fatigue monitoring and functional connectivity based measures for fatigue assessment. We aim to develop an analysis framework for fatigue states monitoring in real time based on dry EEG systems. The estimated mental states can be used as bio-markers to automate the system when human operator is in risk-prone conditions. This design is potentially beneficial to other safety-critical areas including industrial control and air traffic management.
Human-Intelligent Machine Coexistence (HELIOS)
The HELIOS project focuses on developing a novel integrative framework for human machine interaction system (HMI) as a collaboration between human and modern machines, which will be applied to enhance motor, speech and neurocognition restoration of stroke patients. HELIOS will incorporate feedback to facilitate therapy course by establishing a trusted human-machine relationship through collaboration, conversation, and cognitive association. The overarching goal is to demonstrate the implementation of the devised framework in stroke rehabilitation therapy, targeting neurocognition and neuromotor restoration and enhancement through feedback and plasticity. Additionally,the research on machine intelligence will address both human and machine adaptation within real-life conditions. The research program has three main research pillars, which are Physical HMI (Assistive and augmentative motor control systems), Communication HMI (human-machine ‘speech chain’ for speech rehabilitation), and BM-I (HMI through Brain-Machine).
Biomarkers for Creative Ideation
Creativity is defined as the ability to produce ideas that are both novel and useful. It is a crucial skill for effective problem-solving and decision-making, especially under extreme circumstances, in volatile, uncertain and increasingly complex environments. We designed an experimental paradigm where the participants were asked to perform Alternative Uses (AU, which participants were asked to think of alternative/unconventional ways to use everyday objects) task and Object Characteristics (OC, which participants were asked to list typical characteristics or properties of an object) task. We estimated relative power spectrum, global efficiency from brain networks constructed with the imaginary part of coherence and phase-to-amplitude coupling (PAC) as potential biomarker of creativity. Statistically significant differences between AU and OC were detected with PAC estimated within sensors in certain frequency pairs, which can be considered as the ground for both detecting and designing a connectomic biomarker of creativity.
Cognitive AI Frontiers for Autonomous Driving and Flying
Autonomous driving is becoming increasingly popular. What is the role of humans in autonomous driving? How do humans and machines (car) interact? We have developed a full virtual reality simulator for autonomous driving. We have developed another simulator for autonomous flying. The driver/student works in this simulator and his brain/mind is monitored during the autonomous experience. We study brain waves, eye movements, and give haptic/touch feedback. This project may be of interest to students interested in AI, augmented reality, autonomous driving. Good programming, AI/machine learning, and other skills or interests are desirable. This project has very practical real-life applications in human-machine interaction, and in advanced topics of AI and brain information processing.
Funding
