I am working on a multimodal alert system which can detect eyes- off-road distraction and cognitive states of driver to alert with haptic, auditory and visual feedback. When an eyes-off-road event is detected, it will alert the driver by an auditory sound followed by a voice note telling “please concentrate on driving”. An LED (Light Emit- ting Diode) strip lights up with a blinking pattern to alert the driver vi- sually. If it detects that the driver is undergoing distraction, it will lock secondary tasks from being operated by driver. In case a call or message is received, the system does not pop up any notification to the driver. The system will display only important IVIS functions on the screen. The icon size and colours will adapt according to the cognitive state of driver. When driver’s cognitive load decreases, it will retract notifying driver about his missed calls and messages. The driver will then have access to operate locked secondary tasks. The working of alert system is illustrated in figure below.

Publications:

• Prabhakar, G., Mukhopadhyay, A., Murthy, L., Modiksha, M., Sachin, D., & Biswas, P. (2020). Cognitive load estimation using ocular parameters in automotive. Transportation Engineering, 2, 100008, ISSN 2666-691X. DOI: 10.1016/j.treng.2020.100008