ADAPT - Driver Monitoring Systems

AI Platforms for Driver & Passenger Monitoring

This study is part of a collaborative research project between Xperi and the ADAPT-2 SFI research center.

The aim of this research is to build an Artificial Intelligence Platform (AIP) for a new generation of driver and occupant monitoring systems (DMS/OMS) for automobiles. Such systems are an important component of the transition to fully autonomous driving and will improve vehicular safety by checking for drowsiness of the driver. They will hle monitor driver awareness and cognition, managing the switching between manual and semi-autonomous driving. The AIP does not send any personal data to a cloud service, thus ensuring that any speech or video data captured within the vehicle remains secure.

In order to build algorithms for DMS/OMS AIP, training data is required, in particular advanced 3D face and body models are used to simulate a range of human actions, gestures, expressions and activities. Data from these simulations are then used to build large 2D datasets that are used to train the AIP. It is important to have a diverse range of 3D models and Xperi is currently gathering data at multiple locations globally.