Abstract:

We present a driver fatigue state monitoring system for based on Kinect. Preprocessing the Kinect infrared image data can weaken the effect of light deficiency at night. Moreover, the processed images and the face recognition provided by Kinect are used to obtain the features of adriver’s head, mouth and eyes, which are further fused via RBF neural network to judge the fatigue state of drivers on different levels. The identification of fatigue state becomes more accurate and reliable with the help of the sliding average method and database technique. Simulation results show that the proposed system can effectively monitor the fatigue state of drivers at day time, or even at night.

Key words: driving monitoring;fatigue monitoring;infrared image;RBF;information fusion