Driver's distraction is one of the main areas, which researchers are focusing on, in design of Advanced Drivers Assistance Systems (ADASs). Head pose and eye-gaze direction are two reliable indicators of a driver's gaze and the current focus of attention. Compared with other methods that make use of head pose only, methods that combine eye information can achieve higher accuracy. The naturalistic driving environment always presents unique challenges (e.g., unstable illumination, jolts, etc.) to video-based gaze estimation and tracking systems. Some methods can achieve relatively high proficiency in the stationary laboratory environment, but they may not be suitable for the unstable driving environment. In addition, performing in real time or near-real time is another consideration for gaze estimation in an ADAS. Therefore, these special challenges need to be overcome to design ADASs. In this thesis, we proposed a new driver's gaze zone estimation framework designed for the naturalistic driving environment. The framework combines head and eye information to estimate the gaze zone of the driver in both daytime and nighttime. The framework is composed of five main components: Facial Landmark Detection, Head Pose Estimation, Iris Center Detection, Upper Eyelid Information Extraction, and Gaze Zone Estimation. First, Constrained Local Neural Field (CLNF) is applied to obtain the facial landmarks in the image plane and the 3D model of the face in the object frame. In addition, extracting region of interest (ROI) is utilized as an optimization strategy for CLNF facial landmark detection. Second, head pose estimation can be regarded as a Perspective-n-Point (PnP) problem. Levenberg-Marquardt optimization method is used to solve the PnP problem based on the 2D landmark locations in the image plane and their corresponding 3D locations in the object frame. Third, a regression model-based method is employed to obtain the iris center from eye landmarks detected in the previous part. For upper eyelid information extraction, a quadratic function is utilized to model the upper eyelid, and the second-order coefficient is extracted. Finally, the head pose and the eye information are combined to form a feature vector, and Random Decision Forest classifier is utilized to estimate the current gaze zone of the driver from the feature vector extracted. The experiment is carried out in the realistic driving environment in both daytime and nighttime with three volunteers by Kinect sensor V2 for Windows that is put at the back of windshield. Weighted and unweighted accuracy are utilized as evaluation metrics in gaze zone estimation. Weighted accuracy evaluates gaze zones with different significance while unweighted accuracy treats each gaze zone equally. Experiment results show that the gaze zone estimation framework proposed in this work has better performance compared to the reference in the daytime. The weighted and unweighted accuracy of gaze zone estimation reach 96.6% and 95.0% for daytime, respectively. For nighttime, the weighted and unweighted accuracy can reach 96% and 91.4%.

Made available in DSpace on 2016-03-15T19:37:33Z (GMT). No. of bitstreams: 1 Valmir Fernandes Junior.pdf: 2218220 bytes, checksum: f12b7829c2024510149ca8f24aa66e26 (MD5) Previous issue date: 2010-08-10 / This paper presents a technique to iris detection and tracking that can be used in a human computer interface which allows people with mobility restricted, including no mobility above the shoulders, can control the mouse pointer only moving their eyes, without using expensive equipments. The unique data input used is an ordinary webcam without optical zoon, special lights or restricting user face mobility. The mouse displacement will occur in a straight way, in other words, the mouse cursor will be positioned at the place estimated by the technique. To the iris detection tests 60 images were used. 90.83% of the iris were identified correctly, there were 4.17% of missing iris and 5% false positives (iris were estimated in a wrong place). Using images generated straight from the webcam the iris were found correctly in 87,5%, no iris were found in 11,11% and in 1,39% the technique found iris in wrong places, the average time between positioning and a click is about 20 seconds. / Este trabalho apresenta uma técnica de detecção e rastreamento de íris para ser utilizada em uma interface homem-computador que permita pessoas com mobilidade restrita, inclusive sem mobilidade nos ombros, possam controlar o cursor do mouse com o movimento dos olhos, sem a necessidade de adquirir equipamentos caros. A única entrada de dados utilizada é uma webcam simples sem auxílio de zoon ótico, iluminação especial ou fixação da face do usuário. A movimentação do mouse dar-se-á de maneira direta, ou seja, o ponteiro do mouse será direcionado para a região estimada pela técnica. Para a realização dos testes de detecção de íris foram utilizadas 60 imagens. Em 90.83% dos casos as íris foram encontradas corretamente, 4.17% dos casos não foram identificados e ocorreram 5% de falsos positivos (casos em que as íris foram estimadas no lugar errado). Com as imagens geradas diretamente pela webcam a identificação das íris ocorreu com sucesso em 87,50% dos casos, erros em 11,11 % e 1,39% de falsos positivos, o tempo médio entre o posicionamento e um clique é de cerca de 20 segundos.