In this thesis, a visual 3-D eye gaze tracker is designed and implemented to tested via computer simulations and on an experimental setup. Proposed tracker is designed to examine human perception on autostereoscopic displays when the viewer is 3m away from such displays. Two different methods are proposed for calibrating personal parameters and gaze estimation, namely line of gaze (LoG) and line of sight (LoS) solutions. 2-D and 3-D estimation performances of the proposed system are observed both using computer simulations and the experimental setup. In terms of 2-D and 3-D performance criteria, LoS solution generates slightly better results compared to that of LoG on experimental setup and their performances are found to be comparable in simulations. 2-D estimation inaccuracy of the system is obtained as smaller than 0.5&deg / during simulations and approximately 1&deg / for the experimental setup. 3-D estimation inaccuracy of the system along x- and y-axis is obtained as smaller than 2&deg / during the simulations and the experiments. However, estimation accuracy along z-direction is significantly sensitive to pupil detection and head pose estimation errors. For typical error levels, 20cm inaccuracy along z-direction is observed during simulations, whereas this inaccuracy reaches 80cm in the experimental setup.

眼動儀目前的主要用途在分析使用者的觀看行為，藉以改善介面的設計，或幫助身體有缺陷但眼睛還能轉動的使用者與外界溝通。隨著相關技術的發展，眼動儀將可能如同滑鼠、鍵盤一般，成為使用者輸入裝置的選項。本論文的目的在於設計並實作低成本之穿戴式與遠距眼動儀，並將其應用於以視線軌跡為基礎的人機介面，希望能夠增進人與電腦之間的互動方式。由於眼動儀會受到雜訊與角膜反射點等的影響，本研究提出利用瞳孔周圍暗色點比例較高的特性，增加定位之準確性，以改善眼動儀之精確度，此外，頭部的移動亦會造成眼動儀在計算投射位置時之誤差，本研究也針對這個問題提出因應之解決方案。利用前述製作的眼動儀，本論文實作數個以視線軌跡為基礎的人機介面，包括視線軌跡網頁瀏覽器、強化眼睛注視照片區域、井字遊戲、互動式媒體等，並利用眼動儀記錄使用者觀看手機介面的行為。 / Eye tracker, a device for measuring eye position and movements, has traditionally been used for research in human visual system, psychology and interface design. It has also served as an input device for people with disability. With recent progresses in hardware and imaging technology, it has the potential to complement, even replace popular devices such as mouse or keyboard for average users to communicate with the computer. It is the objective of this research to design and implement low-cost head-mounted and remote eye trackers and subsequently develop applications that take advantage of gaze-based interactions. Specifically, we improve the precision of the tracking result by designing a new pupil detection algorithm as well as compensating for head movement. We then present several gaze-based user interfaces, including eye-controlled web browser, attention-based photo browser, interactive game (tic-tac-toe) and media design. We also investigate the feasibility of utilizing the eye trackers to analyze and evaluate the design of mobile user interface.

The aim of this work is to design algorithm that will detect pupil from video. The theoretical knowledge necessary for proper pupil detection is also described in this master’s thesis. Detection is done on 24 videos that are converted to single images. The complete result the dependence of the pupil diameter on the used dioptre. The overall success rate of the algorithm is 88,13 %. The overall error is 11,87 %. For 17 out of 24 patients, it is confirmed that the greater the dioptre, the larger the pupil.

This thesis deals with the eye gaze tracking and determining the direction and the place of the view. The overview of methods for determining the view direction is provided here. The direct 3D gaze estimation technique is proposed and implemented. The eye gaze can be estimated by using a single camera and under nature head movement. This paper describes the algorithms for the image processing and the image description. The center of the pupil is determined by the genetic algorithm for the ellipse detection. The procedures of the instrumentation calibration are proposed here as well. The work also addresses the issue of the determining the eye location. Finally, the comparison of the accuracy with similar projects is mentioned in my thesis.

En aquesta memòria es presenten diversos treballs relacionats amb la utilització dels sensor de flux òptic de baix cost pel desenvolupament de nous sistemes de mesura compactes i de molt baix cost. Les aplicacions plantejades permeten aprofitar tot el potencial industrial d’aquest tipus de sensors. Els sensors de flux òptic tenen la peculiaritat d’incorporar dins d’un únic encapsulat un sistema d’adquisició d’imatges i un processador digital preprogramat per a realitzar el còmput de flux òptic (optical flow) de la imatge. D’aquesta manera, aquest tipus de sensors no requereixen cap sistema processador addicional i, en alguns casos, poden funcionar sense cap altre element addicional de control. Actualment, l’èxit dels sensors de flux òptic ha facilitat la seva producció industrial massiva amb costos de fabricació molt baixos el que ha incentivat el desenvolupament de noves aplicacions en camps tan diversos com la robòtica on el cost és un element fonamental en les aplicacions destinades a un mercat de consum. En aquesta memòria es presenta, per una banda, l’anàlisi de l’estat de l’art dels sensors de flux òptic i les seves aplicacions, i per l’altra, el treball de recerca realitzat sobre l’ús d’aquest sensor per a desenvolupar un codificador rotatiu incremental, un codificador absolut, un sistema de detecció de monedes falses de 2 euros, i per a realitzar el seguiment de la pupil•la de l’ull d’una persona amb discapacitat. Els resultats obtinguts a partir de les proves experimentals realitzades amb els diferents sensors de flux òptics utilitzats als dispositius proposats han permès validar les propostes realitzades i la versatilitat del disseny del sensor. / En esta memoria se presentan diversos trabajos de investigación relacionados con la utilización de sensores de flujo óptico de bajo coste para el desarrollo de nuevos sistemas de medida compactos y de muy bajo coste. Las aplicaciones planteadas permiten aprovechar todo el potencial industrial de este tipo de sensores. Los sensores de flujo óptico tienen la particularidad de incorporar dentro de un único encapsulado un sistema de adquisición de imágenes y un procesador digital preprogramado para realizar el cómputo de flujo óptico (optical flow) de la imagen. De esta manera, este tipo de sensores no requieren ningún sistema procesador adicional y, en algunos casos, pueden funcionar sin ningún otro elemento adicional de control. Actualmente, el éxito comercial de los sensores de flujo óptico ha facilitado su producción industrial masiva con costes de fabricación muy bajos lo que ha incentivado el desarrollo de nuevas aplicaciones en campos tan diversos como la robótica donde el coste es un elemento fundamental en las aplicaciones destinadas a un mercado de consumo. En esta memoria se presenta, por un lado, el análisis del estado del arte de los sensores de flujo óptico y sus aplicaciones, y por el otro, el trabajo de investigación realizado sobre la utilización del sensor para el desarrollo de un codificador rotativo incremental, un codificador absoluto, un sistema de detección de monedas falsas de 2 euros y para realizar el seguimiento de la pupila del ojo de una persona con el fin de desarrollar un dispositivo apuntador que pueda ser de utilidad para una persona con discapacidad. Los resultados obtenidos en las pruebas experimentales realizadas con los diferentes sensores de flujo óptico utilizados en los dispositivos propuestos han permitido validar las propuestas realizadas y la versatilidad del diseño del sensor. / This work presents the research performed with optical flow sensors and the proposal of several new compact and low cost applications developed to take full advantage of the industrial potential of these sensors. Optical flow sensors include into the same chip an image acquisition system and a digital signal processor programmed to compute the optical flow of the image acquired. These sensors do not require additional post-processing and can operate without any other additional external control or processing device. Currently, the commercial success of the optical flow sensors has fostered its massive industrial production and has reduced its final cost. This characteristic, combined with the versatility of the design of the sensor, has also fostered the development of a huge range of new applications in different areas, such as robotics, where the cost is a fundamental factor that prone the development and commercialization of new consumer applications. This works presents, in one hand, a review of the state of the art of the research and development related with optical flow sensors and, in the other hand, a set of new applications proposed to take full advantage of the characteristics of the sensor. The new applications proposed are: a relative encoder, an absolute encoder, a counterfeit system for the 2€ case, and an accessibility device that tracks the pupil of the user to control pointer displacement in a computer screen. This device has been designed specifically to help people with mobility impairments in the upper extremities that cannot use the computer mouse. In all cases, the experimental results achieved with the different optical flow sensors used in the new applications proposed have validated the utility and versatility of each proposal and the utility and versatility of the design of this optical sensor.