La fovéa est la seule zone de la rétine où l’acuité visuelle est maximale. Les mécanismes qui visent à déterminer à quels endroits vont avoir lieu les prochaines fixations restent débattus. Certains auteurs suggèrent que les yeux sont principalement attirés par les zones les plus saillantes de la scène. D’autres suggèrent qu’ils sont orientés vers les objets. Les propriétés du système oculomoteur contraignent également les mouvements oculaires. L’objectif de cette thèse était de départager ces différents points de vue en examinant la contribution respective et le décours temporel des facteurs visuo-moteurs de bas niveau et des facteurs cognitifs de plus haut niveau dans la détermination des mouvements oculaires. Nous nous sommes focalisés sur trois phénomènes comportementaux clés : la tendance à bouger les yeux à proximité du centre des objets (Prefered-Viewing Location), les répercussions qu’ont ces positions d’atterrissage sur les durées initiales des fixations (Inverted Optimal-Viewing-Position) et les probabilités de refixation (Optimal-Viewing-Position). Nous avons observé que ces trois effets émergeaient, et ce, quel que soit le type de stimulus testé: des objets, des mots ou des objets sans signification. Cela suggère que ces effets reflètent les propriétés de bas niveau des systèmes visuel et oculomoteur. Par ailleurs, nous avons observé que l’endroit où les yeux atterrissaient au sein de l’objet était également influencé au fil du temps par les traitements de plus haut-niveau des propriétés du stimulus. Les saccades initiées plus tardivement atterrissaient plus proches de la zone la plus informative de l’objet. / High-quality vision is restricted to the fovea - a small region at the center of gaze. The mechanisms that determine which locations in a scene are selected for fixation remain debated. Some suggest that eye movements are mainly driven by the salient features in a scene. Others suggest that eye guidance is object based. The properties of the oculomotor system also strongly constrain eye behavior, but these have been neglected in most existing models. The purpose of this thesis was to disentangle between these different views, by investigating how low-level visuomotor factors versus higher-level cognitive factors contribute to eye movements towards and within isolated objects, and with which time course. We focused on three viewing-position effects: the tendency to move the eyes near the centers of objects (the PVL effect), and the repercussions these initial landing positions have on initial fixation durations (the I-OVP effect) and refixation probabilities (the OVP effect). We found that these three viewing-position effects emerged, and were comparable, in all stimulus types that we tested in this thesis: objects, words and even meaningless non-objects. This suggests that the effects reflect low-level properties of the visual and oculomotor systems. Furthermore, we found that where the eye moved within objects became influenced by ongoing processing of higher-level stimulus properties (e.g., object affordances) over time. Later- compared to early-triggered initial saccades, and even more so within-object refixations, were biased towards the most informative part of the objects, and away from their center of gravity.

The electro-oculogram (EOG) is the most widely used technique for recording eye movements in clinical settings. It is inexpensive, practical, and non-invasive. Use of EOG is usually restricted to horizontal recordings as vertical EOG contains eyelid artefact (Oster & Stern, 1980) and blinks. The ability to analyse two dimensional (2D) eye movements may provide additional diagnostic information on pathologies, and further insights into the nature of brain functioning. Simultaneous recording of both horizontal and vertical EOG also introduces other difficulties into calibration of the eye movements, such as different gains in the two signals, and misalignment of electrodes producing crosstalk. These transformations of the signals create problems in relating the two dimensional EOG to actual rotations of the eyes. The application of an artificial neural network (ANN) that could map 2D recordings into 2D eye positions would overcome this problem and improve the utility of EOG. To determine whether ANNs are capable of correctly calibrating the saccadic eye movement data from 2D EOG (i.e. performing the necessary inverse transformation), the ANNs were first tested on data generated from mathematical models of saccadic eye movements. Multi-layer perceptrons (MLPs) with non-linear activation functions and trained with back propagation proved to be capable of calibrating simulated EOG data to a mean accuracy of 0.33° of visual angle (SE = 0.01). Linear perceptrons (LPs) were only nearly half as accurate. For five subjects performing a saccadic eye movement task in the upper right quadrant of the visual field, the mean accuracy provided by the MLPs was 1.07° of visual angle (SE = 0.01) for EOG data, and 0.95° of visual angle (SE = 0.03) for infrared limbus reflection (IRIS®) data. MLPs enabled calibration of 2D saccadic EOG to an accuracy not significantly different to that obtained with the infrared limbus tracking data.

Sakkadische Blickbewegungen sind die häufigsten und schnellsten aller menschlichen Bewegungen und führen zur wiederholtem und rapiden Verschiebung von Objektprojektionen über die Retina. Entgegen der verbreiteten Annahme der Suppression untersucht diese Arbeit Ausmaß und Funktion intrasakkadischer visueller Wahrnehmung. Studie I beschreibt eine individuell gefertigte LED-Installation zur ausschließlich intrasakkadischen Präsentation von Text und Bildern, während Studie II einen Algorithmus zur Detektion von Sakkaden vorstellt, welcher blickkontingente Stimulusmanipulationen mithilfe eines DLP Projektionssystems mit einer Bildwiederholungsrate von 1440 Hz ermöglicht. Studien III und IV untersuchten ob visuelle Bewegungsspuren (sog. motion streaks), welche durch die schnelle Bewegung von Objekten über die Retina erzeugt werden, Korrespondenz zwischen Objekten über Sakkaden hinweg herstellen könnten. Diese Bewegungsspuren erlaubten Versuchsteilnehmern nicht nur einen präsakkadischen Stimulus aus zwei identischen postsakkadischen Stimuli zu identifizieren, während diese Fähigkeit von der Deutlichkeit der Bewegungsspur abhing, sondern auch Korrektursakkaden zu einem ursprünglichen präsakkadischen Stimulus zu erleichtern, falls dieser während der Sakkade versetzt wurde. Studie V untersuchte die subjektive Wahrnehmung und Lokalisierung von intrasakkadischen Bewegungsspuren, indem Teilnehmer gezeichnete Berichte angaben. Die Modellierung letzterer ergab, dass retinale Positionssignale mit einer zeitlich gedämpften mentalen Repräsentation von Augenposition kombiniert wurden, um eine Lokalisation in weltzentrierten Koordinaten zu ermöglichen. Diese Ergebnisse legen nahe, dass intrasakkadische visuelle Signale einen Einfluss auf transsakkadische perzeptuelle und motorische Prozesse haben könnten. Letztlich werden die mögliche Funktionen intrasakkadischer Wahrnehmung, sowie Möglichkeiten für zukünftige wissenschaftliche Untersuchungen, diskutiert. / Rapid eye movements, so-called saccades, are the fastest and most frequent human movements and cause projections of objects in the world to constantly shift across the retina at high velocities, thereby producing large amounts of motion blur. In contrast to accounts of saccadic suppression, this work explores the extent and potential functional role of intra-saccadic perception. As saccades are fast and brief events, technical challenges were addressed. Study I describes a custom LED-based anorthoscopic presentation setup capable of displaying text and images strictly during saccades. In study II, a novel online saccade detection algorithm enabled rapid, gaze-contingent display changes using a DLP projection system running at 1440 fps. Studies III and IV investigated whether intra-saccadic motion streaks, i.e., blurred traces routinely induced by stimuli moving at saccadic speeds, could serve as cues to establishing object correspondence across saccades. Motion streaks not only enabled perceptual matching of pre- and post-saccadic object locations, while performance depended strongly on streak efficiency, but also facilitated gaze correction in response to intra-saccadic target displacements, that was previously found to be mainly driven by objects’ surface features. Finally, study V explored the subjective appearance and localization of intra-saccadic motion streaks, tasking observers to reproduce their trajectories. Computational modeling of resulting response patterns suggested that retinal positions over time were combined with a damped eye position signal to readily localize intra-saccadic input in world-centered coordinates. Taken together, these results invite the intriguing hypothesis that intra-saccadic visual signals are not discarded from processing and might affect trans-saccadic perceptual and motor processes. The potential role of intra-saccadic perception for active vision, as well as directions for future research, are discussed.

No description available.

Les fondements théoriques pour la saillance visuelle ont été dressés, il y a 35 ans, par Treisman qui a proposé "feature-integration theory" pour le système visuel humain: dans n’importe quel contenu visuel, certaines régions sont saillantes en raison de la différence entre leurs caractéristiques (intensité, couleur, texture, et mouvement) et leur voisinage. Notre thèse offre un cadre méthodologique et expérimental compréhensif pour extraire les régions saillantes directement des flux compressés (MPEG-4 AVC et HEVC), tout en minimisant les opérations de décodage. L’extraction de la saillance visuelle à partir du flux compressé est à priori une contradiction conceptuelle. D’une part, comme suggéré par Treisman, dans un contenu vidéo, la saillance est donnée par des singularités visuelles. D’autre part, afin d’éliminer la redondance visuelle, les flux compressés ne devraient plus préserver des singularités. La thèse souligne également l’avantage pratique de l’extraction de la saillance dans le domaine compressé. Dans ce cas, nous avons démontré que, intégrée dans une application de tatouage robuste de la vidéo compressée, la carte saillance agit comme un outil d’optimisation, ce qui permet d’augmenter la transparence (pour une quantité d’informations insérées et une robustesse contre les attaques prescrites) tout en diminuant la complexité globale du calcul. On peut conclure que la thèse démontre aussi bien méthodologiquement que expérimentalement que même si les normes MPEG-4 AVC et HEVC ne dépendent pas explicitement d’aucun principe de saillance visuelle, leurs flux préservent cette propriété remarquable reliant la représentation numérique de la vidéo au mécanisme psycho-cognitifs humains / The theoretical ground for visual saliency was established some 35 years ago by Treisman who advanced the integration theory for the human visual system: in any visual content, some regions are salient (appealing) because of the discrepancy between their features (intensity, color, texture, motion) and the features of their surrounding areas. This present thesis offers a comprehensive methodological and experimental framework for extracting the salient regions directly from video compressed streams (namely MPEG-4 AVC and HEVC), with minimal decoding operations. Note that saliency extraction from compressed domain is a priori a conceptual contradiction. On the one hand, as suggested by Treisman, saliency is given by visual singularities in the video content. On the other hand, in order to eliminate the visual redundancy, the compressed streams are no longer expected to feature singularities. The thesis also brings to light the practical benefit of the compressed domain saliency extraction. In this respect, the case of robust video watermarking is targeted and it is demonstrated that the saliency acts as an optimization tool, allowing the transparency to be increased (for prescribed quantity of inserted information and robustness against attacks) while decreasing the overall computational complexity. As an overall conclusion, the thesis methodologically and experimentally demonstrates that although the MPEG-4 AVC and the HEVC standards do not explicitly rely on any visual saliency principle, their stream syntax elements preserve this remarkable property linking the digital representation of the video to sophisticated psycho-cognitive mechanisms

No description available.