Honey bee foragers form time memories that enable them to match their foraging activity to the time of day when a particular food source is most productive. Persistent foragers show food-anticipatory activity by making reconnaissance flights to the previously productive food source and may continue to inspect it for several days. In contrast, reticent foragers do not investigate the source but wait for confirmation from returning persistent foragers. To determine how persistent and reticent foragers might contribute to the colony's ability to rapidly reallocate foragers among sources, we trained foragers to collect sucrose from a feeder at a restricted time of day for several days and then observed their behavior for three consecutive days during which the feeder was empty. In two separate trials, video monitoring of the hive entrance during unrewarded test days in parallel with observing reconnaissance visits to the feeder revealed a high level of activity, in both persistent and reticent foragers, thought to be directed at other food sources. This 'extracurricular' activity showed a high degree of temporal overlap with reconnaissance visits to the feeder. In some cases, inspection flights to the unrewarded feeder were made within the same trip to an extracurricular source, indicating that honey bees have the ability to manage at least two different time memories despite coincidence with respect to time of day. The results have major implications for understanding flower fidelity throughout the day, flower constancy within individual foraging excursions, and the sophisticated cognitive management of spatiotemporal memories in honey bees.

Honey bee foragers form time memories that enable them to match their foraging activity to the time of day when a particular food source is most productive. Persistent foragers show food-anticipatory activity by making reconnaissance flights to the previously productive food source and may continue to inspect it for several days. In contrast, reticent foragers do not investigate the source but wait for confirmation from returning persistent foragers. To determine how persistent and reticent foragers might contribute to the colony's ability to rapidly reallocate foragers among sources, we trained foragers to collect sucrose from a feeder at a restricted time of day for several days and then observed their behavior for three consecutive days during which the feeder was empty. In two separate trials, video monitoring of the hive entrance during unrewarded test days in parallel with observing reconnaissance visits to the feeder revealed a high level of activity, in both persistent and reticent foragers, thought to be directed at other food sources. This 'extracurricular' activity showed a high degree of temporal overlap with reconnaissance visits to the feeder. In some cases, inspection flights to the unrewarded feeder were made within the same trip to an extracurricular source, indicating that honey bees have the ability to manage at least two different time memories despite coincidence with respect to time of day. The results have major implications for understanding flower fidelity throughout the day, flower constancy within individual foraging excursions, and the sophisticated cognitive management of spatiotemporal memories in honey bees.

Le système visuel a évolué de manière à prendre en compte les conséquences de nos mouvements sur notre perception. L’évolution nous a particulièrement doté de la capacité à percevoir notre environnement visuel comme stable et continu malgré les importants déplacements de ses projections sur nos rétines à chaque fois que nous déplaçons nos yeux, notre tête ou notre corps. Des études chez l’animal ont récemment montré que dans certaines aires corticales et sous-corticales, impliquées dans le contrôle attentionnel et dans l’élaboration des mouvements oculaires, des neurones sont capables d’anticiper les conséquences des futurs mouvements volontaires des yeux sur leurs entrées visuelles. Ces neurones prédisent ce à quoi ressemblera notre environnement visuel en re-cartographiant la position des objets d’importance à l’endroit qu’ils occuperont après l’exécution d’une saccade. Dans une série d’études, nous avons tout d’abord démontré que cette re- cartographie pouvait être évaluée de manière non invasive chez l’Homme avec de simples cibles en mouvement apparent. En utilisant l’enregistrement des mouvements des yeux combinés à des méthodes psychophysiques, nous avons déterminé la distribution des erreurs de re-cartographie à travers le champ visuel et ainsi découvert que la compensation des saccades oculomotrices se faisait de manière relativement précise. D’autre part, les patterns d’erreurs observés soutiennent un modèle de la constance spatiale basé sur la re-cartographie de pointeurs attentionnels et excluent d’autres modèles issus de la littérature. Par la suite, en utilisant des objets en mouvement continu et l’exécution de saccades au travers de leurs trajectoires, nous avons mis à jour une visualisation directe des processus de re-cartographie. Avec ce nouveau procédé nous avons à nouveau démontré l’existence d’erreurs systématiques de correction pour les saccades, qui s’expliquent par une re-cartographie imprécise de la position attendue des objets en mouvement. Nous avons par la suite étendu notre modèle à d’autres types de mouvements du corps et notamment étudié les contributions de récepteurs sous-corticaux (otoliths et canaux semi-circulaires) dans le maintien de la constance spatiale à travers des mouvements de la tête. Contrairement à des études décrivant une compensation presque parfaite des mouvements de la tête, nous avons observé une rupture de la constance spatiale pour des mouvements de roulis et de translation de la tête. Enfin, nous avons testé cette re-cartographie de la position des objets compensant un déplacement oculaire avec des cibles présentées à la limite du champ visuel, une re-cartographie censée placer la position attendue de l’objet à l’extérieur du champ visuel. Nos résultats suggèrent que les aires visuelles cérébrales impliquées dans ce processus de re-cartographie construisent une représentation globale de l’espace allant au-delà du traditionnel champ visuel. Pour finir, nous avons conduit deux expériences pour déterminer le déploiement de l’attention à travers l’exécution de saccades. Nous avons alors démontré que l’attention capturée par la présentation brève d’un stimuli est re-cartographiée à sa position spatiale correcte après l’exécution d’une saccade, et que cet effet peut être observé avant même l’initiation d’une saccade. L’ensemble de ces résultats démontre le rôle des pointeurs attentionnels dans la gestion du rétablissement des positions d’un objet dans l’espace ainsi que l’apport des mesures comportementales à un champ de recherche initialement restreint à l’électrophysiologie / The visual system has evolved to deal with the consequences of our own movements onour perception. In particular, evolution has given us the ability to perceive our visual world as stableand continuous despite large shift of the image on our retinas when we move our eyes, head orbody. Animal studies have recently shown that in some cortical and sub-cortical areas involved inattention and saccade control, neurons are able to anticipate the consequences of voluntary eyemovements on their visual input. These neurons predict how the world will look like after a saccadeby remapping the location of each attended object to the place it will occupy following a saccade.In a series of studies, we first showed that remapping could be evaluated in a non-invasive fashion in human with simple apparent motion targets. Using eye movement recordingsand psychophysical methods, we evaluated the distribution of remapping errors across the visualfield and found that saccade compensation was fairly accurate. The pattern of errors observedsupport a model of space constancy based on a remapping of attention pointers and excluded otherknown models. Then using targets that moved continuously while a saccade was made across themotion path, we were able to directly visualize the remapping processes. With this novel method wedemonstrated again the existence of systematic errors of correction for the saccade, best explainedby an inaccurate remapping of expected moving target locations. We then extended our model toother body movements, and studied the contribution of sub-cortical receptors (otoliths and semi-circular canals) in the maintenance of space constancy across head movements. Contrary tostudies reporting almost perfect compensations for head movements, we observed breakdowns ofspace constancy for head tilt as well as for head translation. Then, we tested remapping of targetlocations to correct for saccades at the very edge of the visual field, remapping that would place theexpected target location outside the visual field. Our results suggest that visual areas involved inremapping construct a global representation of space extending out beyond the traditional visualfield. Finally, we conducted experiments to determine the allocation of attention across saccades.We demonstrated that the attention captured by a brief transient was remapped to the correctspatial location after the eye movement and that this shift can be observed even before thesaccade.Taken together these results demonstrate the management of attention pointers to therecovery of target locations in space as well as the ability of behavioral measurements to address atopic pioneered by eletrophysiologists.

The need for real-time video analysis is rapidly increasing in today's world. The decreasing cost of powerful processors and the proliferation of affordable cameras, combined with needs for security, methods for searching the growing collection of video data, and an appetite for high-tech entertainment, have produced an environment where video processing is utilized for a wide variety of applications. Tracking is an element in many of these applications, for purposes like detecting anomalous behavior, classifying video clips, and measuring athletic performance. In this dissertation we focus on augmented reality, but the methods and conclusions are applicable to a wide variety of other areas. In particular, our work deals with achieving real-time performance while tracking with augmented reality systems using a minimum set of commercial hardware. We have built prototypes that use both existing technologies and new algorithms we have developed. While performance improvements would be possible with additional hardware, such as multiple cameras or parallel processors, we have concentrated on getting the most performance with the least equipment. Tracking is a broad research area, but an essential component of an augmented reality system. Tracking of some sort is needed to determine the location of scene augmentation. First, we investigated the effects of illumination on the pixel values recorded by a color video camera. We used the results to track a simple solid-colored object in our first augmented reality application. Our second augmented reality application tracks complex non-rigid objects, namely human faces. In the color experiment, we studied the effects of illumination on the color values recorded by a real camera. Human perception is important for many applications, but our focus is on the RGB values available to tracking algorithms. Since the lighting in most environments where video monitoring is done is close to white, (e.g., fluorescent lights in an office, incandescent lights in a home, or direct and indirect sunlight outside,) we looked at the response to "white" light sources as the intensity varied. The red, green, and blue values recorded by the camera can be converted to a number of other color spaces which have been shown to be invariant to various lighting conditions, including view angle, light angle, light intensity, or light color, using models of the physical properties of reflection. Our experiments show how well these derived quantities actually remained constant with real materials, real lights, and real cameras, while still retaining the ability to discriminate between different colors. This color experiment enabled us to find color spaces that were more invariant to changes in illumination intensity than the ones traditionally used. The first augmented reality application tracks a solid colored rectangle and replaces the rectangle with an image, so it appears that the subject is holding a picture instead. Tracking this simple shape is both easy and hard; easy because of the single color and the shape that can be represented by four points or four lines, and hard because there are fewer features available and the color is affected by illumination changes. Many algorithms for tracking fixed shapes do not run in real time or require rich feature sets. We have created a tracking method for simple solid colored objects that uses color and edge information and is fast enough for real-time operation. We also demonstrate a fast deinterlacing method to avoid "tearing" of fast moving edges when recorded by an interlaced camera, and optimization techniques that usually achieved a speedup of about 10 from an implementation that already used optimized image processing library routines. Human faces are complex objects that differ between individuals and undergo non-rigid transformations. Our second augmented reality application detects faces, determines their initial pose, and then tracks changes in real time. The results are displayed as virtual objects overlaid on the real video image. We used existing algorithms for motion detection and face detection. We present a novel method for determining the initial face pose in real time using symmetry. Our face tracking uses existing point tracking methods as well as extensions to Active Appearance Models (AAMs). We also give a new method for integrating detection and tracking data and leveraging the temporal coherence in video data to mitigate the false positive detections. While many face tracking applications assume exactly one face is in the image, our techniques can handle any number of faces. The color experiment along with the two augmented reality applications provide improvements in understanding the effects of illumination intensity changes on recorded colors, as well as better real-time methods for detection and tracking of solid shapes and human faces for augmented reality. These techniques can be applied to other real-time video analysis tasks, such as surveillance and video analysis.

No description available.

No / In this study human color constancy was tested for two-dimensional (2D) and three-dimensional (3D) setups with real objects and lights. Four different illuminant changes, a natural selection task and a wide choice of target colors were used. We found that color constancy was better when the target color was learned as a 3D object in a cue-rich 3D scene than in a 2D setup. This improvement was independent of the target color and the illuminant change. We were not able to find any evidence that frequently experienced illuminant changes are better compensated for than unusual ones. Normalizing individual color constancy hit rates by the corresponding color memory hit rates yields a color constancy index, which is indicative of observers¿ true ability to compensate for illuminant changes.

Yes / PURPOSE. Glaucoma raises contrast detection thresholds, but our natural visual environment is dominated by high contrast that may remain suprathreshold in early to moderate glaucoma. This study investigates the effect of glaucoma on the apparent contrast of visible stimuli. METHODS. Twenty participants with glaucoma with partial visual field defects (mean age, 72 ± 7 years) and 20 age-similar healthy controls (mean age, 70 ± 7 years) took part. Contrast detection thresholds for Gabor stimuli (SD, 0.75°) of four spatial frequencies (0.5, 1.0, 2.0, and 4.0 c/deg) were first measured at 10° eccentricity, both within and outside of visual field defects for participants with glaucoma. Subsequently, the contrast of a central Gabor was matched to that of a peripheral Gabor with contrast fixed at two times or four times the detection threshold. Data were analyzed by linear mixed modelling. RESULTS. Compared with controls, detection thresholds for participants with glaucoma were raised by 0.05 ± 0.025 (Michelson units, ± SE; P = 0.12) and by 0.141 ± 0.026 (P < 0.001) outside and within visual field defects, respectively. For reference stimuli at two times the detection contrast, matched contrast ratios (matched/reference contrast) were 0.16 ± 0.039 (P < 0.001) higher outside compared with within visual field defects in participants with glaucoma. Matched contrast ratios within visual field defects were similar to controls (mean 0.033 ± 0.066 lower; P = 0.87). For reference stimuli at four times the detection contrast, matched contrast ratios were similar across all three groups (P = 0.58). Spatial frequency had a minimal effect on matched contrast ratios. CONCLUSIONS. Despite decreased contrast sensitivity, people with glaucoma perceive the contrast of visible suprathreshold stimuli similarly to healthy controls. These results suggest possible compensation for sensitivity loss in the visual system. / Supported by a College of Optometrists PhD Scholarship. / Research Development Fund Publication Prize Award winner, June 2020

Les buts des recherches présentées dans cette thèse étaient d’évaluer le rôle de la stéréoscopie dans la reconnaissance de forme, dans la perception du relief et dans la constance de forme. La première étude a examiné le rôle de la stéréoscopie dans la perception des formes visuelles en utilisant une tâche de reconnaissance de formes. Les stimuli pouvaient être présentés en 2D, avec disparité normale (3D) ou avec disparité inversée. La performance de reconnaissance était meilleure avec les modes de présentation 2D et 3D qu’avec la 3D inversée. Cela indique que la stéréoscopie contribue à la reconnaissance de forme. La deuxième étude s’est intéressée à la contribution conjointe de l’ombrage et de la stéréoscopie dans la perception du relief des formes. Les stimuli étaient des images d’une forme 3D convexe synthétique présentée sous un point de vue menant à une ambigüité quant à sa convexité. L’illumination pouvait provenir du haut ou du bas et de la gauche ou de la droite, et les stimuli étaient présentés dichoptiquement avec soit de la disparité binoculaire normale, de la disparité inversée ou sans disparité entre les vues. Les participants ont répondu que les formes étaient convexes plus souvent lorsque la lumière provenait du haut que du bas, plus souvent avec la disparité normale qu’en 2D, et plus souvent avec absence de disparité qu’avec disparité inversée. Les effets de direction d’illumination et du mode de présentation étaient additifs, c’est-à-dire qu’ils n’interagissaient pas. Cela indique que l’ombrage et la stéréoscopie contribuent indépendamment à la perception du relief des formes. La troisième étude a évalué la contribution de la stéréoscopie à la constance de forme, et son interaction avec l’expertise perceptuelle. Elle a utilisé trois tâches de discrimination séquentielle de trombones tordus ayant subi des rotations en profondeur. Les stimuli pouvaient être présentés sans stéréoscopie, avec stéréoscopie normale ou avec stéréoscopie inversée. Dans la première moitié de l’Exp. 1, dans laquelle les variations du mode de présentation étaient intra-sujets, les performances étaient meilleures en 3D qu’en 2D et qu’en 3D inversée. Ces effets ont été renversés dans la seconde moitié de l’expérience, et les coûts de rotation sont devenus plus faibles pour la 2D et la 3D inversée que pour la 3D. Dans les Exps. 2 (variations intra-sujets du mode de présentation, avec un changement de stimuli au milieu de l’expérience) et 3 (variations inter-sujets du mode de présentation), les effets de rotation étaient en tout temps plus faibles avec stéréoscopie qu’avec stéréoscopie inversée et qu’en 2D, et plus faibles avec stéréoscopie inversée que sans stéréoscopie. Ces résultats indiquent que la stéréoscopie contribue à la constance de forme. Toutefois, cela demande qu’elle soit valide avec un niveau minimal de consistance, sinon elle devient stratégiquement ignorée. En bref, les trois études présentées dans cette thèse ont permis de montrer que la stéréoscopie contribue à la reconnaissance de forme, à la perception du relief et à la constance de forme. De plus, l’ombrage et la stéréoscopie sont intégrés linéairement. / The goals of the researches presented in this thesis were to evaluate the role of stereopsis in shape recognition, in relief perception, and in shape constancy. The first study examined the role of stereopsis in visual shape perception using a recognition task. The stimuli were presented with null binocular disparity (i.e. 2D), normal binocular disparity (3D) or reversed disparity. Recognition performance was better with 2D and 3D displays than with reversed 3D. This indicates that stereopsis contributes to shape recognition. The second study examined the joint contribution of shading and stereopsis to the relief perception of shape. The stimuli were the images of a synthetic convex 3D shape seen from viewpoints leading to ambiguity as to its convexity. Illumination either came from above, or below and from the right or the left, and stimuli were presented dichoptically with either normal binocular disparity, reversed disparity, or no disparity between the views presented at each eye. Participants responded “convex” more often when the lighting came from above than from below. Also, participants responded that the shape was convex more often with normal than with zero disparity, and more often with 2D than with reversed stereopsis. The effects of lighting direction and display mode were additive; i.e. they did not interact. This indicates that shading and stereopsis contribute independently to shape perception. The third study assessed the contribution of stereopsis to shape constancy and how it interacts with perceptual expertise using three sequential matching tasks with bent paperclips rotated in depth. Stimuli were presented without stereopsis, or with normal or reversed stereopsis. In the first half of Exp. 1, where display mode variations were within-subject, the performances were better with stereoscopic displays than with 2D or reversed stereoscopic presentations. In the second half of the experiment, the rotation costs became weaker for the 2D and reversed 3D display modes than for the 3D one. In Exps. 2 (display mode within-subject, with stimuli switched halfway into the experiment) and 3, (display mode between-subjects) the rotation effect was consistently weaker with normal stereo than with either 2D or reversed stereoscopic displays. These experiments also demonstrate an advantage of reversed stereo over 2D presentations. This indicates that stereo may contribute to shape constancy. This, however, requires stereoscopic information to be valid with a minimal degree of consistency. Otherwise, stereo may become strategically ignored. In a nutshell, the three studies presented in this thesis showed that stereo contributes to shape recognition, relief perception and shape constancy. Furthermore stereopsis and shading are integrated independently.

Cette thèse vise à mettre en lumière, dans les Essais de Montaigne, un aspect peu connu du débat sur la constance à la fin du 16ème s. Alors que la vertu de constance devient un enjeu philosophique et moral d’importance, servant à la fois des idéaux stoïciens, chrétiens et civils, nous constatons une insistance des Essais à souligner le phénomène contraire, l’inconstance. Il s’agit dans un premier temps de montrer le dialogue que construit Montaigne face à la vertu de constance, puis d’établir le statut argumentatif de l’inconstance dans les Essais. Dans le but de situer le débat constance - inconstance, nous nous rapportons d’abord aux écoles de philosophies hellénistiques que pillent les Essais. Le scepticisme de Montaigne s’en trouve déstabilisé, le stoïcisme à la fois débattu et repoussé, l’épicurisme instrumentalisé. L’inconstance prend un visage universel qui rend présomptueuse et même dangereuse toute aspiration à la constance. Nous montrons ensuite la prise en charge méthodologique de l’inconstance dans les Essais, à travers le Distingo. Nous constatons alors que l’inconstance a le statut d’une condition pré éthique poussant les Essais à déconsidérer toute entreprise humaine dans la sphère publique. Mais les Essais n’encouragent pas simplement à se laisser porter par la fortune ou la coutume. Dans la sphère privée, Ils construisent plusieurs règles éthiques hétérodoxes : non repentir, diversion, vanité, expérience…qui reposent sur le possible (selon qu’on peut) et contribuent à redéfinir la grandeur d’âme, en présentant un nouvel ordre ou une nouvelle conformité de l’action, ce que nous appellerons « l’éthique de l’inconstance » ou « éthique de l’indirection » . / This thesis aims to emphasize in Montaigne’s Essays a little known aspect concerning the debate of constancy towards the end of the 16th. c. While the virtue of constancy becomes a philosophical issue of importance, favouring at the same time the stoic, Christian and civil ideals, we observe in Montaigne’s Essays, an insistence to underline a contradictory phenomenon; inconstancy. First, it is essential to demonstrate the dialogue that builds Montaigne’s work concerning the virtue of constancy, to finally establish the proper argumentation on inconstancy. With the intent to situate this debate concerning the virtue of constancy, we will refer primarily to the Hellenistic philosophies plundered by the Essays. We will present in the first part the origin and in the second part, the transfer of the debate. Montaigne’s scepticism happens to be destabilized, his stoicism is at the same time debated and rejected, his Epicureanism becoming a tool determining their truth. The second section of the thesis demonstrates that methodology of the Essays takes over the notion of inconstancy, notably through the “Distingo”, and its effects on the historical knowledge relating to prudential activities. We claim that the nature of the essay is to correct this error and thus give the right place to human inconstancy. We acknowledge the fact that inconstancy has a status of a pre-ethic condition which pushes the Essays to disrepute any human enterprise in the public sphere. However, this denial cast upon the public sphere does not lead us to reject any kind of ethical reflection. In the private sphere, the Essays construct ethical regulations: non repentance, diversion, vanity, experience...These aspects are all grounded in the ethical mode of the possible, (« Selon qu’on peut ») and at the same time contribute in redefining the magnitude of the soul by presenting a new order or a new conformity of action. We name the project ethic of inconstancy or ethic of indirection

The networks of surveillance cameras installed in public places and private territories continuously record video data with the aim of detecting and preventing unlawful activities. This enhances the importance of video content analysis applications, either for real time (i.e. analytic) or post-event (i.e. forensic) analysis. In this thesis, the primary focus is on four key aspects of video content analysis, namely; 1. Moving object detection and recognition, 2. Correction of colours in the video frames and recognition of colours of moving objects, 3. Make and model recognition of vehicles and identification of their type, 4. Detection and recognition of text information in outdoor scenes. To address the first issue, a framework is presented in the first part of the thesis that efficiently detects and recognizes moving objects in videos. The framework targets the problem of object detection in the presence of complex background. The object detection part of the framework relies on background modelling technique and a novel post processing step where the contours of the foreground regions (i.e. moving object) are refined by the classification of edge segments as belonging either to the background or to the foreground region. Further, a novel feature descriptor is devised for the classification of moving objects into humans, vehicles and background. The proposed feature descriptor captures the texture information present in the silhouette of foreground objects. To address the second issue, a framework for the correction and recognition of true colours of objects in videos is presented with novel noise reduction, colour enhancement and colour recognition stages. The colour recognition stage makes use of temporal information to reliably recognize the true colours of moving objects in multiple frames. The proposed framework is specifically designed to perform robustly on videos that have poor quality because of surrounding illumination, camera sensor imperfection and artefacts due to high compression. In the third part of the thesis, a framework for vehicle make and model recognition and type identification is presented. As a part of this work, a novel feature representation technique for distinctive representation of vehicle images has emerged. The feature representation technique uses dense feature description and mid-level feature encoding scheme to capture the texture in the frontal view of the vehicles. The proposed method is insensitive to minor in-plane rotation and skew within the image. The capability of the proposed framework can be enhanced to any number of vehicle classes without re-training. Another important contribution of this work is the publication of a comprehensive up to date dataset of vehicle images to support future research in this domain. The problem of text detection and recognition in images is addressed in the last part of the thesis. A novel technique is proposed that exploits the colour information in the image for the identification of text regions. Apart from detection, the colour information is also used to segment characters from the words. The recognition of identified characters is performed using shape features and supervised learning. Finally, a lexicon based alignment procedure is adopted to finalize the recognition of strings present in word images. Extensive experiments have been conducted on benchmark datasets to analyse the performance of proposed algorithms. The results show that the proposed moving object detection and recognition technique superseded well-know baseline techniques. The proposed framework for the correction and recognition of object colours in video frames achieved all the aforementioned goals. The performance analysis of the vehicle make and model recognition framework on multiple datasets has shown the strength and reliability of the technique when used within various scenarios. Finally, the experimental results for the text detection and recognition framework on benchmark datasets have revealed the potential of the proposed scheme for accurate detection and recognition of text in the wild.