L’objectif de cette recherche est d’étudier la coordination temporelle entre l’organisation de la performance maternelle (chant et gestes des mains), les variations de l’attention visuelle et la vocalisation du bébé à 3 mois et à 6 mois au cours de la ‘chanson-action’ française ‘les marionnettes’. Le terme ‘chanson-action’ désigne des routines interactives associant une ‘mise en scène’ des mains (ici de la mère) coordonnée à un chant pour bébé. Le ‘chanter-bébé’ fait partie des premières stimulations musicales du bébé. Des recherches expérimentales ont mis en évidence qu’il possède plusieurs fonctions et qu’en particulier il maintient l’attention du bébé au cours des échanges. Les ‘chansons-actions’ apparaissent dans le cours des interactions précoces un peu avant le milieu de la première année du bébé. Or des expériences ont montré qu’à cet âge précoce le bébé semble déjà capable de partager son attention entre la mère et un autre centre d’intérêt dans certaines conditions, en particulier lorsque la mère manipule un objet familier. Les ‘chansons-actions’ apparaissent alors comme une situation naturelle permettant d’étudier l’aptitude du bébé à partager son attention. Nous avons donc cherché à tester l’hypothèse centrale selon laquelle l’organisation hiérarchisée de la performance maternelle et en particulier du chant devait fournir un cadre organisant les variations dynamiques de l’attention visuelle du bébé. Nous pensions de plus que l’organisation temporelle de ses vocalisations devait refléter sa sensibilité à cette organisation musicale et qu’il devait vocaliser à des moments saillants de la chanson-action. Nous avons choisi d’étudier les échanges de mêmes dyades à 3 mois et à 6 mois car ces âges sont périphériques à l’émergence spontanée des ‘chansons-actions’ dans le répertoire des routines interactives de la mère et du bébé. Nous voulions ainsi explorer l’évolution de la coordination entre l’organisation temporelle de la performance maternelle et les variations de l’attention du bébé.Nous avons étudié les échanges de 20 dyades à 3 mois (12 dyades ‘mère-garçon’ et 8 dyades ‘mère-fille’) et de 18 de ces mêmes dyades à 6 mois (10 dyades ‘mère-garçon’ et 8 dyades ‘mère-fille’). L’originalité de notre recherche est d’explorer l’évolution dynamique des variations de l’attention du bébé au cours de la chanson-action... / The aim of this study was to analyze the temporal coordination between the organization of the maternal performance (singing and hand gesturing), the visual attention and vocalization of the infant at 3- and 6-months during sequences of the French ‘action-song’ ‘les marionnettes’. The word ‘action-song’ is used to refer to interactive routines that combine hand gestures coordinated with a baby song. Infant-directed singing has been shown to be among the first musical stimulations addressed infants. Experimental studies have demonstrated that it possesses several functions and that one of them is maintaining the infant’s attention. Action-songs emerge in interactions at about 4-months. Experimental studies have proved that the infant exhibits the ability to share her attention between the mother and another object of interest, in particular when it is a familiar object that the mother holds in her hands. Actions-songs appear to be a natural situation that allows us to study this ability. We tested the central hypothesis that the hierarchical levels of maternal singing performance would provide a frame that would organize the dynamic variations of the infant’s visual attention. Moreover the infant would vocalize at specific moments of the musical structure of maternal singing. We studied the exchanges of the same dyads at 3- and 6-months to explore the developmental trajectory of the coordination between the temporal organization of the maternal performance and the infant’s visual attention.We studied the interactions of 20 dyads at 3 months (12 boys and 8 girls) and of 18 of those dyads at 6 months (10 boys and 8 girls). We performed both video and acoustic microanalyses to study the dynamic variations of infant’s attention during the action-song. Thus, each gaze orientation of the infant was associated with a specific element of the maternal singing. Our results showed that maternal singing was articulated at three hierarchical temporal levels (verse, line, pulse) both at 3- and at 6-months. At 3 months the infant’s attention was oriented mainly towards the mother’s face. The variations of the infant’s attention were coordinated with the phrasing of maternal singing and the infant reoriented her attention towards the hands just before the end of the verse. Infants’ vocalizations also occurred at the end of the verse. At 6-months, infants were more attentive to the mother’s hands. Six-month-olds reoriented her attention towards the mother’s face at the end of the verse. Infants’ vocalizations were synchronized with pulse of the maternal singing. Furthermore our results exhibited gender differences at 3- and at 6-months. The performance of mothers of boys was more regular than the performance of mothers of girls. We suggest that actions-songs provide a frame that scaffolds the ability of the infant to share her attention between the mother’s face and hands.

O presente trabalho analisou algumas das possíveis características do efeito da atenção intermodal entre elas: relação sinal/ruído e assincronia entre início dos estímulos (AIE) em relação ao tipo de tarefa realizada. Os Experimentos 1 e 2 mostraram que os efeitos da atenção intermodal se manifestam na presença de ruído visual externo, e que não se manifestam na ausência de ruído em uma AIE de 133 ms. No entanto, o Experimento 3 mostrou que quando a AIE é maior que a utilizada nos experimentos anteriores, o efeito intermodal se manifesta no comportamento na ausência de ruído visual externo. Finalmente, o Experimento 4 mostrou que em uma AIE curta (133 ms), e em uma tarefa de localização, o efeito intermodal se manifesta. Os resultados sugerem que o efeito atencional intermodal se manifesta na presença e na ausência de ruído visual e que o mecanismo de discriminação da frequência do alvo demora mais tempo para se completar do que o mecanismo de localização do alvo. / The current work examined the possible contribution of signal to noise ratio, the asynchrony between the onsets of the cue and the target (SOA) and the kind of task performed by the observer to the manifestation of crossmodal attentional effects. The Experiments 1 and 2 showed that crossmodal attentional effect appears when there is visual noise, but it does not appear when there is no visual noise at 133 ms SOA. The Experiment 3 showed that when the SOA is longer than 133 ms, the crossmodal attentional effect appears when there is no visual noise. The Experiment 4 showed that in a localization task, the crossmodal attentional effect appears even in a short SOA (133 ms). Taken together, the results indicate that crossmodal attentional effects appear when there is visual noise and when there is no visual noise. However, in the later condition and when the target has to be identified, the crossmodal attentional effect takes longer to appear.

Visual attention is a process by which the Human Visual System (HVS) selects most important information from a scene. Visual attention models are computational or mathematical models developed to predict this information. The performance of the state-of-the-art visual attention models is limited in terms of prediction accuracy and computational complexity. In spite of significant amount of active research in this area, modelling visual attention is still an open research challenge. This thesis proposes a novel computational model of visual attention that achieves higher prediction accuracy with low computational complexity. A new bottom-up visual attention model based on in-focus regions is proposed. To develop the model, an image dataset is created by capturing images with in-focus and out-of-focus regions. The Discrete Cosine Transform (DCT) spectrum of these images is investigated qualitatively and quantitatively to discover the key frequency coefficients that correspond to the in-focus regions. The model detects these key coefficients by formulating a novel relation between the in-focus and out-of-focus regions in the frequency domain. These frequency coefficients are used to detect the salient in-focus regions. The simulation results show that this attention model achieves good prediction accuracy with low complexity. The prediction accuracy of the proposed in-focus visual attention model is further improved by incorporating sensitivity of the HVS towards the image centre and the human faces. Moreover, the computational complexity is further reduced by using Integer Cosine Transform (ICT). The model is parameter tuned using the hill climbing approach to optimise the accuracy. The performance has been analysed qualitatively and quantitatively using two large image datasets with eye tracking fixation ground truth. The results show that the model achieves higher prediction accuracy with a lower computational complexity compared to the state-of-the-art visual attention models. The proposed model is useful in predicting human fixations in computationally constrained environments. Mainly it is useful in applications such as perceptual video coding, image quality assessment, object recognition and image segmentation.

Nós realizamos três experimentos para estudar a distribuição da atenção pelo campo visual e a possibilidade dos recursos atentivos serem mais concentrados no interior de uma área delimitada por uma figura geométrica de aparecimento abrupto. Os participantes realizaram uma tarefa de julgamento de ordem temporal (JOT), na qual julgaram a ordem de duas letras apresentadas em seqüência. Uma letra foi apresentada dentro e a outra fora de uma moldura, que não foi relacionada com a tarefa. A percepção de ordem temporal foi influenciada pela moldura nos três experimentos. A variação da distância entre as duas letras e o tempo de exposição da moldura foram manipulados, alterando o julgamento dos participantes. Os resultados demonstraram uma variação na concentração dos recursos atentivos em função da distância entre as duas letras e em função do tempo de exposição da moldura. Os resultados sugerem que a forma de uma figura geométrica pode produzir uma reorganização dos recursos atentivos, que parecem estar mais concentrados dentro do que fora das suas bordas. / We conducted three experiments to examine the distribution of visual attention and the possibility of the attentional resources to be concentrated along an area delimited by a frame of abrupt onset. The participants performed a temporal order judgment (TOJ) task, in which judged the order of two letters presented in sequence. One letter was showed inside and other outside a frame that was not related to the task. Perception of temporal order was influenced by the frame in all experimental conditions. The judgement of participants was affected by the distance between the two letters and the cue lead time. The findings suggest that the form of a geometric figure can reallocate the resources of attention that should be more concentrated inside than outside of its borders.

Pelo menos uma parte do ambiente no qual uma resposta produz uma consequência ganha controle sobre a resposta. Geralmente, a parte que ganha o controle correlaciona com a consequência. Partes não correlacionadas podem dificultar ou facilitar a aquisição do controle por as partes correlacionadas e até mesmo ganhar controle por si mesmas. Esta tese trata sobre o papel que partes do ambiente não correlacionadas com a consequência têm no estabelecimento de controle de estímulos. O capítulo 1 é uma revisão sobre o estabelecimento de controle com ênfase nas propriedades do ambiente. O Capítulo 2 descreve dois experimentos que avaliaram controle por porções do ambiente não correlacionadas com a consequência. Experimentos anteriores com uma tarefa de reconhecimento sugeriram controle por partes de estímulos com forma humana não correlacionadas com a consequência. Os resultados do Experimento 2 mostraram com uma tarefa operante que o teste de reconhecimento mede controle por aspectos do ambiente não correlacionadas com a consequência e que o controle de porções não correlacionadas podem dificultar ou até impedir o controle pelas partes correlacionadas. O Capítulo 3 descreve três experimentos que avaliaram a influência da forma dos estímulos no controle por estímulos não correlacionadas. Os resultados mostraram que porções não correlacionadas de estímulos em formato humano tinham uma chance maior de controlar o responder do que estímulos com os mesmos componentes em formato não-humano. O capítulo 4 descreve três experimentos que avaliaram controle por porções do ambiente não correlacionadas com a consequência com cruzes formadas por quadrados que tinham contato uns aos outros ou que tinham uma pequena distância entre eles. Os resultados mostraram que partes dos estímulos formados por quadrados desconectados ganhou controle sobre a responder, mas não ganharam controle quando as cruzes estavam formadas por estímulos unidos / At least part of the environment in which a response produces a consequence always gains control over the response. As a rule, the portion that gains control correlates with the consequence. Uncorrelated portions may hinder or facilitate the acquisition of control by the correlated ones and even gain control by themselves. The present dissertation deals with the role that portions of the environment uncorrelated with the consequence play on the establishment of stimulus control. Chapter 1 is a review on the establishment of control with emphases on the properties of the environment. Chapter 2 describes two experiments that evaluated control by portions of the environment uncorrelated with the consequence. Previous experiments with a recognition task suggested control over responding by portions of human-like stimuli uncorrelated with the consequence. Results from Experiment 2 demonstrated with an operant task that the recognition task measures control by aspects of the environment uncorrelated with the consequence and that control by uncorrelated portions of the stimuli may hinder or prevent control by the correlated portions. Chapter 3 describes three experiments that evaluated the influence of the stimulis shape on the acquisition of control by uncorrelated features. Results showed that uncorrelated portions of stimuli in human format had a greater chance of gaining control over responding than stimuli with the same components in nonhuman format. Chapter 4 describe two experiments that evaluated control by portions of the environment uncorrelated with the consequence with crosses formed by squares that touched each other or that had a small distance between them. Results showed that portions of the stimuli formed by disconnected squares gained control over responding, but they did not gain control when the crosses were formed by united stimuli

Pelo menos uma parte do ambiente no qual uma resposta produz uma consequência ganha controle sobre a resposta. Geralmente, a parte que ganha o controle correlaciona com a consequência. Partes não correlacionadas podem dificultar ou facilitar a aquisição do controle por as partes correlacionadas e até mesmo ganhar controle por si mesmas. Esta tese trata sobre o papel que partes do ambiente não correlacionadas com a consequência têm no estabelecimento de controle de estímulos. O capítulo 1 é uma revisão sobre o estabelecimento de controle com ênfase nas propriedades do ambiente. O Capítulo 2 descreve dois experimentos que avaliaram controle por porções do ambiente não correlacionadas com a consequência. Experimentos anteriores com uma tarefa de reconhecimento sugeriram controle por partes de estímulos com forma humana não correlacionadas com a consequência. Os resultados do Experimento 2 mostraram com uma tarefa operante que o teste de reconhecimento mede controle por aspectos do ambiente não correlacionadas com a consequência e que o controle de porções não correlacionadas podem dificultar ou até impedir o controle pelas partes correlacionadas. O Capítulo 3 descreve três experimentos que avaliaram a influência da forma dos estímulos no controle por estímulos não correlacionadas. Os resultados mostraram que porções não correlacionadas de estímulos em formato humano tinham uma chance maior de controlar o responder do que estímulos com os mesmos componentes em formato não-humano. O capítulo 4 descreve três experimentos que avaliaram controle por porções do ambiente não correlacionadas com a consequência com cruzes formadas por quadrados que tinham contato uns aos outros ou que tinham uma pequena distância entre eles. Os resultados mostraram que partes dos estímulos formados por quadrados desconectados ganhou controle sobre a responder, mas não ganharam controle quando as cruzes estavam formadas por estímulos unidos / At least part of the environment in which a response produces a consequence always gains control over the response. As a rule, the portion that gains control correlates with the consequence. Uncorrelated portions may hinder or facilitate the acquisition of control by the correlated ones and even gain control by themselves. The present dissertation deals with the role that portions of the environment uncorrelated with the consequence play on the establishment of stimulus control. Chapter 1 is a review on the establishment of control with emphases on the properties of the environment. Chapter 2 describes two experiments that evaluated control by portions of the environment uncorrelated with the consequence. Previous experiments with a recognition task suggested control over responding by portions of human-like stimuli uncorrelated with the consequence. Results from Experiment 2 demonstrated with an operant task that the recognition task measures control by aspects of the environment uncorrelated with the consequence and that control by uncorrelated portions of the stimuli may hinder or prevent control by the correlated portions. Chapter 3 describes three experiments that evaluated the influence of the stimulis shape on the acquisition of control by uncorrelated features. Results showed that uncorrelated portions of stimuli in human format had a greater chance of gaining control over responding than stimuli with the same components in nonhuman format. Chapter 4 describe two experiments that evaluated control by portions of the environment uncorrelated with the consequence with crosses formed by squares that touched each other or that had a small distance between them. Results showed that portions of the stimuli formed by disconnected squares gained control over responding, but they did not gain control when the crosses were formed by united stimuli

Investigamos, no Experimento, se o estímulo precedente, que captura a atenção quando existem demarcações, deixa de capturar a atenção na ausência de demarcações por ter seu processamento filtrado precocemente. Além disso, investigamos, nos experimentos 2, 3 e 4, se alterações no fundo da tela, que gerassem maior competição no processamento dos estímulos presentes na cena visual, poderiam levar à captura da atenção, mesmo sem a presença das demarcações classicamente utilizadas. Observamos que quando a intensidade dos estímulos competidores presentes na tela era alta, o estímulo precedente passou a capturar a atenção. Explicamos esse resultado com a hipótese de que as demarcações são importantes por adicionarem ruído ao processamento dos estímulos apresentados, influenciando a representação desses estímulos e, portanto, a possibilidade de um estímulo capturar a atenção. Por fim, no Experimento 5, investigamos se os resultados da tarefa de escolha de local seriam replicados em uma tarefa de discriminação de forma. / In Experiment 1 we investigated if a peripheral stimulus, which is able to capture attention when there are placeholders on the screen, is no longer able to capture attention in the absence of placeholders because is early filtered. In Experimento 2, 3 and 4 we investigated if changes on screen background, which would generate stronger processing competition between stimuli, could lead to attentional capture even in absence of placeholders. Accorging to our results the peripheral stimuli is able to capture attention when competing stimuli of high intensity are presented togueter on screen. Our explanation is that placeholders are important because they add noise to stimuli processing, affecting stimuli representation and, therefore, the probability that a stimulus will capture attention. Lastly, in Experimento 5 we investigated if similar results would be obtained in a form discrimination task.

The human vision system is generally recognized as being superior to all known artificial vision systems. Visual attention, among many processes that are related to human vision, is responsible for identifying relevant regions in a scene for further processing. In most cases, analyzing an entire scene is unnecessary and inevitably time consuming. Hence considering visual attention might be advantageous. A subfield of computer vision where this particular functionality is computationally emulated has been shown to retain high potential in solving real world vision problems effectively. In this monograph, elements of visual attention are explored and algorithms are proposed that exploit such elements in order to enhance image understanding capabilities. Satellite images are given special attention due to their practical relevance, inherent complexity in terms of image contents, and their resolution. Processing such large-size images using visual attention can be very helpful since one can first identify relevant regions and deploy further detailed analysis in those regions only. Bottom-up features, which are directly derived from the scene contents, are at the core of visual attention and help identify salient image regions. In the literature, the use of intensity, orientation and color as dominant features to compute bottom-up attention is ubiquitous. The effects of incorporating an entropy feature on top of the above mentioned ones are also studied. This investigation demonstrates that such integration makes visual attention more sensitive to fine details and hence retains the potential to be exploited in a suitable context. One interesting application of bottom-up attention, which is also examined in this work, is that of image segmentation. Since low salient regions generally correspond to homogenously textured regions in the input image; a model can therefore be learned from a homogenous region and used to group similar textures existing in other image regions. Experimentation demonstrates that the proposed method produces realistic segmentation on satellite images. Top-down attention, on the other hand, is influenced by the observer’s current states such as knowledge, goal, and expectation. It can be exploited to locate target objects depending on various features, and increases search or recognition efficiency by concentrating on the relevant image regions only. This technique is very helpful in processing large images such as satellite images. A novel algorithm for computing top-down attention is proposed which is able to learn and quantify important bottom-up features from a set of training images and enhances such features in a test image in order to localize objects having similar features. An object recognition technique is then deployed that extracts potential target objects from the computed top-down attention map and attempts to recognize them. An object descriptor is formed based on physical appearance and uses both texture and shape information. This combination is shown to be especially useful in the object recognition phase. The proposed texture descriptor is based on Legendre moments computed on local binary patterns, while shape is described using Hu moment invariants. Several tools and techniques such as different types of moments of functions, and combinations of different measures have been applied for the purpose of experimentations. The developed algorithms are generalized, efficient and effective, and have the potential to be deployed for real world problems. A dedicated software testing platform has been designed to facilitate the manipulation of satellite images and support a modular and flexible implementation of computational methods, including various components of visual attention models.

A new framework for simulating the visual attention system in primates is introduced. The proposed architecture is an abstraction of existing approaches influenced by the work of Koch and Ullman, and Tompa. Each stage of the attentional hierarchy is chosen with consideration for both psychophysics and mathematical optimality. A set of attentional operators are derived that act on basic image channels of intensity, hue and orientation to produce maps representing perceptual importance of each image pixel. The development of such operators is realized within the context of a genetic optimization. The model includes the notion of an information domain where feature maps are transformed to a domain that more closely corresponds to the human visual system. A careful analysis of various issues including feature extraction, density estimation and data fusion is presented within the context of the visual attention problem.

A new framework for simulating the visual attention system in primates is introduced. The proposed architecture is an abstraction of existing approaches influenced by the work of Koch and Ullman, and Tompa. Each stage of the attentional hierarchy is chosen with consideration for both psychophysics and mathematical optimality. A set of attentional operators are derived that act on basic image channels of intensity, hue and orientation to produce maps representing perceptual importance of each image pixel. The development of such operators is realized within the context of a genetic optimization. The model includes the notion of an information domain where feature maps are transformed to a domain that more closely corresponds to the human visual system. A careful analysis of various issues including feature extraction, density estimation and data fusion is presented within the context of the visual attention problem.