Il existe aujourd’hui un large consensus sur le fait que le système cognitif est capabled’avoir des activités sur lui-même, on parle de métacognition. Si plusieurs travaux se sontintéressés aux mécanismes qui sous-tendent cette métacognition, à notre connaissance,aucun ne l’a fait dans une perspective « sensorimotrice et intégrative » du fonctionne-ment cognitif comme celle que nous proposons. Ainsi, la thèse que nous défendons dansce travail est la suivante : l’information métacognitive, notamment la fluence, possèdestrictement le même statut que l’information cognitive (i.e., sensorielle et motrice). Dansun premier chapitre, nous proposons un modèle de la cognition respectant ce principe.Ensuite, dans les deux chapitres suivants, nous mettons à l’épreuve notre hypothèse parle biais d’expériences et de simulations effectuées à l’aide du modèle mathématique quenous avons élaboré. Ces travaux ont porté plus précisément sur des phénomènes liés à troispossibilités originales prédites par notre hypothèse : la possibilité de méta-métacognition,la possibilité d’intégration entre information sensorielle et information métacognitive, etla possibilité d’abstraction métacognitive. / There is today a broad consensus that the cognitive system is capable of having acti-vities on itself, we are talking about metacognition. Although several studies have focusedon the mechanisms underlying this metacognition, to our knowledge, none has done so ina "sensorimotor and integrative" perspective of cognitive functioning such as the one wepropose. Thus, the thesis we defend in this work is the following : metacognitive infor-mation, especially fluency, has strictly the same status as any cognitive information (i.e.,sensory and motor). In a first chapter, we propose a model of cognition respecting thisprinciple. Then, in the next two chapters, we test our hypothesis through experimentsand simulations using the mathematical model we have developed. This work focusedmore specifically on phenomena related to three original possibilities predicted by ourhypothesis : the possibility of meta-metacognition, the possibility of integration betweensensory information and metacognitive information, and the possibility of metacognitiveabstraction.

Syftet med denna forskning genom design och kvalitativa undersökning är att skapa en audiovisuell installation vilket mäts av en fokusgrupp för att se om fenomenet Immersion uppnås hos informanterna. Det är informanternas kollektiva och subjektiva upplevelse av installationen som ligger till grund för studiens resultat och berör frågor inom det audiovisuella området. Installationen undersöks i förhållande till rummet den tar plats i som en viktigt påverkande aspekt. Studien ska ses på som ett förslag för hur fenomenet Immersion kan uppnås genom audiovisuella verktyg. Alltså är detta en studie som inte försöker nå en absolut sanning genom undersökningen utan olika resultat kan nås även om genomförandet av installationen skulle försökas återskapas. Resultaten tyder på att Installationen kändes Immersiv och nåddes genom projektionskonstformen och spatialt 3D ljud. Samt att andra aspekter och egenskaper som att installationens fysiska form, vilket bestod av genomskinligt tyg som omringade informanterna, påverkade deras Immersion positivt genom att avskärma deras perception. Det presenteras även andra aspekter och egenskaper som påverkade informanternas upplevelse av Immersion positivt men även resultat som påverkade upplevelsen negativt, vilket är lika viktigt för vidare forskning och som bidrag till det kunskapsområdet. Styrkan i undersökningen är presentationen av installationens genomförande men framförallt resultatet som bidrar med förståelse och perspektiv till ett svårformulerat intresseområde. Svagheten ligger i och med att fokusgruppdiskussioner och kvalitativa underökningar inte går att generaliseras, samt så är validiteten svår att styrka. Ytterligare en svaghet är att bara en fokusgrupp användes för studiens undersökning vilket gör det svårt att säkerställa resultatets giltighet.

The research conducted in ‘The Internal podcast’ aims to answer how podcast could be used for internal communication in organizations and what its weakness and strength is. The study has gathered theories such as storytelling, affordance and sensemaking and combined them into a unique framework for this study. Based on multimodal analysis we have studied three podcasts content and content design to help answer the questions of the study. The three podcasts: Kackellackan, Fast forward and Radio Samhall all have their coworkers as the primary target group. From these podcasts the study analyzed at a total of 60 episodes (20 from each podcast). The results showed that all three podcasts have different content design that suggests multiple possibilities for organizations to form the content for their own needs. Because of its intimate and close character, it also suggests a usefulness for sensemaking in organizational changes. But one of the weaknesses that the result pointed at is the lack of interaction between producer and listener, because one key part in empowerment is the possibility for feedback.

Denna uppsats undersöker hur diskurser om kropp och skönhet tar sig uttryck i SVT:s tvprogram Kroppshets, samt genom vilka språkliga och visuella element kritiken mot rådande kroppsideal förmedlas i programmet. Intresset har bakgrund i fenomenet kroppsaktivism som har vuxit fram på nätet som motreaktion till kroppshets och kroppsångest. Det saknas kunskap kring hur fenomenet tar sig uttryck i television, och i synnerhet svensk television. Med utgångspunkt i feministisk medieteori och Erving Goffmans teorier om sjalvpresentation görs därför en multimodal kritisk diskursanalys på seriens första avsnitt. Resultatet visar att kroppsdiskursen till störst del tar sig uttryck genom uttrycklig ångest, ilska och negativ kroppsuppfattning. Diskurser om kroppen som instrument dominerar också det språkliga innehållet. Hela avsnittet genomsyras av en dualitet: å ena sidan synliggör den kroppar utanför normerna, å andra finns beaktandet av kvinnokroppen fortfarande kvar.

abstract: Multimodal Representation Learning is a multi-disciplinary research field which aims to integrate information from multiple communicative modalities in a meaningful manner to help solve some downstream task. These modalities can be visual, acoustic, linguistic, haptic etc. The interpretation of ’meaningful integration of information from different modalities’ remains modality and task dependent. The downstream task can range from understanding one modality in the presence of information from other modalities, to that of translating input from one modality to another. In this thesis the utility of multimodal representation learning for understanding one modality vis-à-vis Image Understanding for Visual Reasoning given corresponding information in other modalities, as well as translating from one modality to the other, specifically, Text to Image Translation was investigated. Visual Reasoning has been an active area of research in computer vision. It encompasses advanced image processing and artificial intelligence techniques to locate, characterize and recognize objects, regions and their attributes in the image in order to comprehend the image itself. One way of building a visual reasoning system is to ask the system to answer questions about the image that requires attribute identification, counting, comparison, multi-step attention, and reasoning. An intelligent system is thought to have a proper grasp of the image if it can answer said questions correctly and provide a valid reasoning for the given answers. In this work how a system can be built by learning a multimodal representation between the stated image and the questions was investigated. Also, how background knowledge, specifically scene-graph information, if available, can be incorporated into existing image understanding models was demonstrated. Multimodal learning provides an intuitive way of learning a joint representation between different modalities. Such a joint representation can be used to translate from one modality to the other. It also gives way to learning a shared representation between these varied modalities and allows to provide meaning to what this shared representation should capture. In this work, using the surrogate task of text to image translation, neural network based architectures to learn a shared representation between these two modalities was investigated. Also, the ability that such a shared representation is capable of capturing parts of different modalities that are equivalent in some sense is proposed. Specifically, given an image and a semantic description of certain objects present in the image, a shared representation between the text and the image modality capable of capturing parts of the image being mentioned in the text was demonstrated. Such a capability was showcased on a publicly available dataset. / Dissertation/Thesis / Masters Thesis Computer Engineering 2018

abstract: Pipeline infrastructure forms a vital aspect of the United States economy and standard of living. A majority of the current pipeline systems were installed in the early 1900’s and often lack a reliable database reporting the mechanical properties, and information about manufacturing and installation, thereby raising a concern for their safety and integrity. Testing for the aging pipe strength and toughness estimation without interrupting the transmission and operations thus becomes important. The state-of-the-art techniques tend to focus on the single modality deterministic estimation of pipe strength and do not account for inhomogeneity and uncertainties, many others appear to rely on destructive means. These gaps provide an impetus for novel methods to better characterize the pipe material properties. The focus of this study is the design of a Bayesian Network information fusion model for the prediction of accurate probabilistic pipe strength and consequently the maximum allowable operating pressure. A multimodal diagnosis is performed by assessing the mechanical property variation within the pipe in terms of material property measurements, such as microstructure, composition, hardness and other mechanical properties through experimental analysis, which are then integrated with the Bayesian network model that uses a Markov chain Monte Carlo (MCMC) algorithm. Prototype testing is carried out for model verification, validation and demonstration and data training of the model is employed to obtain a more accurate measure of the probabilistic pipe strength. With a view of providing a holistic measure of material performance in service, the fatigue properties of the pipe steel are investigated. The variation in the fatigue crack growth rate (da/dN) along the direction of the pipe wall thickness is studied in relation to the microstructure and the material constants for the crack growth have been reported. A combination of imaging and composition analysis is incorporated to study the fracture surface of the fatigue specimen. Finally, some well-known statistical inference models are employed for prediction of manufacturing process parameters for steel pipelines. The adaptability of the small datasets for the accuracy of the prediction outcomes is discussed and the models are compared for their performance. / Dissertation/Thesis / Doctoral Dissertation Materials Science and Engineering 2018

abstract: As the demand for wireless systems increases exponentially, it has become necessary for different wireless modalities, like radar and communication systems, to share the available bandwidth. One approach to realize coexistence successfully is for each system to adopt a transmit waveform with a unique nonlinear time-varying phase function. At the receiver of the system of interest, the waveform received for process- ing may still suffer from low signal-to-interference-plus-noise ratio (SINR) due to the presence of the waveforms that are matched to the other coexisting systems. This thesis uses a time-frequency based approach to increase the SINR of a system by estimating the unique nonlinear instantaneous frequency (IF) of the waveform matched to the system. Specifically, the IF is estimated using the synchrosqueezing transform, a highly localized time-frequency representation that also enables reconstruction of individual waveform components. As the IF estimate is biased, modified versions of the transform are investigated to obtain estimators that are both unbiased and also matched to the unique nonlinear phase function of a given waveform. Simulations using transmit waveforms of coexisting wireless systems are provided to demonstrate the performance of the proposed approach using both biased and unbiased IF estimators. / Dissertation/Thesis / Masters Thesis Electrical Engineering 2018

Aujourd'hui, la proportion des personnes âgées devient importante par rapport à l'ensemble de la population, et les capacités d'admission dans les hôpitaux sont limitées. En conséquence, plusieurs systèmes de télévigilance médicale ont été développés, mais il existe peu de solutions commerciales. Ces systèmes se concentrent soit sur la mise en oeuvre d’une architecture générique pour l'intégration des systèmes d'information médicale, soit sur l'amélioration de la vie quotidienne des patients en utilisant divers dispositifs automatiques avec alarme, soit sur l’offre de services de soins aux patients souffrant de certaines maladies comme l'asthme, le diabète, les problèmes cardiaques ou pulmonaires, ou la maladie d'Alzheimer. Dans ce contexte, un système automatique pour la télévigilance médicale à domicile est une solution pour faire face à ces problèmes et ainsi permettre aux personnes âgées de vivre en toute sécurité et en toute indépendance à leur domicile. Dans cette thèse, qui s’inscrit dans le cadre de la télévigilance médicale, un nouveau système de télévigilance médicale à plusieurs modalités nommé EMUTEM (Environnement Multimodale pour la Télévigilance Médicale) est présenté. Il combine et synchronise plusieurs modalités ou capteurs, grâce à une technique de fusion de données multimodale basée sur la logique floue. Ce système peut assurer une surveillance continue de la santé des personnes âgées. L'originalité de ce système avec la nouvelle approche de fusion est sa flexibilité à combiner plusieurs modalités de télévigilance médicale. Il offre un grand bénéfice aux personnes âgées en surveillant en permanence leur état de santé et en détectant d’éventuelles situations de détresse. / The population age increases in all societies throughout the world. In Europe, for example, the life expectancy for men is about 71 years and for women about 79 years. For North America the life expectancy, currently is about 75 for men and 81 for women. Moreover, the elderly prefer to preserve their independence, autonomy and way of life living at home the longest time possible. The current healthcare infrastructures in these countries are widely considered to be inadequate to meet the needs of an increasingly older population. Home healthcare monitoring is a solution to deal with this problem and to ensure that elderly people can live safely and independently in their own homes for as long as possible. Automatic in-home healthcare monitoring is a technological approach which helps people age in place by continuously telemonitoring. In this thesis, we explore automatic in-home healthcare monitoring by conducting a study of professionals who currently perform in-home healthcare monitoring, by combining and synchronizing various telemonitoring modalities,under a data synchronization and multimodal data fusion platform, FL-EMUTEM (Fuzzy Logic Multimodal Environment for Medical Remote Monitoring). This platform incorporates algorithms that process each modality and providing a technique of multimodal data fusion which can ensures a pervasive in-home health monitoring for elderly people based on fuzzy logic.The originality of this thesis which is the combination of various modalities in the home, about its inhabitant and their surroundings, will constitute an interesting benefit and impact for the elderly person suffering from loneliness. This work complements the stationary smart home environment in bringing to bear its capability for integrative continuous observation and detection of critical situations.

This thesis considers the ways in which a multimodal approach to teaching writing process can help students better understand the choices available as they navigate first-year writing and beyond. Such an approach destabilizes their understanding of what counts as writing, beyond the strictly text-based practices they may normally associate with writing. This destabilization emphasizes the uncertainty of writing as a productive frame of mind, as it encourages a more critical approach for students as they develop and adapt their writing processes. A multimodal perspective on writing process encourages a more proactive approach to students’ development of a repertoire of writing knowledge and practice to increase their chances of transfer.

This study was designed to examine the effect of Science Writing Heuristic Approach on Students’ Learning of Multimodal Representations across 4th Grade to 8the Grade Levels. Multimodal representations in the forms of figures, tables, pictures, and charts are part of scientific language. A quasi-experimental design with control and treatment group of classes was used. Students completed the summary writing task by including multimodal representations in the both control and treatment classes. The students’ writing samples were evaluated with four measures of multimodal categories, including sign, functional, conceptual and embeddedness structures. To examine the differences of treatment and control groups and the effect of age, the Hierarchical Linear Modeling (HLM) analysis was used in this study. The HLM provides an opportunity to use statistical models that account for nesting of the data. Analysis of quantitative data indicated that the treatment classes significantly outperformed than the control classes on four measures of categories. Age also was a significant contributor to students’ learning of multimodal representations. Three key points emerged from the results. Firstly, the SWH approach had positive effects on students’ understanding of the multimodal representations. Secondly, the impact of the age was different for each category. Thirdly, the categories were used in this study had significant potential when exploring the students learning of multimodal representations. The study indicated some practical benefits that the strategy of promoting argumentative scientific language effectively was resulted in better communication, understanding of the topic with multimodal representations, and some transferring impacts of all these with the summary writing activities.