Aspectos relacionados à percepção cognitiva do homem têm sido cada vez mais considerados em projetos de produtos e nos processos de seleção de materiais. Em especial, a seleção de materiais têxteis configura uma tarefa de alta complexidade tanto devido a aspectos técnicos, quanto a aspectos percebidos através dos sentidos. Por isso, esta pesquisa objetiva contribuir com a seleção de materiais têxteis para uso em calçados, através da proposição de um processo sistematizado. O presente estudo integra atributos percebidos de maneira visual e tátil a partir de superfícies de materiais e qualidades percebidas de produtos, encontrados em bibliografia especializada, a uma escala de diferencial semântico. Em etapa posterior, através de teste piloto com designers e especialistas e utilizando os dados coletados por meio de observação direta e questionários, este conteúdo foi avaliado de maneira qualitativa, gerando o referido processo, que utiliza a lista de atributos para a classificação de materiais têxteis para uso no PDP. Como resultado, é proposto um processo industrial patenteado, amparado por uma ferramenta que viabiliza a classificação de materiais têxteis, para uso específico no projeto de calçados. / Aspects related to the cognitive perception of man have been increasingly considered in product designs and materials selection processes. The selection of textile materials constitutes a task of high complexity both due to technical aspects and to aspects perceived through the senses. From this, this research aims to contribute with the selection of textile materials for use in footwear, through the proposition of a systematized process. For this, the present study integrates visually and tactile perceived attributes from material surfaces and perceived qualities of products, found in specialized bibliography, on a semantic differential scale. In a later stage, through a pilot test with designers and specialists and using data collected through direct observation and questionnaires, this content was evaluated in a qualitative way, generating the said process, which uses the list of attributes for the classification of textile materials for use in the PDP. As a result, a patented industrial process is proposed, supported by a tool that enables the classification of textile materials for specific use in shoe design.

Aspectos relacionados à percepção cognitiva do homem têm sido cada vez mais considerados em projetos de produtos e nos processos de seleção de materiais. Em especial, a seleção de materiais têxteis configura uma tarefa de alta complexidade tanto devido a aspectos técnicos, quanto a aspectos percebidos através dos sentidos. Por isso, esta pesquisa objetiva contribuir com a seleção de materiais têxteis para uso em calçados, através da proposição de um processo sistematizado. O presente estudo integra atributos percebidos de maneira visual e tátil a partir de superfícies de materiais e qualidades percebidas de produtos, encontrados em bibliografia especializada, a uma escala de diferencial semântico. Em etapa posterior, através de teste piloto com designers e especialistas e utilizando os dados coletados por meio de observação direta e questionários, este conteúdo foi avaliado de maneira qualitativa, gerando o referido processo, que utiliza a lista de atributos para a classificação de materiais têxteis para uso no PDP. Como resultado, é proposto um processo industrial patenteado, amparado por uma ferramenta que viabiliza a classificação de materiais têxteis, para uso específico no projeto de calçados. / Aspects related to the cognitive perception of man have been increasingly considered in product designs and materials selection processes. The selection of textile materials constitutes a task of high complexity both due to technical aspects and to aspects perceived through the senses. From this, this research aims to contribute with the selection of textile materials for use in footwear, through the proposition of a systematized process. For this, the present study integrates visually and tactile perceived attributes from material surfaces and perceived qualities of products, found in specialized bibliography, on a semantic differential scale. In a later stage, through a pilot test with designers and specialists and using data collected through direct observation and questionnaires, this content was evaluated in a qualitative way, generating the said process, which uses the list of attributes for the classification of textile materials for use in the PDP. As a result, a patented industrial process is proposed, supported by a tool that enables the classification of textile materials for specific use in shoe design.

One of the central goals of design is the creation of experiences that are rated favorably in the intended application context. User expectations play an integral role in tactile product quality and tactile plausibility judgments alike. In the vibrotactile authoring process for virtual environments, vibra-tion is created to match the user’s expectations of the presented situational context. Currently, inefficient trial and error approaches attempt to match expectations implicitly. A more efficient, model-driven procedure based explicitly on tactile user expectations would thus be beneficial for author-ing vibrations. In everyday life, we are frequently exposed to various whole-body vibrations. Depending on their temporal and spectral proper-ties we intuitively associate specific perceptual properties such as “tin-gling”. This suggests a systematic relationship between physical parame-ters and perceptual properties. To communicate with potential users about such elicited or expected tactile properties, a standardized design language is proposed. It contains a set of sensory tactile perceptual attributes, which are sufficient to characterize the perceptual space of vibration encountered in everyday life. This design language enables the assessment of quantita-tive tactile perceptual specifications by laypersons that are elicited in situational contexts such as auditory-visual-tactile vehicle scenes. Howev-er, such specifications can also be assessed by providing only verbal de-scriptions of the content of these scenes. Quasi identical ratings observed for both presentation modes suggest that tactile user expectations can be quantified even before any vibration is presented. Such expected perceptu-al specifications are the prerequisite for a subsequent translation into phys-ical vibration parameters. Plausibility can be understood as a similarity judgment between elicited features and expected features. Thus, plausible vibration can be synthesized by maximizing the similarity of the elicited perceptual properties to the expected perceptual properties. Based on the observed relationships between vibration parameters and sensory tactile perceptual attributes, a 1-nearest-neighbor model and a regression model were built. The plausibility of the vibrations synthesized by these models in the context of virtual auditory-visual-tactile vehicle scenes was validat-ed in a perceptual study. The results demonstrated that the perceptual spec-ifications obtained with the design language are sufficient to synthesize vibrations, which are perceived as equally plausible as recorded vibrations in a given situational context. Overall, the demonstrated design method can be a new, more efficient tool for designers authoring vibrations for virtual environments or creating tactile feedback. The method enables further automation of the design process and thus potential time and cost reductions.:Preface III Abstract V Zusammenfassung VII List of Abbreviations XV 1 Introduction 1 1.1 General Introduction 1 1.1 Objectives of the Thesis 4 1.2 Structure of the Thesis 4 2. Tactile Perception in Real and Virtual Environments 7 2.1 Tactile Perception as a Multilayered Process 7 2.1.1 Physical Layer 8 2.1.2 Mechanoreceptor Layer 9 2.1.3 Sensory Layer 19 2.1.4 Affective Layer 26 2.2 Perception of Virtual Environments 29 2.2.1 The Place Illusion 29 2.2.2 The Plausibility Illusion 31 2.3 Approaches for the Authoring of Vibrations 38 2.3.1 Approaches on the Physical Layer 38 2.3.2 Approaches on the Mechanoreceptor Layer 40 2.3.3 Approaches on the Sensory Layer 40 2.3.4 Approaches on the Affective Layer 43 2.4 Summary 43 3. Research Concept 47 3.1 Research Questions 47 3.1.1 Foundations of the Research Concept 47 3.1.2 Research Concept 49 3.2 Limitations 50 4. Development of the Experimental Setup 53 4.1 Hardware 53 4.1.1 Optical Reproduction System 53 4.1.2 Acoustical Reproduction System 54 4.1.3 Whole-Body Vibration Reproduction System 56 4.2 Software 64 4.2.1 Combination of Reproduction Systems for Unimodal and Multimodal Presentation 64 4.2.2 Conducting Perceptual Studies 65 5. Assessment of a Sensory Tactile Design Language for Characterizing Vibration 67 5.1.1 Design Language Requirements 67 5.1.2 Method to Assess the Design Language 69 5.1.3 Goals of this Chapter 70 5.2 Tactile Stimuli 72 5.2.1 Generalization into Excitation Patterns 72 5.2.2 Definition of Parameter Values of the Excitation Patterns 75 5.2.3 Generation of the Stimuli 85 5.2.4 Summary 86 5.3 Assessment of the most relevant Sensory Tactile Perceptual Attributes 86 5.3.1 Experimental Design 87 5.3.2 Participants 88 5.3.3 Results 88 5.3.4 Aggregation and Prioritization 89 5.3.5 Summary 91 5.4 Identification of the Attributes forming the Design Language 92 5.4.1 Experimental Design 93 5.4.2 Participants 95 5.4.3 Results 95 5.4.4 Selecting the Elements of the Sensory Tactile Design Language 106 5.4.5 Summary 109 5.5 Summary and Discussion 109 5.5.1 Summary 109 5.5.2 Discussion 111 6. Quantification of Expected Properties with the Sensory Tactile Design Language 115 6.1 Multimodal Stimuli 116 6.1.1 Selection of the Scenes 116 6.1.2 Recording of the Scenes 117 6.1.3 Recorded Stimuli 119 6.2 Qualitative Communication in the Presence of Vibration 123 6.2.1 Experimental Design 123 6.2.2 Participants 124 6.2.3 Results 124 6.2.4 Summary 126 6.3 Quantitative Communication in the Presence of Vibration 126 6.3.1 Experimental Design 127 6.3.2 Participants 127 6.3.3 Results 127 6.3.4 Summary 129 6.4 Quantitative Communication in the Absence of Vibration 129 6.4.1 Experimental Design 130 6.4.2 Participants 132 6.4.3 Results 132 6.4.4 Summary 134 6.5 Summary and Discussion 135 7. Synthesis Models for the Translation of Sensory Tactile Properties into Vibration 137 7.1 Formalization of the Tactile Plausibility Illusion for Models 139 7.1.1 Formalization of Plausibility 139 7.1.2 Model Boundaries 143 7.2 Investigation of the Influence of Vibration Level on Attribute Ratings 144 7.2.1 Stimuli 145 7.2.2 Experimental Design 145 7.2.3 Participants 146 7.2.4 Results 146 7.2.5 Summary 148 7.3 Comparison of Modulated Vibration to Successive Impulse-like Vibration 148 7.3.1 Stimuli 149 7.3.2 Experimental Design 151 7.3.3 Participants 151 7.3.4 Results 151 7.3.5 Summary 153 7.4 Synthesis Based on the Discrete Estimates of a k-Nearest-Neighbor Classifier 153 7.4.1 Definition of the K-Nearest-Neighbor Classifier 154 7.4.2 Analysis Model 155 7.4.3 Synthesis Model 156 7.4.4 Interpolation of acceleration level for the vibration attribute profile pairs 158 7.4.5 Implementation of the Synthesis 159 7.4.6 Advantages and Disadvantages 164 7.5 Synthesis Based on the Quasi-Continuous Estimates of Regression Models 166 7.5.1 Overall Model Structure 168 7.5.2 Classification of the Excitation Pattern with a Support Vector Machine 171 7.5.3 General Approach to the Regression Models of each Excitation Pattern 178 7.5.4 Synthesis for the Impulse-like Excitation Pattern 181 7.5.5 Synthesis for the Bandlimited White Gaussian Noise Excitation Pattern 187 7.5.6 Synthesis for the Amplitude Modulated Sinusoidal Excitation Pattern 193 7.5.7 Synthesis for the Sinusoidal Excitation Pattern 199 7.5.8 Implementation of the Synthesis 205 7.5.9 Advantages and Disadvantages of the Approach 208 7.6 Validation of the Synthesis Models 210 7.6.1 Stimuli 212 7.6.2 Experimental Design 212 7.6.3 Participants 214 7.6.4 Results 214 7.6.5 Summary 219 7.7 Summary and Discussion 219 7.7.1 Summary 219 7.7.2 Discussion 222 8. General Discussion and Outlook 227 Acknowledgment 237 References 237 / Eines der zentralen Ziele des Designs von Produkten oder virtuellen Um-gebungen ist die Schaffung von Erfahrungen, die im beabsichtigten An-wendungskontext die Erwartungen der Benutzer erfüllen. Gegenwärtig versucht man im vibrotaktilen Authoring-Prozess mit ineffizienten Trial-and-Error-Verfahren, die Erwartungen an den dargestellten, virtuellen Situationskontext implizit zu erfüllen. Ein effizienteres, modellgetriebenes Verfahren, das explizit auf den taktilen Benutzererwartungen basiert, wäre daher von Vorteil. Im Alltag sind wir häufig verschiedenen Ganzkörper-schwingungen ausgesetzt. Abhängig von ihren zeitlichen und spektralen Eigenschaften assoziieren wir intuitiv bestimmte Wahrnehmungsmerkmale wie z.B. “kribbeln”. Dies legt eine systematische Beziehung zwischen physikalischen Parametern und Wahrnehmungsmerkmalen nahe. Um mit potentiellen Nutzern über hervorgerufene oder erwartete taktile Eigen-schaften zu kommunizieren, wird eine standardisierte Designsprache vor-geschlagen. Sie enthält eine Menge von sensorisch-taktilen Wahrneh-mungsmerkmalen, die hinreichend den Wahrnehmungsraum der im Alltag auftretenden Vibrationen charakterisieren. Diese Entwurfssprache ermög-licht die quantitative Beurteilung taktiler Wahrnehmungsmerkmale, die in Situationskontexten wie z.B. auditiv-visuell-taktilen Fahrzeugszenen her-vorgerufen werden. Solche Wahrnehmungsspezifikationen können jedoch auch bewertet werden, indem der Inhalt dieser Szenen verbal beschrieben wird. Quasi identische Bewertungen für beide Präsentationsmodi deuten darauf hin, dass die taktilen Benutzererwartungen quantifiziert werden können, noch bevor eine Vibration präsentiert wird. Die erwarteten Wahr-nehmungsspezifikationen sind die Voraussetzung für eine anschließende Übersetzung in physikalische Schwingungsparameter. Plausible Vibratio-nen können synthetisiert werden, indem die erwarteten Wahrnehmungs-merkmale hervorgerufen werden. Auf der Grundlage der beobachteten Beziehungen zwischen Schwingungs¬parametern und sensorisch-taktilen Wahrnehmungsmerkmalen wurden ein 1-Nearest-Neighbor-Modell und ein Regressionsmodell erstellt. Die Plausibilität der von diesen Modellen synthetisierten Schwingungen im Kontext virtueller, auditorisch-visuell-taktiler Fahrzeugszenen wurde in einer Wahrnehmungsstudie validiert. Die Ergebnisse zeigten, dass die mit der Designsprache gewonnenen Wahr-nehmungsspezifikationen ausreichen, um Schwingungen zu synthetisieren, die in einem gegebenen Situationskontext als ebenso plausibel empfunden werden wie aufgezeichnete Schwingungen. Die demonstrierte Entwurfsme-thode stellt ein neues, effizienteres Werkzeug für Designer dar, die Schwingungen für virtuelle Umgebungen erstellen oder taktiles Feedback für Produkte erzeugen.:Preface III Abstract V Zusammenfassung VII List of Abbreviations XV 1 Introduction 1 1.1 General Introduction 1 1.1 Objectives of the Thesis 4 1.2 Structure of the Thesis 4 2. Tactile Perception in Real and Virtual Environments 7 2.1 Tactile Perception as a Multilayered Process 7 2.1.1 Physical Layer 8 2.1.2 Mechanoreceptor Layer 9 2.1.3 Sensory Layer 19 2.1.4 Affective Layer 26 2.2 Perception of Virtual Environments 29 2.2.1 The Place Illusion 29 2.2.2 The Plausibility Illusion 31 2.3 Approaches for the Authoring of Vibrations 38 2.3.1 Approaches on the Physical Layer 38 2.3.2 Approaches on the Mechanoreceptor Layer 40 2.3.3 Approaches on the Sensory Layer 40 2.3.4 Approaches on the Affective Layer 43 2.4 Summary 43 3. Research Concept 47 3.1 Research Questions 47 3.1.1 Foundations of the Research Concept 47 3.1.2 Research Concept 49 3.2 Limitations 50 4. Development of the Experimental Setup 53 4.1 Hardware 53 4.1.1 Optical Reproduction System 53 4.1.2 Acoustical Reproduction System 54 4.1.3 Whole-Body Vibration Reproduction System 56 4.2 Software 64 4.2.1 Combination of Reproduction Systems for Unimodal and Multimodal Presentation 64 4.2.2 Conducting Perceptual Studies 65 5. Assessment of a Sensory Tactile Design Language for Characterizing Vibration 67 5.1.1 Design Language Requirements 67 5.1.2 Method to Assess the Design Language 69 5.1.3 Goals of this Chapter 70 5.2 Tactile Stimuli 72 5.2.1 Generalization into Excitation Patterns 72 5.2.2 Definition of Parameter Values of the Excitation Patterns 75 5.2.3 Generation of the Stimuli 85 5.2.4 Summary 86 5.3 Assessment of the most relevant Sensory Tactile Perceptual Attributes 86 5.3.1 Experimental Design 87 5.3.2 Participants 88 5.3.3 Results 88 5.3.4 Aggregation and Prioritization 89 5.3.5 Summary 91 5.4 Identification of the Attributes forming the Design Language 92 5.4.1 Experimental Design 93 5.4.2 Participants 95 5.4.3 Results 95 5.4.4 Selecting the Elements of the Sensory Tactile Design Language 106 5.4.5 Summary 109 5.5 Summary and Discussion 109 5.5.1 Summary 109 5.5.2 Discussion 111 6. Quantification of Expected Properties with the Sensory Tactile Design Language 115 6.1 Multimodal Stimuli 116 6.1.1 Selection of the Scenes 116 6.1.2 Recording of the Scenes 117 6.1.3 Recorded Stimuli 119 6.2 Qualitative Communication in the Presence of Vibration 123 6.2.1 Experimental Design 123 6.2.2 Participants 124 6.2.3 Results 124 6.2.4 Summary 126 6.3 Quantitative Communication in the Presence of Vibration 126 6.3.1 Experimental Design 127 6.3.2 Participants 127 6.3.3 Results 127 6.3.4 Summary 129 6.4 Quantitative Communication in the Absence of Vibration 129 6.4.1 Experimental Design 130 6.4.2 Participants 132 6.4.3 Results 132 6.4.4 Summary 134 6.5 Summary and Discussion 135 7. Synthesis Models for the Translation of Sensory Tactile Properties into Vibration 137 7.1 Formalization of the Tactile Plausibility Illusion for Models 139 7.1.1 Formalization of Plausibility 139 7.1.2 Model Boundaries 143 7.2 Investigation of the Influence of Vibration Level on Attribute Ratings 144 7.2.1 Stimuli 145 7.2.2 Experimental Design 145 7.2.3 Participants 146 7.2.4 Results 146 7.2.5 Summary 148 7.3 Comparison of Modulated Vibration to Successive Impulse-like Vibration 148 7.3.1 Stimuli 149 7.3.2 Experimental Design 151 7.3.3 Participants 151 7.3.4 Results 151 7.3.5 Summary 153 7.4 Synthesis Based on the Discrete Estimates of a k-Nearest-Neighbor Classifier 153 7.4.1 Definition of the K-Nearest-Neighbor Classifier 154 7.4.2 Analysis Model 155 7.4.3 Synthesis Model 156 7.4.4 Interpolation of acceleration level for the vibration attribute profile pairs 158 7.4.5 Implementation of the Synthesis 159 7.4.6 Advantages and Disadvantages 164 7.5 Synthesis Based on the Quasi-Continuous Estimates of Regression Models 166 7.5.1 Overall Model Structure 168 7.5.2 Classification of the Excitation Pattern with a Support Vector Machine 171 7.5.3 General Approach to the Regression Models of each Excitation Pattern 178 7.5.4 Synthesis for the Impulse-like Excitation Pattern 181 7.5.5 Synthesis for the Bandlimited White Gaussian Noise Excitation Pattern 187 7.5.6 Synthesis for the Amplitude Modulated Sinusoidal Excitation Pattern 193 7.5.7 Synthesis for the Sinusoidal Excitation Pattern 199 7.5.8 Implementation of the Synthesis 205 7.5.9 Advantages and Disadvantages of the Approach 208 7.6 Validation of the Synthesis Models 210 7.6.1 Stimuli 212 7.6.2 Experimental Design 212 7.6.3 Participants 214 7.6.4 Results 214 7.6.5 Summary 219 7.7 Summary and Discussion 219 7.7.1 Summary 219 7.7.2 Discussion 222 8. General Discussion and Outlook 227 Acknowledgment 237 References 237

OF THE THESIS The topic of this thesis is to study the cognitive processes (especially perception, imagination and thinking) of blind pupils through experiments with geometric objects. Tools of the experiment are four tasks (two for one pupil, two for a pair of pupils) that are recorded, transcribed into written protocols and analysed. An overview of the involved cognitive functions or naming of missing cognitive functions has been complied on basis of the specialised literature as a theoretical solution of analysis. Findings of psychology of mathematics didactic were other important theoretical starting points. The ones which are devoted to the tactile perception (of geometrical objects), stages of Piaget operation developments, cognitive mechanisms in mathematics and importance of communication in mathematics or geometry teaching are involved in the theses. Analysis of the experiments involves observations of the tactile perception, imaginations, thinking, cognitive processes, speech and communication, and other occurrences essential for specific tasks.

This diploma thesis is focused on the problematics of examination of tactile perception in older school-age pupils with severe visual impairment. The thesis has got three main parts. The first part deals with tactile perception, defines its main characteristics, properties and obstacles associated with tactile perception. It also deals with the role of touch in the life of pupils with visual impairment. A large part of this chapter focuses on the description of orientation aids for visually impaired students. In conclusion, there are mentioned the diagnostic instruments by which the tactile perception is judged. The second part deals with the Tactual Profile observation instrument. There is a detailed description of its purpose and use and there are also mentioned foreign studies on this instrument of Dutch origin. The practical part includes the study of the level of tactile perception in school-aged pupils with visual impairment through the Tactual Profile test. The aim of this diploma thesis is to determine the functionality and usability of this test material (Tactual Profile) in praxis in the given age group of pupils and students with visual impairment. Keywords Tactile perception, touch, visual impairment, Tactual Profile test, school age, older school-age pupils, diagnostics, blindness.

Une régression des principales modalités sensorielles (vision, audition, goût et odorat) est bien rapportée à l'âge. La perception tactile est influencée par différents paramètres. Un grand nombre de ces paramètres ont été bien étudiés dans la littérature tels que le système nerveux central, la densité des mécanorécepteurs dans la peau et les seuils de détection vibro-tactile. Ces paramètres ont été étudiés pour comprendre l'affaiblissement de la perception tactile au fil du temps et les différences naturelles entre les hommes et les femmes. Le doigt humain est toujours utilisé pour qualifier la qualité et les propriétés d'une surface. Par conséquent, un panel de différent âge et sexe est toujours utilisé par différents secteurs industriels afin de comprendre les besoins des consommateurs. Cependant, cette méthode est très coûteuse, longue et subjective. L’objectif de ce travail était de développer une méthodologie qui permette d'avoir une objectivation tactile semblable au panel, cela signifie qu'on doit prendre en compte les effets de l'âge et du sexe. Cette thèse a fourni des mesures in vivo pour 40 doigts humains. Nos développements proposent un doigt artificiel capable de mimer le doigt humain, en tenant l’effet de l'âge et du sexe. Pour atteindre notre objectif, nous avons développé plusieurs approches qui combinent à la fois, la topographie multi-échelle du doigt humain, ces propriétés mécaniques anisotropes, les propriétés tribologiques et l’effet de l’aire réelle de contact et la direction du toucher sur la force de frottement et les vibrations générées. Le développement d’un algorithme de traitement du signal, a permis d’identifier des coefficients représentatifs de la qualité de la surface touchée. L’ingénierie de l'émotion a été un autre axe de recherche dans de ces travaux. L’instrumentation du doigt humain avec un dispositif laser-doppler, a permis d’évaluer la qualité tactile des échantillons en fonction de l'émotion générée pendant le processus du toucher. Cette émotion est étudiée par la variation fréquentielle du débit sanguin. Le mise au point d’un doigt artificiel bio-inspiré qui possède des propriétés biophysiques proches du doigt humain, a permis de réaliser un démonstrateur de toucher qui peut intégrer l’âge et le sexe d’un panel. Ce dispositif répond au cahier des charges défini dans le projet ANR «plasticTouchDevice», et permet aux industriels de la plasturgie de mener des expertises de leurs innovations en ayant recours à un dispositif qui permet d’intégrer l’effet de l’âge et du sexe dans la métrologie de la qualité du toucher des matériaux plastiques. / A decline in the main sensory modalities (vision, hearing, taste, and smell) is well reported to occur with advancing age, it is expected a similar change to occur with touch sensation and perception. The tactile perception is influenced by different parameters. Many of those parameters have been well studied in the literature such as central nervous system, the density of mechanoreceptors in the skin and the vibro-tactile detection thresholds. These parameters have been studied in order to understand the weakens of tactile perception over time and the natural differences between men and women. The human finger is always used to qualify the quality and the properties of a surface. Therefore, a panel of different age and gender always used by companies in order to understand the customers’ needs. However, this method is very expensive, time-consuming and subjective. The objective of this work is to give a solution that avoid the limits of the actual method, but in the same time it should keep their advantages (age and gender). This thesis provided in vivo measurements for 40 human fingers. Our developments propose an artificial finger capable of mimicking the human finger, taking into account the effects of age and gender. To achieve our goal, we have developed several approaches that combine the multi-scale topography of the human finger, the anisotropic mechanical properties, the tribological properties, the effect of the real contact area, the direction of touch on the friction force and the vibrations generated by the human finger. The development of a new signal processing algorithm has made it possible to identify coefficients representative of the quality of the affected surface. The engineering of emotion has been another area of research in this work. Instrumentation of the human finger with a laser Doppler device, allowed to evaluate the tactile quality of the samples according to the emotion generated during the process of the touch. This emotion is studied by the frequency variation of the blood flow. The development of a bio-inspired artificial finger that has biophysical properties close to the human finger, has made it possible to realize a haptic touch demonstrator that can integrate the age and gender of a panel. This device meets the specifications defined in the ANR project "PlasticTouchDevice", and allows plastics industry to conduct expertise of their innovations by using a device that allows the integration of the effects of age and of gender in the metrology of the quality of the touch of plastic materials.

Earlier studies of persons with deafness (D) and/or deafblindness (DB) have primarily focused on the mobility and communication problems. The purpose of the present study was to develop technology for monitoring aids to improve the ability of persons with D and/or DB to detect, identify, and perceive direction of events that produce sounds in their surroundings. The purpose was achieved stepwise in four studies. In Study I, the focus was on hearing aids for persons with residual low frequency hearing. In Study II-IV, the focus was on vibratory aids for persons with total D. In Study I, six signal processing algorithms (calculation methods) based on two principles, transposition and modulation, were developed and evaluated regarding auditory identification of environmental sounds. Twenty persons with normal hearing listened to 45 environmental sounds processed with the six different algorithms and identified them in three experiments. In Exp. 1, the sounds were unknown and the subjects had to identify them freely. In Exp. 2 and 3, the sounds were known and the subjects had to identify them by choosing one of 45 sounds. The transposing algorithms showed better results (median value in Exp. 3, 64%-69%) than the modulating algorithms (40%-52%) did, and they were good candidates for implementing in a hearing aid for persons with residual low frequency hearing. In Study II, eight algorithms were developed based on three principles, transposition, modulation, and filtration – in addition to No Processing as reference, and evaluated for vibratory identification of environmental sounds. The transposing algorithms and the modulating algorithms were also adapted to the vibratory thresholds of the skin. Nineteen persons with profound D tested the algorithms using a stationary, wideband vibrator and identified them by choosing one of 10 randomly selected from the list of 45 sounds. One transposing algorithm and two modulating algorithms showed better (p<0.05) scores than did the No Processing method. Two transposing and three modulating algorithms showed better (p<0.05) scores than did the filtering algorithm. Adaptation to the vibratory thresholds of the skin did not improve the vibratory identification results. In Study III, the two transposing algorithms and the three modulating algorithms with the best identification scores in Study II, plus their adapted alternative, were evaluated in a laboratory study. Five persons from Study II with profound D tested the algorithms using a portable narrowband vibrator and identified the sounds by choosing one of 45 sounds in three experiments (Exp. 1, 2, and 3). In Exp. 1, the sounds were pre-processed and directly fed to the vibrator. In Exp. 2 and 3, the sounds were presented in an acoustic test room, without or with background noise (SNR=+5 dB), and processed in real time. Five of the algorithms had acceptable results (27%-41%) in the three experiments and constitute candidates for a miniaturized vibratory aid (VA). The algorithms had the same rank order in both tests in the acoustic room (Exp. 2, and 3), and the noise did not worsen the identification results. In Study IV, the portable vibrotactile monitoring aid (with stationary processor) for detection, identification and directional perception of environmental sounds was evaluated in a field study. The same five persons with profound D as in Study III tested the aid using a randomly chosen algorithm, drawn from the five with the best results in Study III, in a home and in a traffic environment. The persons identified 12 events at home and five events in a traffic environment when they were inexperienced (the events were unknown) and later when they were experienced (the events were known). The VA consistently improved the ability with regard to detection, identification and directional perception of environmental sounds for all five persons. It is concluded that the selected algorithms improve the ability to detect, and identify sound emitting events. In future, the algorithms will be implemented in a low frequency hearing aid for persons with low frequency residual hearing or in a fully portable vibratory monitoring aid, for persons with profound D or DB to improve their ability to sense the environment.

Le cadre neuroconstructiviste du développement cognitif, en considérant la variabilité des contraintes qui agissent dès la conception et façonnent le développement, apparaît pertinent pour considérer l’influence des expériences sensorielles précoces sur le développement neurocomportemental des nouveau-nés prématurés. Ils évoluent dans un environnement particulier et ont une vulnérabilité aux troubles neurodéveloppementaux, auxquels des atypies du traitement tactile et temporel sont associées. L’objectif de ce travail de thèse est d’étudier les compétences tactiles et temporelles des nouveaux nés prématurés, et d’évaluer l’effet de l’environnement précoce sur ces perceptions. La perception tactile passive et la cognition ont été étudié auprès de 61 nouveau-nés prématurés (nés entre 32 et 34SA) à 35 semaines d’âge corrigé. Les réponses d’orientation manuelle lors de stimulations tactiles passives du membre supérieur ont été mesurées lors d'un paradigme d’habituation et de déshabituation (changement de localisation ou pause dans la séquence de stimulation). Les prématurés montrent une réponse d'orientation manuelle aux stimuli, qui diminue lors de la répétition, indépendamment de son emplacement sur le bras. L'habituation est retardée chez les sujets nés le plus tôt, à un petit poids et ayant vécu davantage d’expériences douloureuses. Enfin, les prématurés perçoivent les changements de localisation du stimulus et l'intervalle interstimulus, ce qui suggère un développement prénatal des capacités de traitement temporel. Ces capacités de traitement temporel et leur utilisation pour générer une prédiction sensorielle ont été évaluées au cours d’une seconde étude. 19 nouveau-nés prématurés (nés entre 31 et 32 SA) ont été soumis à une séquence tactile (régulière ou irrégulière) aux âges corrigés de 33 et 35 SA. Les variations de flux sanguin cérébral été mesurées. Aux deux âges corrigés, les stimuli tactiles sont associés à une réponse hémodynamique au sein du cortex somatosensoriel. À 33 semaines d’âge gestationnel corrigé les omissions dans la séquence sont associées à une augmentation du flux sanguin cérébral, qui indique que les prématurés forment des prédictions sensorielles, indépendamment du groupe expérimental. Ce travail de thèse permet de mieux caractériser les capacités de traitement tactile et temporel des nouveau-nés prématurés, qui manquent d’investigations récentes et approfondies. De plus, il apporte des arguments rationnels qui pourraient permettre de proposer des thérapies sensorielles à ces patients, basées sur leurs capacités de perception. / The neuroconstructivist theoretical framework of cognitive development, taking into account the variability of the constraints that act from the conception to shape development, is relevant to consider the early influence of sensory experiences on the neurobehavioral development of preterm neonates. They evolve in a particular environment and are vulnerable to neurodevelopmental disorders, to which atypical tactile and temporal processing are associated. The aim of the thesis is to study tactile and temporal abilities in preterm newborns and to evaluate the effect of the early environment on these perceptions. We included 61 preterm neonates (born between 32 and 34 weeks of gestational age (wGA)). At 35 weeks of corrected gestational age, we measured orienting responses (forearm, hand, and fingers movements) during vibrotactile stimulation of their hand and forearm, during a habituation and dishabituation paradigm, the dishabituation being either a location change or a pause in the stimulation sequence. Preterm newborns displayed a manual orienting response to vibrotactile stimuli which significantly decreased when the stimulus was repeated, regardless of the stimulated location on the limb. Habituation was delayed in subjects born at a younger gestational age, smaller birth weight, and having experienced more painful care procedures. Preterm neonates perceived changes in stimulus location and interstimulus time interval, suggesting a prenatal development of temporal processing capacities. These temporal processing abilities and their use to generate sensory prediction are being evaluated in a second study. 19 premature neonates (born between 31 and 32wGA) were presented with a tactile sequence (regular or irregular) at 33 and 35 weeks of corrected GA. Variations in cerebral blood flow were measured. At both corrected GA, tactile stimuli are associated with a hemodynamic response in the primary somatosensory cortex. At 33 weeks of corrected GA, omissions in the sequence are associated with an increase in cerebral blood flow, which indicates that premature neonates form sensory predictions, regardless of their experimental group. This thesis work allows to better characterize the tactile and temporal processing abilities in premature neonates, which lack recent and thorough investigation. In addition, it provides rational arguments that could help to propose sensory therapies to these patients, based on their perceptual abilities.

Des études suggèrent que certaines capacités sensorielles peuvent être augmentées chez l’humain, soit i) à la suite d’un entraînement ou ii) à la suite de privation sensorielle précoce. Des études suggèrent qu’une telle altération sensorielle peut être retrouvée chez les personnes ayant subi un entraînement musical. L’interaction entre ce qui est entendu et ressenti est spécialement importante lorsqu’un individu joue d’un instrument de musique. L’entraînement musical est reconnu comme étant une forme d’entraînement multisensoriel incluant des interactions entre des composantes auditives, visuelles et tactiles. Celui-ci peut mener à des réorganisations anatomiques et structurelles dans les régions corticales associées à ces modalités sensorielles. Plusieurs études comportementales ont révélé des habiletés de détection tactile améliorées chez les musiciens. Il est toujours incertain que ces améliorations puissent être retrouvées lors de processus plus complexes tels que la reconnaissance des émotions. Une autre population d’étude pourrait aussi révéler une altération des capacités tactiles, soit les personnes sourdes de naissance. Des études en imagerie ont révélé que les stimuli vibrotactiles activaient les régions auditives chez les personnes sourdes, suggérant ainsi une importante réorganisation tactile chez ces individus. Pourtant, au niveau comportemental, les capacités de détection tactile semblent similaires aux contrôles. Récemment, il a été suggéré que des processus tactiles plus complexes pourraient permettre de révéler des différences comportementales entre les personnes sourdes et entendantes. Malheureusement, tout comme chez les musiciens, ces processus n’ont toujours pas été évalués à ce jour. L’objectif principal de cette thèse est donc d’évaluer i) la perception unisensorielle tactile, auditive ainsi que multisensorielle chez les musiciens et ii) la perception unisensorielle tactile chez les sourds à l’aide de tâches non-musicales et musicales. Chez les musiciens, les résultats de cette thèse suggèrent des capacités de discrimination fréquentielle auditive, tactile et audiotactile améliorées (étude 1) ainsi que des améliorations de la perception d’émotions musicales complexes auditive et tactile (étude 2). Ces études supportent l’hypothèse qu’une formation musicale à long terme : i) entraîne une amélioration des capacités unisensorielles auditives et tactiles, mais surtout que celle-ci s’étend à des processus tactiles complexes, ii) a un impact à tous les niveaux hiérarchiques du traitement sensoriel et cognitif. Chez les individus sourds, les résultats ont révélé un plus haut taux d’erreurs lors de la tâche de détection d’ordre temporel tactile (étude 3). Ce résultat suggère que la cartographie spatiale du toucher est altérée chez les individus sourds. De plus, l’étude ayant mesuré la perception des émotions tactiles a révélé que ceux-ci sont capables d’identifier des émotions via la modalité tactile seule et ont même une capacité améliorée à identifier la joie (étude 4). Cette capacité accrue à percevoir la joie dans une mélodie via la modalité tactile illustre que des habiletés tactiles complexes peuvent être améliorées suite à une privation auditive de longue date. Ces deux études mises en commun illustrent que des capacités tactiles complexes non-musicales et musicales sont altérées chez l’individu sourd, ce qui supporte les études suggérant une réorganisation corticale des aires auditives et tactiles chez les individus sourds. / Studies suggest that some sensory abilities may be increased in humans, either i) following training or ii) following early sensory deprivation. Studies suggest that such sensory alteration can be found in people who have undergone musical training. The interaction between what is heard and felt is especially important when an individual is playing a musical instrument. Musical training is well-known as a form of multisensory training that includes interactions between auditory, visual and tactile modalities. This can lead to anatomical and structural reorganizations in the cortical regions associated with these sensory systems. Several behavioral studies have revealed improved tactile perception skills in musicians. It is still unclear whether these improvements can be found for more complex processes, such as recognition of emotions. Similar alteration of tactile abilities may also be found in another population, namely early-deaf individuals. Imaging studies have shown that vibrotactile stimuli activate auditory regions following deafness, suggesting a significant tactile reorganization of their cortex. Yet, from a behavioral point of view, tactile perception in deaf seems similar to controls. Recently, it has been suggested that more complex tactile processes may reveal behavioral differences between deaf and normal-hearing individuals. Unfortunately, similarly to musicians, these processes have not been investigated to date. The main objective of this thesis is therefore to evaluate via non-musical and musical tasks i) tactile, auditory and multisensory perception of music among musicians and ii) tactile perception of music among deaf individuals. For musicians, results of this thesis suggest enhanced auditory, tactile and audio-tactile frequency discrimination capabilities (Study 1). Also, results suggest an increase perception of emotions in music, which suggests improvements for complex auditory and tactile abilities (Study 2). These studies support the hypothesis that long-term musical training: i) leads to improved auditory and tactile perception, but especially that it extends to complex tactile processes, ii) has an impact at all hierarchical levels of sensory and cognitive processing For deaf individuals, results revealed a higher error rate during the tactile temporal order detection task (Study 3). This result suggests that spatial mapping of touch is impaired in deaf individuals. In addition, the study measuring tactile perception of emotion in music revealed that they are able to identify emotions via tactile modality solely. Also, improvements were found for the identification of happy emotion via tactile modality solely (Study 4). This increased ability to perceive happiness in a melody via the tactile modality illustrates that complex tactile skills can be improved following longstanding hearing deprivation. These two studies together suggest that complex non-musical and musical tactile abilities are altered in the deaf individual, which supports studies suggesting a cortical reorganization of auditory and tactile areas following long-term auditory deprivation.

Sensory adaptation is an important aspect of perception. A seemingly non-beneficial consequence of adaptation is that it produces perceptual illusions. For instance, following focal adaptation, the perceived separation between stimuli straddling the adapted attribute or region is often exaggerated. This type of illusion, known as perceptual repulsion, is both a consequence of and a clue to the brain’s coding strategies and how they are influenced by recent sensory events. Adaptation-induced perceptual repulsion has been well documented in vision (e.g. the tilt aftereffect) and to a lesser extent in audition, but rarely studied in touch. The present thesis investigated the effects of adaptation on tactile spatial perception using a combination of human psychophysics and computational modeling. In a two-interval forced choice task, participants compared the perceived separation between two point-stimuli applied on the forearms successively. The point of subjective equality was extracted as a measure of perceived two-point distance. We showed that tactile spatial perception is subject to an adaptation-induced repulsion illusion: vibrotactile adaptation focally reduced tactile sensitivity and significantly increased the perceived distance between points straddling the adapted skin site (Chapter 2). This repulsion illusion, however, was not observed when the intervening skin was desensitized with topical anesthesia instead of vibrotactile adaptation, suggesting that peripheral desensitization alone is insufficient to induce the illusion (Chapter 3). With Bayesian perceptual modeling, we showed that the illusion was consistent with the hypothesis that the brain decodes tactile spatial input without awareness of the adaptation state in the nervous system (Chapter 4). Together, the empirical and theoretical work furthers the understanding of dynamic tactile spatial coding as the somatosensory system adapts to the sensory environment. Its main findings are consistent with the adaptation- induced repulsion illusions reported in vision and audition, suggesting that perception in different sensory modalities shares common processing features and computational principles. / Thesis / Doctor of Philosophy (PhD) / Sensory adaptation can shape how we perceive the world. In this thesis, we showed that the perception of space in touch is pliable and subject to the influence of adaptation. Psychophysical testing in human participants showed that vibratory adaptation induced an illusion that expanded the perceived distance between stimuli on the skin. This illusion provides clues into how information about space in touch is normally processed and interpreted by the brain. In addition, we developed a computational model that used a powerful statistical framework – Bayesian inference – to probe touch on a theoretical basis. To the best of our knowledge, the present thesis provides the first combined psychophysical and computational study on the effects of adaptation on tactile spatial perception. Our findings suggest that touch shares some common information processing principles with vision and hearing, and adaptation plays a functionally similar role in mediating this process across the senses.