Thesis advisor: Ellen Winner / Previous research reported that people can successfully determine the winner of a musical competition when viewing a six second film clip of the performer without sound (Tsay, 2013, 2014); in contrast, when given an audio-only film clip or a clip that combined auditory and visual information, people perform at chance. Given the well-known publication bias in psychology (Ioannidis, 2005), this surprising and counterintuitive finding begs replication. In Study 1, 112 participants were randomly assigned to a sound, video, or video-plus-sound condition and were asked to select the winning musician after viewing five pairs of clips, one showing the winner and the other showing a non-winning musician. Clips were presented for 60 instead of six seconds, with the goal of giving participants more information about the performance, a modification we predicted would enhance performance in the audio and audio-visual conditions. Contrary to Tsay (2013), participants performed at chance in all three conditions. To more directly replicate Tsay (2013), in Study 2, 69 additional participants were randomly assigned to either a sound, video, or sound plus video condition and were asked to select the winning musician after viewing five pairs of 6-second clips showing the winner and another, non-winning musician. Here again the results did not replicate Tsay (2013): Participants performed significantly above chance in only one condition – when only hearing the performance and not seeing it. These results suggest that previous findings showing increased performance in rating musical performances without sound may be spurious and due to sampling error, issues in experimental design, low power, publication bias, or some combination of these. This also shows the strong importance of replication studies. / Thesis (BA) — Boston College, 2014. / Submitted to: Boston College. College of Arts and Sciences. / Discipline: College Honors Program. / Discipline: Psychology Honors Program. / Discipline: Psychology.

Head-Mounted Displays (HMDs) are increasingly used to support mobile work (Laramee & Ware, 2002). Human operators sometimes require additional auditory support when using an HMD, which raises the question of whether sound is better delivered publicly in free-field or privately via earpiece. A novel experimental procedure was created in which participants had to identify mismatches between auditory information and visual information on an HMD. Different conditions of sound delivery and physical movement were manipulated within-subjects. Participants heard the sound either via earpiece or free-field while they either sat or moved about the test room. Predictions were based on the idea that inconsistent spatial mapping of vision and sound would compromise mismatch detection. First, I predicted a main effect of movement such that participants‟ mismatch detection would be worse when they moved than when they sat. Second, I predicted an interaction between movement and sound delivery. When participants are seated there will be no difference in mismatch detection between the two methods of sound delivery. When participants are walking, however, mismatch detection will be better with an earpiece than with free-field delivery. Results supported the first prediction. For the second prediction, the significant interaction found took a different form than predicted. With the earpiece, participants performed equally well whether sitting or walking, but with free-field sound, participants performed better when sitting than when walking. Results have implications for understanding necessary auditory conditions for effective crossmodal integration and may indicate a cause for concern for people who use HMDs and auditory displays in safety-critical environments.

The perception of our environment and processing situation- or task-relevant information guides us through our everyday life. For example, in sports, the perception of situation-relevant information can be crucial for success or defeat. Different studies show that auditory and visual information interacts in the perception of complex stimuli (Allerdissen et al., 2017; Ca˜nal-Bruland et al., 2018). Furthermore, the combination of auditory and visual stimuli seems to lead to an increase in the precision of perception (Effenberg, 2005). So far, many studies have investigated the influence of (motor) experiences on the perception and evaluation of complex skills (Heinen et al., 2012; Pizzera & Raab, 2012). This dissertation investigates the role of visual and auditory information in the perception, assessment, and evaluation of complex gymnastic skills. Furthermore, it attempts to approach the role of auditory and visual information in motor control of complex skills. The publication-based dissertation includes five different studies. The first two studies (chapters four and five) deal with expert-novice comparisons regarding the quality of movement perception in gymnastics under three different conditions (audiovisual, visual, and auditory). Here, a three-part acrobatic element sequence (round-off, followed by a back handspring and straight back somersault) on the floor was chosen as the object of investigation. Based on the results of the first study, the second investigation takes up the three-part acrobatic series again. The focus here is on the auditory perception of the natural movement sounds through manipulations. The results of the second study lay the foundation for subsequent investigations. The third study investigated whether and to what extent auditory and visual information processing affect the execution of complex skills in trampoline gymnastics. The fourth study takes up the acrobatic series again. Here, music is examined as a possible influencing factor that can play an essential role in female gymnastics on the floor. The fifth and final study attempts to replicate the results of the fourth study for another component of floor routines in female gymnastics female (gymnastic series). Within the dissertation project studies, previous study results regarding the perception of complex skills could be confirmed for the field of gymnastics. On the one hand, it could be shown that more accurate estimations of complex skills are made when visual and auditory information is available and that current gymnasts use auditory information differently than persons without previous experience and persons with visual experience. On the other hand, it could be shown within a synchronization task in trampoline gymnastics that the availability of information affects the speed of movement regulation. It could also be observed that music adapted to the speed of movement leads to higher scores in evaluating the shown gymnastics skills.:Versicherung I List of Publications II Summary III Zusammenfassung IV 1 Introduction 2 Theoretical Background 2.1 Motion Perception in Gymnastics 2.2 Sensory Contributions to Motion Perception 2.3 Neurophysiological Processes in Motion Perception 2.4 Behavioral and Cognitive Approaches to Motion Perception 2.5 Summary 3 Research Program 4 Publication I - The Role of Visual and Auditory Information in the Observation and Evaluation of Complex Skills in Gymnastics 5 Publication II - How does Auditory Information Influence Observers’ Perception during the Evaluation of Complex Skills? 6 Publication III (accepted) - The Role of Auditory and Visual Information in Interpersonal Coordination in Trampoline Gymnastics 7 Publication IV - Does Jumping to the Beat Result in Better Ratings from Gymnastics Experts? 8 Publication V - The Influence of Music on Judges’ Evaluation of Complex Skills in Gymnastics 9 General Discussion 9.1 Theoretical Discussion 9.2 Methodological Discussion 9.3 Practical Implications 10 Conclusions References Appendix / Die Wahrnehmung unserer Umwelt und die Verarbeitung der situations- oder auf- gabenrelevanten Informationen leitet uns durch unseren Alltag. Im Sport kann die Wahrnehmung von situationsrelevanten Informationen ausschlaggebend für Erfolg oder Niederlage sein. Dabei zeigen unterschiedliche Studien, dass auditive und visuelle Informationen bei der Wahrnehmung komplexer Stimuli interagieren (Allerdissen et al., 2017; Cañal-Bruland et al., 2018). Des Weiteren scheint die Kombination von auditiven und visuellen Reizen zu einer präziseren Wahrnehmung zu führen (Effenberg, 2005). Bisher wurde vielfach untersucht, welchen Einfluss (Bewegungs-) Erfahrungen auf die Wahrnehmung und die Bewertung von Bewegungen hat (Heinen et al., 2012; Pizzera & Raab, 2012). Das Ziel des Dissertationsprojektes ist es die Rolle von visuellen und auditiven Informationen bei der Wahrnehmung, Einschätzung und Bewertung von komplexen turnerischen Elementen zu untersuchen. Des Weiteren wird versucht sich der Rolle von auditiven und visuellen Informationen bei der motorischen Kontrolle komplexer Bewegungen zu nähern. Die publikationsbasierte Arbeit umfasst fünf Studien. Die ersten beiden Untersuchungen (Kapitel vier und fünf) befassen sich mit Experten-Novizen-Vergleichen hinsichtlich der Qualität der Bewegungswahrnehmung im Gerätturnen unter drei verschiedenen Bedingungen (audio-visuell, visuell, auditiv). Hierbei wurde eine dreiteilige akrobatische Elementabfolge (Rondat, Flick-Flack, Salto rückwärts gestreckt) am Gerät Boden als Untersuchungsgegenstand gewählt. Aufbauend auf den Ergebnissen der ersten Studie greift die zweite Untersuchung die dreiteilige Bewegungsfolge erneut auf. Der Fokus wird hierbei auf die natürlichen Bewegungsgeräusche gelegt, deren Informationen durch Manipulationen verändert werden. Die Ergebnisse der zweiten Studie legen die Grundlage für die darauf folgenden Untersuchungen. In der dritten Studie wurde untersucht, ob und inwiefern sich die Verarbeitung von auditiven und visuellen Informationen auf die Ausführung von komplexen Bewegungen auswirkt. Die vierte Studie greift erneut die akrobatische Elementabfolge auf. Hierbei wird Musik als möglicher Einflussfaktor untersucht, der im Gerätturnen weiblich am Boden eine wichtige Rollen spielen kann. Die fünfte und abschließende Studie versucht die Ergebnisse der vierten Studie für einen anderen Bestandteil der Bodenübung im Gerätturnen weiblich (gymnastische Reihen) zu replizieren. Innerhalb des Dissertationsprojektes konnten bisherige Studienergebnisse bezüglich der Wahrnehmung von komplexen Bewegungen für den Bereich des Turnens bestätigt werden. Einerseits konnte gezeigt werden, dass genauere Einschätzungen von Bewegungen erfolgen, wenn visuelle und auditive Informationen verfügbar sind und aktive Sportler:innen auditive Informationen anders nutzen, als Personen ohne Vorerfahrung oder mit visuellen Erfahrungen. Andererseits konnte innerhalb einer Synchronisationsaufgabe im Trampolinturnen gezeigt werden, dass sich die Verfügbarkeit der Informationen auf die Geschwindigkeit der Bewegungsregulation auswirkt. Es konnte außer- dem beobachtet werden, dass an die Bewegungsgeschwindigkeit angepasste Musik zu höheren Werten bei der Bewertung der gezeigten Bewegungen führt.:Versicherung I List of Publications II Summary III Zusammenfassung IV 1 Introduction 2 Theoretical Background 2.1 Motion Perception in Gymnastics 2.2 Sensory Contributions to Motion Perception 2.3 Neurophysiological Processes in Motion Perception 2.4 Behavioral and Cognitive Approaches to Motion Perception 2.5 Summary 3 Research Program 4 Publication I - The Role of Visual and Auditory Information in the Observation and Evaluation of Complex Skills in Gymnastics 5 Publication II - How does Auditory Information Influence Observers’ Perception during the Evaluation of Complex Skills? 6 Publication III (accepted) - The Role of Auditory and Visual Information in Interpersonal Coordination in Trampoline Gymnastics 7 Publication IV - Does Jumping to the Beat Result in Better Ratings from Gymnastics Experts? 8 Publication V - The Influence of Music on Judges’ Evaluation of Complex Skills in Gymnastics 9 General Discussion 9.1 Theoretical Discussion 9.2 Methodological Discussion 9.3 Practical Implications 10 Conclusions References Appendix

Des anomalies du traitement des informations sensorielles sont observées dans l'autisme, notamment, les signaux dynamiques semblent trop rapides et/ou complexes pour être convenablement traités par les personnes avec TSA. Aussi, ralentir ces signaux (Gepner, 2001, 2005) pourrait les aider à les percevoir et faciliterait leur compréhension aux interactions sociales. Nous avons proposé des enfants avec TSA, âgés de 3 à 8 ans, pendant un an des séances hebdomadaires d'orthophonie impliquant l'utilisation d'un logiciel ralentissant le son et les images des vidéos (Logiral(TM)). Un groupe contrôle d'enfants avec TSA, bénéficiant de séances d'orthophonie mais sans l'utilisation de Logiral(TM), a également été constitué. Nous avons comparé l'évolution des compétences socio-communicatives des deux groupes ainsi que les comportements d'exploration visuelle lors de la présentation du visage d'une narratrice racontant une histoire. Nos résultats montrent une amélioration significative de la capacité à imiter et diminution des comportements inadaptés uniquement pour les enfants du groupe expérimental. Après un an d'utilisation de Logiral(TM), ces enfants regardent davantage le visage et ses caractéristiques internes (yeux et bouche). / Sensory processing abnormalities are observed in autism, in particular dynamic signals involved in interactions seem too fast and/or too complex to be adequately treated by people with ASD. Also, slow down the speed of these signals (Gepner, 2001, 2005; Gepner et al, 2001, 2002, 2005) could help them to perceive informations and could facilitate their understanding in social interactions. We proposed to children with ASD, aged from 3 to 8 years, speech therapy weekly for a year with the use of a software (Logiral(TM)) to slow down sound and pictures. A control group of children with ASD, receiving speech therapy without the use of Logiral (TM) was also set up. We compared the evolution of the social communication skills of the two groups and their visual exploration behavior during the presentation of the face of a narrator telling a story. Our results show a significant improvement in the ability to imitate and a decrease in inappropriate behaviors, and this, only for the children in the experimental group. After a year of using Logiral(TM), these children watch more facial and internal features (eyes and mouth) which is no observed for children in the control group.