One longstanding challenge in the field of robotics has been the robust and reliable grasping of objects of unknown shape. Part of that challenge lies in reconstructing the object’s shape using only limited observations. Most approaches use either visual or tactile information to reconstruct the shape, having to face issues resulting from the limitations of the chosen modality. This thesis tries to combine the strengths of visual and tactile observations by taking the result from an existing visual approach and refining that result through sparse tactile glances. The existing approach produces potential shape hypotheses in voxel space which get combined into one final shape. This thesis takes that final shape and determines voxels of interest using either entropy or variance. These voxels will be targeted by the exploration, providing information about these voxels. This information will be used to assign weights to the original hypotheses in order for the combined shape to better fit the observations. All explorations are simulated and evaluated in MATLAB. The resulting shapes are evaluated based on their Jaccard Index with the ground truth model. The algorithm leads to improvements in the Jaccard Index, but not to drastically different looking shapes.

No description available.

The explorative scanning movements of the hands have been compared to those of the eyes. The visual process is known to be composed of alternating phases of saccadic eye movements and fixation pauses. Descriptive results suggest that during the haptic exploration of objects short movement pauses occur as well.The goal of the present study was to detect these \"explorative stops\"(ES) during one-handed and two-handed haptic explorations of various objects and patterns, and to measure their duration. Additionally, the associations between the following variables were analyzed:(a) between mean exploration time and duration of ES, (b) between certain stimulus features and ES frequency, and (c) the duration of ES during the course of exploration.

abstract: Effective tactile sensing in prosthetic and robotic hands is crucial for improving the functionality of such hands and enhancing the user's experience. Thus, improving the range of tactile sensing capabilities is essential for developing versatile artificial hands. Multimodal tactile sensors called BioTacs, which include a hydrophone and a force electrode array, were used to understand how grip force, contact angle, object texture, and slip direction may be encoded in the sensor data. Findings show that slip induced under conditions of high contact angles and grip forces resulted in significant changes in both AC and DC pressure magnitude and rate of change in pressure. Slip induced under conditions of low contact angles and grip forces resulted in significant changes in the rate of change in electrode impedance. Slip in the distal direction of a precision grip caused significant changes in pressure magnitude and rate of change in pressure, while slip in the radial direction of the wrist caused significant changes in the rate of change in electrode impedance. A strong relationship was established between slip direction and the rate of change in ratios of electrode impedance for radial and ulnar slip relative to the wrist. Consequently, establishing multiple thresholds or establishing a multivariate model may be a useful method for detecting and characterizing slip. Detecting slip for low contact angles could be done by monitoring electrode data, while detecting slip for high contact angles could be done by monitoring pressure data. Predicting slip in the distal direction could be done by monitoring pressure data, while predicting slip in the radial and ulnar directions could be done by monitoring electrode data. / Dissertation/Thesis / M.S. Bioengineering 2012

L’objectif de cette thèse est de mieux comprendre comment les enfants déficients visuels (DV) appréhendent les images tactiles qui illustrent les livres qui leur sont destinés. Notre travail est organisé autour de deux axes de réflexion. Le premier axe se concentre sur l’enfant qui explore des images tactiles, alors que le second axe se focalise sur l’impact des propriétés de ces images sur le traitement haptique des enfants. Nos travaux ont porté sur des enfants atteints de différents degrés de handicap visuel mais sans troubles associés (en particulier, sans retard cognitif), en distinguant les enfants aveugles précoces des enfants malvoyants. Nous avons également comparé leurs performances à celles d’enfants voyants de mêmes âges. Les résultats obtenus montrent que l’expérience perceptive des enfants en fonction de leur degré de handicap visuel impacte fortement la compréhension de l’image explorée tactilement. Les capacités de conceptualisation (accès aux dimensions perceptives et sémantiques de l’image) sont différentes, tout comme les mouvements d’exploration mis en œuvre pour accéder à une bonne compréhension. Nous montrons également que les dimensions spatio-temporelles des explorations (temps, quantité d’exploration, appréhension de l’espace) sont déterminantes pour reconnaitre ce qui est représenté par l’image, et que ces dimensions varient, à nouveau, en fonction du degré de handicap visuel. D’un point de vue fondamental, nous apportons des données concernant les spécificités du système perceptif haptique des enfants DV. D’un point de vue appliqué, nos travaux permettent de proposer des consignes pratiques relatives à la conception d’albums et des conseils pédagogiques concernant l’éducation au toucher à proposer à ces enfants. / The present PhD aims at understanding how Visual Impaired (VI) children process the tactile pictures that illustrate the tactile books specially designed for them. Our work is organized around two main axes of analysis. The first axis concentrates on the child who explores the tactile images, while the second axis focuses on the impact that the properties of these images can have on children’s haptic processing. Our researches included children presenting various degrees of visual impairment but without any associated disorders (in particular, without any cognitive delay), distinguishing early blind children from children with low vision. We also compared their performance with those of sighted children of similar ages. The results showed that children’s perceptive experience, varying according to their degree of visual handicap, strongly impacted their understanding of the tactually explored pictures. Their capacities of conceptualization (access to the perceptive and semantic dimensions of the pictures) were different, just like their movements of exploration carried out to attain a good understanding of the images. We also showed that some properties of the children’s explorations (duration, quantity of exploration, space apprehension) were directly related to the way the children interpreted what was represented in the pictures. Again, these spatiotemporal features varied as a function of the degree of visual handicap. From a fundamental point of view, we provided interesting information concerning the specificities of the haptic perceptive system of the VI children. From an applied point of view, our work enabled to elaborate practical instructions relative to the design of tactile albums and educational advices concerning the education of touch to be proposed to these children.

With the advancements in medicine and welfare systems, the average life span of modern human beings is expanding, creating a new market for elderly care and assistive technology. Along with the development of assistive devices based on traditional aids such as voice-readers, electronic wheelchairs, and prosthetic limbs, a robotic platform is one of the most suitable platforms for providing multi-purpose assistance in human life. This research focuses on the transference of environmental perception to a human user through the use of interactive multi-modal feedback and an assistive robotic platform. A novel framework for haptic telepresence is presented to solve the problem, and state-of-the-art methodologies from computer vision, haptics, and robotics are utilized. The objective of this research is to design a framework that achieves the following: 1) This framework integrates visual perception from heterogeneous vision sensors, 2) it enables real-time interactive haptic representation of the real world through a mobile manipulation robotic platform and a haptic interface, and 3) it achieves haptic fusion of multiple sensory modalities from the robotic platform and provides interactive feedback to the human user. Specifically, a set of multi-disciplinary algorithms such as stereo-vision processes, three-dimensional (3D) map-building algorithms, and virtual-proxy based haptic volume representation processes will be integrated into a unified framework to successfully accomplish the goal. The application area of this work is focused on, but not limited to, assisting people with visual impairment with a robotic platform by providing multi-modal feedback of the environment.

The explorative scanning movements of the hands have been compared to those of the eyes. The visual process is known to be composed of alternating phases of saccadic eye movements and fixation pauses. Descriptive results suggest that during the haptic exploration of objects short movement pauses occur as well.The goal of the present study was to detect these \"explorative stops\"(ES) during one-handed and two-handed haptic explorations of various objects and patterns, and to measure their duration. Additionally, the associations between the following variables were analyzed:(a) between mean exploration time and duration of ES, (b) between certain stimulus features and ES frequency, and (c) the duration of ES during the course of exploration.:Introduction; Materials and methods; Results; Discussion