Minimally invasive surgery (MIS) consists in operating through small incisions in which a camera and adapted instruments are inserted. It allows to perform many interventions with reduced trauma for the patient. One of these is the ablation of peripheral pulmonary nodules.<p><p>Nevertheless, the means for detecting nodules during MIS are limited. In fact, because of the lack of direct contact, the surgeon cannot palpate the lung to find invisible lesions, as he would do in classical open surgery. As a result, only clearly visible nodules can be treated by MIS presently.<p><p>This work aims at designing, building and controlling a teleoperated palpation instrument, in order to extend the possibilities of MIS in the thoracic field. Such an instrument is made of a master device, manipulated by an operator, and a slave device which is in contact with the patient and reproduces the task imposed by the master. Adequate control laws between these two parts allow to restore the operator's haptic sensation. The goal is not to build a marketable prototype, but to establish a proof of concept.<p><p>The palpation device has been designed in collaboration with thoracic surgeons on the basis of the study of the medical gesture. The specifications have been deduced through experiments with experiencied surgeons from the Erasmus Hospital and the Charleroi Civil Hospital.<p><p>A pantograph has been built to be used as the master of the palpation tool. The slave is made of a 2 degrees of freedom (dof) clamp, which can be actuated in compression and shear. The compression corresponds to vertical moves of the pantograph, and the shear to horizontal ones. Force sensors have been designed within this project to measure the efforts along these directions, both at the master and the slave side, in order to implement advanced force-feedback control laws and for validation purposes.<p><p>Teleoperation control laws providing a suitable kinesthetic force feedback for lung palpation have been designed and validated through simulations. These simulations have been realized using a realistic model of lung, validated by experienced surgeons. Among the implemented control schemes, the 3-Channel scheme, including a local force control loop at the master side, is the most efficient for lung palpation. Moreover, the increased efficiency of a 2 dof device with respect to a 1 dof tool has been confirmed. Indeed, a characteristic force profile due to the motion in 2 directions appeared in the compression force tracking, making the lesion easier to locate. / Doctorat en Sciences de l'ingénieur / info:eu-repo/semantics/nonPublished

Background: An intermediate step towards fully autonomous construction equipment is “assisted tele-remote operation”. These sorts of operations imply that an operator remotely supports machines that has encountered a situation that autonomous systems onboard the construction machines (CM) cannot solve. Considering teleoperators are not required to continuously monitor the CM in an assisted tele-remote environment, multiple construction machines can be teleoperated simultaneously. For simplification, “assisted tele-remote operation” will now be referred to as “teleoperations”. Volvo Construction Equipment is currently exploring the possibility to teleoperate wheel loaders, articulated haulers, and excavators from a single platform. To do this, primary controls adapted for operating these machines are needed. The primary controls should be designed with the needs of a teleoperator in mind while taking functionality into account, which is needed when CM are both operated conventionally and in tele-remote applications. This procedure will be referred to as relevant primary controls. As the primary controls from three different CM-types are destined to be combined into one platform, the teleoperations platform will be referred to as “3-1 CM teleoperations platform”. The purpose of this thesis project was to propose a relevant solution to primary controls for a 3-1 CM teleoperations platform. To fulfil this purpose, the following two research questions (RQ) where formulated: • RQ1: What are the challenges for teleoperating construction equipment? • RQ2: What defines primary controls in a 3-1 CM teleoperations platform and how can the layout be improved? Method: Using interviews, observations, and literature as qualitative data collection methods, several insights where gained. A scenario for the CM was defined to define the situation in which the quantitative data collection method would be performed. Needs of current CM operators combined with teleoperators have been analysed and listed. Quantitative data has been collected and analysed to design the layout of the primary controls using the objective data as a basis. Result: The research questions were answered with the following results: • RQ1: Insights that resulted in several themes describing how teleoperations can be developed by looking at different challenges it can face. • RQ2: Specifications of the functions included in the new ‘primary controls’ based on CM functions from the company and from teleoperating experiences from several industries. An analysis on how often the functions for the new ‘primary controls’ were used, was carried out. The answers to the research questions were used as a basis to fulfil the purpose of this thesis project by proposing a conceptual solution for primary controls to a teleoperation’s platform for operating multiple CM. Conclusions: It was established that a 3-1 CM teleoperations platform can be developed towards certain CE-machine types. Moreover, additional analysis with experienced operators of each machine type are needed to improve and verify the most optimal layout of the primary controls and platform. Further research is still required to validate the answers to RQ1 and RQ2.

In direct teleoperation the interface is vital to control a robot. Often it is reduced to a simple controller and the feedback provided by a camera stream in a monitor which leads to poor results. A telepresence system combined with a Free Look Control is proposed to increase the result in terms of situational awareness, usability and comfort. The telepresence system provides the sense of depth to the operatorin several manners. Free Look Control replaces Tank Control as control mode, in which the robot can be driven in any direction and the operator takes the control of the camera. A synergy is found when both features are implemented together as their advantages are increased. In addition a multi-camera setup is created, in order to build the 3D environment shown to the operator, which is calibrated in an automatic way. The two different control modes are tested and compared by several people. The outcome shows how the inclusion of these characteristics improve the result of the teleoperation in a visible way.

Poslední roky přinesly rostoucí trend nasazení robotů v nových aplikacích, kde se od nich očekává nejen práce vedle lidí, ale skutečná spolupráce na společných komplexních úlohách. K umožnění blízké, bohaté a přirozené interakce člověka s robotem, bude nutné podstatně rozšířit schopnosti současných robotických systémů. Dále již nebude docházet k interakci jen mezi roboty v bezpečnostních klecích a experty na jejich programování. Stále častěji budou interagovat s~bezpečnými spolupracujícími roboty uživatelé bez odborných znalostí z oblasti robotiky, s různorodým vzděláním a zkušenostmi. Úžasně složitá zařízení, kterými dnešní roboti jsou, se tak stanou ještě složitějšími, což představuje zásadní výzvu pro návrh jejich uživatelských rozhraní. Cílem této práce je zkoumat a vyvinout řešení umožňující blízkou interakci mezi neodbornými uživateli a komplexními roboty. Výzkum byl zaměřen na dvě oblasti robotiky: asistenční servisní a průmyslové spolupracující roboty. Ačkoliv se tyto dvě oblasti vyznačují odlišnými požadavky, pro návrh interakce mezi člověkem a~robotem je možné použít podobné principy. Nedostatky stávajících přístupů jsou řešeny návrhem nové metody pro úlohově zaměřenou interakci. Nejvýznamější aspekty metody jsou využití smíšené reality, autonomních funkcí robota, komunikace vnitřního stavu robota, kontextová citlivost a použití modalit vhodných pro danou úlohu. Pro obě oblasti zaměření výzkumu bylo na základě metody navrženo a implementováno uživatelské rozhraní. Obě rozhraní byla úspěšně ověřena s neodbornými uživateli, kteří díky nim byli schopni úspěšně spolupracovat s robotem na složitých úlohách. Publikovaná ověření rozhraní prokazují, že realizovaná metoda významně zlepšuje blízkou interakci mezi člověkem a robotem, která s dosavadními přístupy nebyla plně dosažitelná. Klíčové aspekty metody představují vodítko pro návrh uživatelských rozhraní v oblasti spolupracujících robotů.

付記する学位プログラム名: デザイン学大学院連携プログラム / 京都大学 / 0048 / 新制・課程博士 / 博士(工学) / 甲第21759号 / 工博第4576号 / 新制||工||1713(附属図書館) / 京都大学大学院工学研究科機械理工学専攻 / (主査)教授 松野 文俊, 教授 椹木 哲夫, 教授 小森 雅晴 / 学位規則第4条第1項該当 / Doctor of Philosophy (Engineering) / Kyoto University / DFAM

No description available.

<p dir="ltr">Teletaction, the transmission of tactile feedback or touch, is a crucial aspect in the</p><p dir="ltr">field of teleoperation. High-quality teletaction feedback allows users to remotely manipulate</p><p dir="ltr">objects and increase the quality of the human-machine interface between the operator and</p><p dir="ltr">the robot, making complex manipulation tasks possible. Advances in the field of teletaction</p><p dir="ltr">for teleoperation however, have yet to make full use of the high-resolution 3D data provided</p><p dir="ltr">by modern vision-based tactile sensors. Existing solutions for teletaction lack in one or more</p><p dir="ltr">areas of form or function, such as fidelity or hardware footprint. In this thesis, we showcase</p><p dir="ltr">our research into a low-cost teletaction device for teleoperation that can utilize the real-time</p><p dir="ltr">high-resolution tactile information from vision-based tactile sensors, through both physical</p><p dir="ltr">3D surface reconstruction and shear displacement. We present our device, the Feelit, which</p><p dir="ltr">uses a combination of a pin-based shape display and compliant mechanisms to accomplish</p><p dir="ltr">this task. The pin-based shape display utilizes an array of 24 servomotors with miniature</p><p dir="ltr">Bowden cables, giving the device a resolution of 6x4 pins in a 15x10 mm display footprint.</p><p dir="ltr">Each pin can actuate up to 3 mm in 200 ms, while providing 80 N of force and 3 um of</p><p dir="ltr">depth resolution. Shear displacement and rotation is achieved using a compliant mechanism</p><p dir="ltr">design, allowing a minimum of 1 mm displacement laterally and 10 degrees of rotation. This</p><p dir="ltr">real-time 3D tactile reconstruction is achieved with the use of a vision-based tactile sensor,</p><p dir="ltr">the GelSight, along with an algorithm that samples the depth data and marker tracking to</p><p dir="ltr">generate actuator commands. With our device we perform a series of experiments including</p><p dir="ltr">shape recognition and relative weight identification, showing that our device has the potential</p><p dir="ltr">to expand teletaction capabilities in the teleoperation space.</p>

No description available.

The research addresses current shortcomings of autonomous service robots operating in domestic environments by considering the concept of a semi-autonomous robot that would be supported by human remote operators whenever the robot cannot handle a task autonomously. The main research objective was to investigate how to design the human-robot interaction for a robotic system to assist elderly people with physical tasks at home according to this conceptual idea. The research procedure followed the principles of human-centered design and is structured into four phases: In the first phase, the context of use of the system to be designed was determined. A focus group study yielded characteristics and attitudes of several potential user groups. A survey determined the demands of elderly people and informal caregivers for services a semiautonomous assistive robot may provide. An ethnographic study investigated the living conditions of elderly people and determined technical challenges for robots operating in this type of environment. Another ethnographic study investigated the work environment in teleassistive service centers and determined the feasibility of extending their range of services to incorporate robotic teleassistance. In the second phase, two studies were carried out to understand the interaction requirements. The first study determined common types of failure of current autonomous robots and required human interventions to resolve such failure states. The second study investigated how the human assistance could be provided considering a range of potential interaction devices. In the third phase, a human-robot interaction concept with three user groups and dedicated user interfaces was designed. The concept and user interfaces were refined in an iterative process based on the results of evaluations with prospective users and received encouraging results for user satisfaction and user experience. In the fourth and final phase the utility of two specific user interface features was investigated experimentally. The first experiment investigated the utility of providing remote operators with global 3D environment maps during robot navigation and identified beneficial usage scenarios. The second experiment investigated the utility of stereoscopic display for remote manipulation and robot navigation. Results suggested temporal advantages under stereoscopic display for one of three investigated task types and potential advantages for the other two. / Forskningen behandlar problem med autonoma robotar som agerar i hemmiljö. Specifikt studeras konceptet semi-autonoma robotar, vilket innebär att robotarna stöds av mänskliga operatörer när de inte klarar uppgifter på egen hand. Syftet med forskningen är att undersöka design av människa-robotinteraktion för robotsystem som stöder äldres behov av hjälp med fysiska uppgifter i hemmiljö. Forskningen är användarcentrerad och har strukturerats i fyra faser: I den första fasen undersöktes användarkontexten för systemet. I en fokusgruppsstudie utforskades karakteristika och attityder för flera potentiella användargrupper. Kraven på en semi-autonom robot för att assistera äldre och informella vårdgivare fastställdes. En enkätstudie undersökte levnadsvillkor hos äldre för att utforska tekniska utmaningar dessa omgivningar ställer på robotar. En etnografisk studie undersökte arbetskontexten på servicecenter för teleassistans och undersökte genomförbarhet i att utöka tjänsteutbudet till att även inkludera teleassisterade robotar. I den andra fasen utfördes två studier för att få kunskap om interaktionskrav. Den första studien fastställde vanliga typer av fel som inträffar med nuvarande typer av autonoma robotar och de typer av mänsklig assistans som krävs för att hantera dessa fel. Den andra studien undersökte hur mänsklig assistans kan utformas givet en repertoar av potentiella interaktionsanordningar. I den tredje fasen utformades ett interaktionskoncept för människa-robot interaktionen för tre användargrupper med dedicerade gränssnitt. Koncepten och användargränssnitten förfinades i en iterativ process baserat på resultat från utvärderingar med tänkta användare, och resulterade i uppmuntrande resultat vad gäller användarnas uppskattning och tillfredsställelse. I den fjärde och sista fasen studerades nyttan hos två specifika gränssnitt experimentellt. Det första experimentet undersökte nyttan med att ge operatörer på distans globala 3D-kartor under robotnavigeringen och identifierade användarscenarier där detta kan utnyttjas. Det andra experimentet undersökte nyttan med en stereoskopisk display för att manipulera och navigera roboten på distans. Resultaten visar på temporala fördelar med stereoskopisk display för en av tre undersökta uppgiftstyper och potentiella fördelar för de andra två.

The Compact Rescue Crawler is a pneumatic legged robot. Two legs of a hexapod were designed and built. The legs are controlled directly from operator inputs. The operator gives foot position inputs through two PHANToM haptic controllers. A PD controller with a supplementary force gain-scheduler control stroke lengths of each cylinder. The force-based position control technique allows the robot feet to track operator inputs to within 10% position error. A guided gait algorithm was developed to allow the operator to control all 6 legs simply by haptically guiding the front two. The operator records successful and collision-free trajectories and the gait coordinator plays the trajectories through the rear legs as they approach the detected obstacles. This hybrid gait algorithm allows the robot to proceed through a hazardous environment, guided by an operator, but without taxing the input capabilities of the human operator.