L’imagerie de fluorescence est une technique d’imagerie médicale permettant de visualiser l’émission d’un traceur, ou fluorophore, à l’aide d’une excitation de type Laser ou LED. Les domaines d’application de la technologie sont la chirurgie oncologique, la chirurgie reconstructive ou encore la chirurgie cardiaque. Bien que les besoins en chirurgie ouverte soient importants, l’évolution des pratiques tend à démocratiser la chirurgie dite minimalement invasive. La chirurgie endoscopique va dans ce sens, le but étant de limiter les traumatismes opératoires rencontrés en chirurgie ouverte. Parmi les avantages de cette techniques on note une diminution des saignements et de la douleur, ou encore une réduction de la durée d’hospitalisation.Lors d’une intervention de type chirurgie ouverte, le praticien peur se contenter de la seuls information de fluorescence fournie par le système d’imagerie. Cependant, tout l’enjeu de l’imagerie de fluorescence pour la chirurgie mini-invasive est de venir greffer ne information relative au fluorophore sur une image couleur de très bonne qualité, essentielle au chirurgien. Pour une première évaluation, un système deux caméras a été réalisé. Un capteur est dédié à l’acquisition de l’image couleur et un autre à l’information de fluorescence. Cependant, notamment pour conserver pour conserver un système compact et proposer la meilleure ergonomie possible au chirurgien, l’endoscope final ne devra comporter qu’un seul imageur. Le principe de base est d’utiliser des impulsions de lumière d’excitation et de lumière blanche afin de séquentiellement acquérir les données de fluorescence et les images couleur. Il convient ensuite de traiter les informations recueillies pour reconstruire l’image désirée en temps réel. / Fluorescence image-guided surgery is a medical imaging modality which allows the surgeon to visualize a fluorescent probe previously injected to the patient. The probe could be specific or not and the technology is useful in a wide range of application from oncologic procedures to reconstructive surgeries or cardiac procedures. Despite the important needs of this technology in open-procedures, the surgery in general is more and more minimally invasive. The goal of mini-invasive surgery is to limit patient's per and post operation trauma. The advantages of the technique are a decrease of bleeding and pain and a decreasing hospitalization time.During an open surgery, the B&W fluorescence information given by the fluorescence image-guided surgery system is enough for the surgeon. For mini-invasive procedures, the in-game is to overlay the fluorescence information to high quality color image, compulsory for the surgeon to perform his procedure. As a first evaluation, a 2-sensors system has been rapidly developed. One sensor is dedicated to the acquisition of the color image and the other to the fluorescence information. In order to make the system more compact and improve the quality of the color image furnished to the surgeon, the final system should be composed of only one sensor. To create the color image and collect the fluorescence information with one sensor, the technique involved pulsed white light and excitation light in a sequential acquisition mode. The two information are combined and a real-time color plus fluorescence video is displayed to the surgeon.

In the past twenty years, the combination of the advances in medical imaging technologies and therapeutic methods had a great impact in developing minimally invasive interventional procedures. Although the use of medical imaging for the surgery and therapy guidance dates back to the early days of x-ray discovery, there is an increasing evidence in using the new imaging modalities such as computed tomography (CT), magnetic reso- nance imaging (MRI) and ultrasound in the operating rooms. The focus of this thesis is on developing image-guided interventional methods and techniques to support the radiation therapy treatment of gynecologic cancers. Gynecologic cancers which involves malignan- cies of the uterus, cervix, vagina and the ovaries are one of the top causes of mortality and morbidity among the women in U.S. and worldwide. The common treatment plan for radiation therapy of gynecologic cancers is chemotherapy and external beam radiation therapy followed by brachytherapy. Gynecological brachytherapy involves placement of interstitial catheters in and around the tumor area, often with the aid of an applicator. The goal is to create an optimal brachytherapy treatment plan that leads to maximal radiation dose to the cancerous tissue and minimal destructive radiation to the organs at risk. The accuracy of the catheter placement has a leading effect in the success of the treatment. However there are several techniques are developed for navigation of catheters and needles for procedures such as prostate biopsy, brain biopsy, and cardiac ablation, it is obviously lacking for gynecologic brachytherapy procedures. This thesis proposes a technique which aims to increase the accuracy and efficiency of catheter placements in gynecologic brachytherapy by guiding the catheters with an electromagnetic tracking system. To increase the accuracy of needle placement a navigation system has been set up and the appropriate software tools were developed and released for the public use as a module in the open-source 3D Slicer software. The developed technology can be translated from benchmark to the bedside to offer the potential benefit of maximizing tumor coverage during catheter placement while avoiding damage to the adjacent organs including bladder, rectum and bowel. To test the designed system two independent experiments were designed and performed on a phantom model in order to evaluate the targeting accuracy of the tracking system and the mean targeting error over all experiments was less than 2.9 mm, which can be compared to the targeting errors in the available commercial clinical navigation systems.

En chirurgie mini-invasive guidée par l’image, une planification préopératoire précise des trajectoires des outils chirurgicaux est un facteur clé pour une intervention réussie. Cependant, une planification efficace est une tâche difficile, qui peut être considérablement améliorée en considérant différents facteurs contributifs tels que les déformations biomécaniques intra-opératoires, ou en introduisant de nouvelles techniques d'optimisation. Dans ce travail, nous nous concentrons sur deux aspects. Le premier aspect porte sur l'intégration de la déformation intra-opératoire dans le processus de planification de trajectoire. Nos méthodes combinent des techniques d'optimisation géométrique à base de simulations biomécaniques. Elles sont caractérisées par un certain niveau de généralité, et ont été expérimentées sur deux types d’interventions chirurgicales: les procédures percutanées pour l'ablation de tumeurs hépatiques, et la stimulation cérébrale profonde en neurochirurgie. Deuxièmement, nous étudions, mettons en œuvre, et comparons plusieurs approches d'optimisation en utilisant des méthodes qualitatives et quantitatives, et nous présentons une méthode efficace d'optimisation évolutionnaire multicritères à base de Pareto qui permet de trouver des solutions optimales qui ne sont pas accessibles par les méthodes existantes. / In image-guided minimally invasive surgery, a precise preoperative planning of the surgical tools trajectory is a key factor to a successful intervention. However, an efficient planning is a challenging task, which can be significantly improved when considering different contributing factors such as biomechanical intra-operative deformations, or novel optimization techniques. In this work, we focus on two aspects. The first aspect addresses integrating intra-operative deformation to the path planning process. Our methods combine geometric-based optimization techniques with physics-based simulations. They are characterized with a certain level of generality, and are experimented on two different surgical procedures: percutaneous procedures for hepatic tumor ablation, and in neurosurgery for Deep Brain Stimulation (DBS). Secondly, we investigate, implement, and compare many optimization approaches using qualitative and quantitative methods, and present an efficient evolutionary Pareto-based multi-criteria optimization method which can find optimal solutions that are not reachable via the current state of the art methods.

Les gliomes sont des tumeurs cérébrales primitives représentant le deuxième cancer le plus fréquent chez l’enfant et la troisième cause de mortalité chez l’adulte jeune. Il a été démontré qu’une chirurgie d’exérèse tumorale permet d’augmenter la qualité et la durée de vie du patient, voir même dans certains cas, d’obtenir sa guérison. L’identification intraopératoire des résidus tumoraux permettrait au chirurgien de vérifier, in situ, la qualité de son geste d’exérèse. Une nouvelle modalité d’imagerie intraopératoire a été proposée comme solution pour détecter les tumeurs résiduelles. Elle se base sur l’utilisation d’une sonde nucléaire combinée à un système de localisation optique. Cette nouvelle modalité, appelée imagerie surfacique de positons (ISP), permet la génération d’images de la distribution surfacique d’un radiotraceur comme le 18 F − F DG d’une zone d’intérêt scannée. L’ISP n’étant actuellement pas utilisée en clinique, nous proposons pour la première fois une étude de faisabilité de son utilisation pour l’optimisation de la chirurgie des tumeurs cérébrales. Nous montrons les limites de l’utilisation potentielle de l’ISP dans un contexte neurochirurgical par des études expérimentales en considérant des facteurs intraopératoires pouvant influencer la qualité des images générées par le système. Les contributions présentées se concentrent sur trois axes. Dans un premier temps, nous souhaitons obtenir des images fonctionnelles d’ISP avec un temps de calcul faible. L’application de modèles d’acquisition aux mesures permettent d’améliorer la qualité des images, au détriment d’un temps de calcul élevé. Nous suggérons un nouveau modèle d’acquisition dédié au contexte intraopératoire, permettant l’amélioration de la résolution et du contraste des images pour un temps de calcul réduit. Un deuxième axe est dédié à l’étude de l’impact d’une acquisition intraopératoire sur les performances du système. Nous proposons l’estimation des paramètres intrinsèques de la sonde nucléaire utilisée et de l’influence de la hauteur du processus de scan sur leurs valeurs. Le dernier axe est consacré à la validation de modèles d’acquisition dans le contexte intraopératoire. Nous présentons une étude comparative des performances de modèles d’acquisition en considérant l’impact potentiel de la vitesse de scan durant l’acquisition. L’ensemble de ces travaux a contribué à l’étude de faisabilité de l’utilisation d’un système d’ISP en intraopératoire, proposée pour la première fois en neurochirurgie. / Gliomas are primitive brain tumors, which represent the second most frequent cancer among children and the third cause of death among young adult. It has been shown that resection surgery improves patient outcomes, leading to its cure for some cases. Intraoperative detection of residual tumor allows the surgeon to check the quality of its resection gesture. A new intraoperative imaging modality has been proposed as a solution to detect residual tumors. It relies on a nuclear probe associated with an optical localization system. This new modality, called positron surface imaging (PSI), generates images of the activity surface distribution of a 18 F based radiotracer of a scanned area of interest. Not used in clinical context yet, we proposed for the first time a feasibility study of its usage to optimize brain tumor surgery. We show limitations of the potential usage of PSI in neurosurgery through experimental studies, considering intraoperatives factors which may influence quality of generated images. Contributions in this study are presented on three axes. First, we want to generate PSI functional images with a low computational time. Acquisition models applied to measurements improve image quality at the cost of high computational time. We suggest a new acquisition model dedicated to intraoperative usage, allowing enhancement of spatial resolution and contrast of images for a low computational time. The second axis is dedicated to the study of the intraoperative acquisition impact on system performance. We propose to estimate the intrinsic parameters of nuclear probe and the study of scanning process on their values. Finally, we present the validation of acquisition models dedicated to intraoperative context. We show a comparative study of acquisition models performance considering potential impact of scanning speed process during acquisition. This work has contributed to the feasibility study of using an ISP system in the intraoperative context, proposed for the first time in neurosurgery.

The identification of eloquent areas is of utmost importance in the surgery of tumors located near speech-eloquent brain areas, since the classical concept of a constant localization was proven to be untrue and the spatial localization of these areas may show large interindividual differences. Some neurosurgical centers apply intraoperative electrophysiological methods that, however, necessitate the performance of surgery in the awake patient. This might be a severe burden both for the patient and the operating team in a procedure that lasts several hours; in addition, electrical stimulation may generate epileptic seizures. Alternatively, methods of functional brain imaging (e.g., PET, fMRI, MEG) may be applied, which allow individual localization of speech-eloquent areas. Matching of these image data with a conventional 3D-CT or MRI now allows the exact transfer of this information into the surgical field by neuronavigation. Whereas standards concerning electrophysiological stimulation techniques that could prevent a permanent postoperative worsening of language are available, until now it remains unclear whether the resection of regions shown to be active in functional brain imaging will cause a permanent postoperative deficit. / Die Identifikation sprachaktiver Areale ist von höchster Bedeutung bei der Operation von Tumoren in der Nähe des vermuteten Sprachzentrums, da das klassische Konzept einer konstanten Lokalisation des Sprachzentrums sich als unrichtig erwiesen hat und die räumliche Ausdehnung dieser Areale eine hohe interindividuelle Varianz aufweisen kann. Einige neurochirurgische Zentren benutzen deshalb intraoperativ elektrophysiologische Methoden, die jedoch eine Operation am wachen Patienten voraussetzen. Dies kann sowohl für den Patienten als auch das Operations-Team eine schwere Belastung bei diesem mehrstündigen Eingriff darstellen, zusätzlich können epileptische Anfälle durch die elektrische Stimulation generiert werden. Alternativ können Modalitäten des «functional brain imaging» (PET, fMRT, MEG usw.) eingesetzt werden, die die individuelle Lokalisation sprachaktiver Areale gestatten. Die Bildfusion dieser Daten mit einem konventionellen 3D-CT oder MRT erlaubt den exakten Transfer dieser Daten in den OP-Situs mittels Neuronavigation. Während Standards bei elektrophysiologischen Stimulationstechniken existieren, die eine permanente postoperative Verschlechterung der Sprachfunktion weitgehend verhindern, bleibt die Relevanz sprachaktiver Areale bei den neuesten bildgebenden Techniken bezüglich einer Operations-bedingten Verschlechterung der Sprachfunktion bisher noch unklar. / Dieser Beitrag ist mit Zustimmung des Rechteinhabers aufgrund einer (DFG-geförderten) Allianz- bzw. Nationallizenz frei zugänglich.

There are approximately 1.8 million diagnoses of colorectal cancer, 1 million diagnoses of stomach cancer, and 0.6 million diagnoses of esophageal cancer each year globally. An automatic computer-assisted diagnostic (CAD) tool to rapidly detect colorectal and esophagogastric cancer tissue in optical images would be hugely valuable to a surgeon during an intervention. Based on a colon dataset with 12 patients and an esophagogastric dataset of 10 patients, several state-of-the-art machine learning methods have been trained to detect cancer tissue using hyperspectral imaging (HSI), including Support Vector Machines (SVM) with radial basis function kernels, Multi-Layer Perceptrons (MLP) and 3D Convolutional Neural Networks (3DCNN). A leave-one-patient-out cross-validation (LOPOCV) with and without combining these sets was performed. The ROC-AUC score of the 3DCNN was slightly higher than the MLP and SVM with a difference of 0.04 AUC. The best performance was achieved with the 3DCNN for colon cancer and esophagogastric cancer detection with a high ROC-AUC of 0.93. The 3DCNN also achieved the best DICE scores of 0.49 and 0.41 on the colon and esophagogastric datasets, respectively. These scores were significantly improved using a patient-specific decision threshold to 0.58 and 0.51, respectively. This indicates that, in practical use, an HSI-based CAD system using an interactive decision threshold is likely to be valuable. Experiments were also performed to measure the benefits of combining the colorectal and esophagogastric datasets (22 patients), and this yielded significantly better results with the MLP and SVM models.

Innovations and new advancements in intraoperative real-time imaging have gained significant importance in the field of gastric cancer surgery in the recent past. Currently, the most promising procedures include indocyanine green fluorescence imaging (ICG-FI) and hyperspectral imaging or multispectral imaging (HSI, MSI). ICG-FI is utilized in a broad range of clinical applications, e.g., assessment of perfusion or lymphatic drainage, and additional implementations are currently investigated. HSI is still in the experimental phase and its value and clinical relevance require further evaluation, but initial studies have shown a successful application in perfusion assessment, and prospects concerning non-invasive tissue and tumor classification are promising. The application of machine learning and artificial intelligence technologies might enable an automatic evaluation of the acquired image data in the future. Both methods facilitate the accurate visualization of tissue characteristics that are initially indistinguishable for the human eye. By aiding surgeons in optimizing the surgical procedure, image-guided surgery can contribute to the oncologic safety and reduction of complications in gastric cancer surgery and recent advances hold promise for the application of HSI in intraoperative tissue diagnostics.

Abstract Minimally invasive surgery (MIS) techniques have seen rapid growth as methods for improved operational procedures. The main technology of MIS is based on image guided surgery (IGS) devices, namely surgical navigators, surgical robotics and image scanners. With their widespread use in various fields of surgery, methods and tools that may be used routinely in the hospital setting for “real world” assessment of the accuracy of these devices are lacking. In this thesis the concept of accuracy testing was developed to meet the needs of quality assurance of navigators and robots in a hospital environment. Thus, accuracy was defined as the difference between actual and measured distances from an origin, also including determination of directional accuracy within a specific volume. Two precision engineered accuracy assessment phantoms with assessment protocols were developed as advanced materials and methods for the community. The phantoms were designed to include a common region of surgical interest (ROSI) that was determined to roughly mimic the size of the human head. These tools and methods were utilized in accuracy assessment of two commercial navigators, both enabling the two most widely used tracking modalities, namely the optical tracking system (OTS) and the electromagnetic tracking system (EMTS). Also a study of the accuracy and repeatability of a prototype surgical interactive robot (SIRO) was done. Finally, the phantoms were utilized in spatial accuracy assessment of a commercial surgical 3D CT scanner, the O-Arm. The experimental results indicate that the proposed definitions, tools and methods fulfill the requirements of quality assurance of IGS devices in the hospital setting. The OTS and EMTS tracking modalities were nearly identical in overall accuracy but had unique error trends. Also, the accuracy of the prototype robot SIRO was in the range recommended in the IGS community. Finally, the image quality of the O-Arm could be analyzed using the developed phantoms. Based on the accuracy assessment results, suggestions were made when setting up each IGS device for surgical procedures and for new applications in minimally invasive surgery. / Tiivistelmä Mini-invasiivisen eli täsmäkirurgian tekniikoita ja teknologioita on alettu hyödyntää viime aikoina yhä enemmän. Tavoitteena on ollut parantaa kirurgisten operaatioiden tarkkuutta ja turvallisuutta. Täsmäkirurgiassa käytetyt teknologiat pohjautuvat kuvaohjattuihin kirurgisiin paikannuslaitteisiin. Kuvaohjattuihin laitteisiin kuuluvat navigaattorit, kirurgiset robotit ja kuvantalaitteet. Näiden laitteistojen kehittyminen on mahdollistanut tekniikoiden hyödyntämisen monialaisessa kirurgiassa. Paikannuslaitteistojen ja robottien yleistyminen on kuitenkin nostanut sairaaloissa esiin yleisen ongelman paikannustarkkuuden määrittämisessä käytännön olosuhteissa. Tässä väitöskirjassa esitetään kirurgisten yksiköiden käyttöön menetelmä sekä kaksi uutta fantomia ja protokollaa käytössä olevien paikannuslaitteistojen tarkkuuden määrittämiseen. Fantomit suunniteltiin sisältämään ennalta määritetty kirurginen kohdealue, mikä rajattiin käsittämään ihmisen kallon tilavuus. Fantomeita ja protokollaa hyödynnettiin kahden kaupallisen paikannuslaitteen tarkkuuden määrityksessä. Navigaattorit käyttivät optiseen ja elektromagneettiseen paikannukseen perustuvaa tekniikkaa. Lisäksi työssä kehitetyillä menetelmillä tutkittiin prototyyppivaiheessa olevan kirurgisen robotin paikannus- ja toistotarkkuutta sekä tietokonetomografialaitteen O-kaaren kuvan tarkkuuden määritystä. Kokeellisten tulosten perusteella työssä kehitetyt fantomit ja protokollat ovat luotettavia ja tarkkoja menetelmiä kirurgisten paikannuslaitteistojen tarkkuuden määrittämiseen sairaalaoloissa. Kirurgisten navigaattoreiden tarkkuuden määritystulokset osoittivat optisen ja elektromagneettisen paikannustekniikan olevan lähes yhtä tarkkoja. Prototyyppirobotin tarkkuus oli tulosten perusteella kirjallisuudessa esitettyjen suosituksien mukainen. Lisäksi O-kaaren kuvanlaatua voitiin tutkia kehitetyillä fantomeilla. Tarkkuudenmääritystulosten perusteella työssä ehdotetaan menetelmiä laitteistojen optimaalisesta käytöstä leikkaussalissa sekä laajennetaan niiden käyttömahdollisuuksia. Tuloksia voidaan hyödyntää myös paikannuslaitteistojen kehittämistyössä.

Le système perceptif d’un chirurgien doit s’adapter aux contraintes multisensorielles liées à la chirurgie guidée par l’image. Trois expériences sont conçues pour explorer ces contraintes visuelles et haptiques pour l’apprentissage guidé par l’image. Les résultats montrent que les sujets sont plus rapides et plus précis avec une vision directe. La stéréoscopie 3D n’améliore pas les performances des débutants complets. En réalité virtuelle, la variation de la longueur, largeur, position et complexité de l'objet affecte les performances motrices. La force de préhension appliquée sur un système robotique chirurgical dépend de l'expérience de l'utilisateur. En conclusion, le temps et la précision sont importants, mais la précision doit rester une priorité pour un apprenti. L'homogénéité des groupes d'étude est important pour la recherche sur la formation chirurgicale. Les résultats ont un impact direct sur le suivi des compétences individuelles pour les applications guidées par l'image. / Perceptual system of a surgeon must adapt to conditions of multisensorial constrains regard to planning, control, and execution of the image-guided surgical operations. Three experimental setups are designed to explore these visual and haptic constraints in the image-guided training. Results show that subjects are faster and more precise with direct vision compared to image guidance. Stereoscopic 3D viewing does not represent a performance advantage for complete beginners. In virtual reality, variation in object length, width, position, and complexity affect the motor performance. Applied grip force on a surgical robot system depends on the user experience level. In conclusion, both time and precision matter critically, but trainee gets as precise as possible before getting faster should be a priority. Study group homogeneity and background play key role in surgical training research. The findings have direct implications for individual skill monitoring for image-guided applications.