A major goal in biological imaging is to visualize interactions of different tissues, often fluorescently labeled, during dynamic processes. Only a few of these labels fit into the available spectral range without overlap, but can be separated computationally if the full spectrum of every single pixel is known. In medical imaging, hyperspectral techniques show promise to identify different tissue types without any staining. Yet, microscopists still commonly acquire spectral information either with filters, thus integrating over a few broad bands only, or point-wise, dispersing the spectra onto a multichannel detector, which is inherently slow. Light sheet fluorescence microscopy (LSFM) and optical projection tomography (OPT) are two techniques to acquire 3D microscopic data fast, photon-efficiently and gently on the specimen. LSFM works in fluorescence mode and OPT in transmission. Both are based on a fast widefield detection scheme where a 2D detector records the spatial information but leaves no room to acquire dispersed spectra. Hyperspectral imaging had not yet been demonstrated for either technique. In this work, I developed a line-scanning hyperspectral LSFM and an excitation scanning OPT to acquire 5D data (3D spatial, 1D temporal, 1D spectral) and optimized the performance of both setups to minimize acquisition times without sacrificing image contrast, spatial or spectral information. I implemented and assessed different evaluation pipelines to classify and unmix relevant features. I demonstrate the efficiency of my workflow by acquiring up to five fluorescent markers and the autofluorescence in \\zf and fruit fly embryos on my hyperspectral LSFM. I extracted both concentration maps and spectra for each of these fluorophores from the multidimensional data. The same methods were applied to investigate the transmission data from my spectral OPT, where I found evidence that OPT image formation is governed by refraction, whereas scattering and absorption only play a minor role. Furthermore, I have implemented a robust, educational LSFM on which laymen have explored the working principles of modern microscopies. This eduSPIM has been on display in the Technische Sammlungen Dresden for one year during the UNESCO international year of light. / Ein wichtiges Ziel biologischer Bildgebung ist die Visualisierung des Zusammenspiels von verschiedenen, meist fluoreszent markierten, Geweben bei dynamischen Prozessen. Nur wenige dieser Farbstoffe passen ohne Überlapp in das zur Verfügung stehende Spektrum. Sie können jedoch rechnerisch getrennt werden, wenn das gesamte Spektrum jedes Pixels bekannt ist. In medizinischen Anwendungen versprechen hyperspektrale Techniken, verschiedene Gewebetypen markierungsfrei zu identifizieren. Dennoch ist es in der Mikroskopie noch immer üblich, spektrale Information entweder mit Filtern über breiten Bändern zu integrieren, oder Punktspektren mithilfe von Dispersion zu trennen und auf einem Multikanaldetektor aufzunehmen, was inhärent langsam ist. Light Sheet Fluorescence Microscopy (LSFM) und Optical Projection Tomography (OPT) nehmen 3D Mikroskopiedaten schnell, photoneneffizient und sanft für die Probe auf. LSFM arbeitet mit Fluoreszenz, OPT in Transmission. Beide basieren auf schneller Weitfelddetektion, wobei die räumliche Information mit einem 2D Detektor aufgenommen wird, der keinen Raum lässt, um die getrennten Spektren zu messen. Hyperspektrale Bildgebung wurde bis jetzt für keine der zwei Techniken gezeigt. Ich habe ein hyperspektrales LSFM mit Linienabtastung und ein OPT mit Wellenlängenabtastung entwickelt, um 5D Daten (3D räumlich, 1D zeitlich, 1D spektral) aufzunehmen. Beide Aufbauten wurden hinsichtlich minimaler Aufnahmezeit optimiert, ohne dabei Kontrast, räumliche oder spektrale Auflösung zu opfern. Ich habe verschiedene Abläufe zum Klassifizieren und Trennen der Hauptkomponenten implementiert. Ich nehme bis zu fünf Fluorophore und Autofluoreszenz in Zebrafisch- und Fruchtfliegenembryos mit dem hyperspektralen LSFM auf und zeige die Effizienz des gesamten Ablaufes, indem ich Spektren und räumliche Verteilung aller Marker extrahiere. Die Transmissionsdaten des spektralen OPT werden mit denselben Methoden untersucht. Ich konnte belegen, dass die Bildformation im OPT massgeblich von Brechung bestimmt ist, und Streuung und Absorption nur einen geringen Beitrag leisten. Außerdem habe ich ein robustes, didaktisches LSFM gebaut, damit Laien die Funktionsweise moderner Mikroskopie erkunden können. Dieses eduSPIM war ein Jahr lang in den Technischen Sammlungen Dresden ausgestellt.

Agriculture-related industry and academia have widely adopted Hyperspectral Imaging (HSI) based in-field phenotyping activities. Current HSI solutions such as airborne remote sensing platforms and handheld spectrometers have been proven effective and have become popular in various phenotyping applications. However, the quality of remote sensing systems suffers from a low signal-over-noise ratio due to the imaging distance and low resolution. Handheld leaf spectrometers are slow, labor-intensive, and only measure a small spot on the leaf, which fails to represent the canopy variation. In 2018, the Purdue ABE sensor lab developed a new handheld hyperspectral leaf imager, LeafSpec. For the first time, field phenotyping researchers were able to collect high-resolution leaf hyperspectral images without the negative impacts of ambient lighting and leaf-slope angle changes. LeafSpec has been successfully tested in field assays and showed its advantageous phenotyping quality. The goal of this study was to test the hypothesis that a robotic system could replace the human operator required to perform in-field and leaf-level HSI using LeafSpec. The system consisted of a modified version of the LeafSpec device, a machine vision system for target leaf detection, a National Instrument MyRIO as a controller and a customized cartesian robotic arm with five Degrees of Freedom (DOF). For each scan, the on-board machine vision system recognized the top leaf collar and obtained the target coordinates. The coordinates were then passed to the controller, which calculated the appropriate path and acceleration profile and drove the arm to approach the target leaf and scan the leaf with the LeafSpec device. The scanned image was then processed in real-time to calculate plant physiological features such as chlorophyll content, nitrogen content and so on. In the 2019 field test, the designed system collected data from 41 corn plants with two genotypes and three levels of nitrogen treatments with an average cycle time of 86 seconds. The nitrogen content predicted by the designed system had an R squared of 0.72 with the ground truth. The developers, therefore, concluded that the robotic gantry system was capable of replacing human operators for LeafSpec hyperspectral corn leaf imaging in the field with high quality.

No description available.

Measurement science has seen fast growth of data in both volume and complexity in recent years, new algorithms and methodologies have been developed to aid the decision<br>making in measurement sciences, and this process is automated for the liberation of labor. In light of the adversarial approaches shown in digital image processing, Chapter 2 demonstrate how the same attack is possible with spectroscopic data. Chapter 3 takes the question presented in Chapter 2 and optimized the classifier through an iterative approach. The optimized LDA was cross-validated and compared with other standard chemometrics methods, the application was extended to bi-distribution mineral Raman data. Chapter 4 focused on a novel Artificial Neural Network structure design with diffusion measurements; the architecture was tested both with simulated dataset and experimental dataset. Chapter 5 presents the construction of a novel infrared hyperspectral microscope for complex chemical compound classification, with detailed discussion in the segmentation of the images and choice of a classifier to choose.<br>

Background: Novel intraoperative imaging techniques, namely, hyperspectral (HSI) and fluorescence imaging (FI), are promising with respect to reducing severe postoperative complications, thus increasing patient safety. Both tools have already been used to evaluate perfusion of the gastric conduit after esophagectomy and before anastomosis. To our knowledge, this is the first study evaluating both modalities simultaneously during esophagectomy. Methods: In our pilot study, 13 patients, who underwent Ivor Lewis esophagectomy and gastric conduit reconstruction, were analyzed prospectively. HSI and FI were recorded before establishing the anastomosis in order to determine its optimum position. Results: No anastomotic leak occurred during this pilot study. In five patients, the imaging methods resulted in a more peripheral adaptation of the anastomosis. There were no significant differences between the two imaging tools, and no adverse events due to the imaging methods or indocyanine green (ICG) injection occurred. Conclusions: Simultaneous intraoperative application of both modalities was feasible and not time consuming. They are complementary with regard to the ideal anastomotic position and may contribute to better surgical outcomes. The impact of their simultaneous application will be proven in consecutive prospective trials with a large patient cohort.

There are approximately 1.8 million diagnoses of colorectal cancer, 1 million diagnoses of stomach cancer, and 0.6 million diagnoses of esophageal cancer each year globally. An automatic computer-assisted diagnostic (CAD) tool to rapidly detect colorectal and esophagogastric cancer tissue in optical images would be hugely valuable to a surgeon during an intervention. Based on a colon dataset with 12 patients and an esophagogastric dataset of 10 patients, several state-of-the-art machine learning methods have been trained to detect cancer tissue using hyperspectral imaging (HSI), including Support Vector Machines (SVM) with radial basis function kernels, Multi-Layer Perceptrons (MLP) and 3D Convolutional Neural Networks (3DCNN). A leave-one-patient-out cross-validation (LOPOCV) with and without combining these sets was performed. The ROC-AUC score of the 3DCNN was slightly higher than the MLP and SVM with a difference of 0.04 AUC. The best performance was achieved with the 3DCNN for colon cancer and esophagogastric cancer detection with a high ROC-AUC of 0.93. The 3DCNN also achieved the best DICE scores of 0.49 and 0.41 on the colon and esophagogastric datasets, respectively. These scores were significantly improved using a patient-specific decision threshold to 0.58 and 0.51, respectively. This indicates that, in practical use, an HSI-based CAD system using an interactive decision threshold is likely to be valuable. Experiments were also performed to measure the benefits of combining the colorectal and esophagogastric datasets (22 patients), and this yielded significantly better results with the MLP and SVM models.

Simple Summary Good oxygenation of both bowel ends is an important prerequisite to promote anastomotic healing after colorectal resections. Bowel oxygenation is usually assessed clinically. Hyperspectral imaging is a contactless and contrast-free tool that allows quantifying tissue oxygen intraoperatively. In this study, the results of 105 colorectal resections with hyperspectral imaging are reported. Abstract Background: A perfusion deficit is a well-defined and intraoperatively influenceable cause of anastomotic leak (AL). Current intraoperative perfusion assessment methods do not provide objective and quantitative results. In this study, the ability of hyperspectral imaging (HSI) to quantify tissue oxygenation intraoperatively was assessed. Methods: 115 patients undergoing colorectal resections were included in the final analysis. Before anastomotic formation, the bowel was extracted and the resection line was outlined and imaged using a compact HSI camera, in order to provide instantaneously quantitative perfusion assessment. Results: In 105 patients, a clear demarcation line was visible with HSI one minute after marginal artery transection, reaching a plateau after 3 min. In 58 (55.2%) patients, the clinically determined transection line matched with HSI. In 23 (21.9%) patients, the clinically established resection margin was entirely within the less perfused area. In 24 patients (22.8%), the HSI transection line had an irregular course and crossed the clinically established resection line. In four cases, HSI disclosed a clinically undetected lesion of the marginal artery. Conclusions: Intraoperative HSI is safe, well reproducible, and does not disrupt the surgical workflow. It also quantifies bowel surface perfusion. HSI might become an intraoperative guidance tool, potentially preventing postoperative complications.

Innovations and new advancements in intraoperative real-time imaging have gained significant importance in the field of gastric cancer surgery in the recent past. Currently, the most promising procedures include indocyanine green fluorescence imaging (ICG-FI) and hyperspectral imaging or multispectral imaging (HSI, MSI). ICG-FI is utilized in a broad range of clinical applications, e.g., assessment of perfusion or lymphatic drainage, and additional implementations are currently investigated. HSI is still in the experimental phase and its value and clinical relevance require further evaluation, but initial studies have shown a successful application in perfusion assessment, and prospects concerning non-invasive tissue and tumor classification are promising. The application of machine learning and artificial intelligence technologies might enable an automatic evaluation of the acquired image data in the future. Both methods facilitate the accurate visualization of tissue characteristics that are initially indistinguishable for the human eye. By aiding surgeons in optimizing the surgical procedure, image-guided surgery can contribute to the oncologic safety and reduction of complications in gastric cancer surgery and recent advances hold promise for the application of HSI in intraoperative tissue diagnostics.

Esophagectomy often presents anastomotic leaks (AL), due to tenuous perfusion of gastric conduit fundus (GCF). Hybrid (endovascular/surgical) ischemic gastric preconditioning (IGP), might improve GCF perfusion. Sixteen pigs undergoing IGP were randomized: (1) Max-IGP (n = 6): embolization of left gastric artery (LGA), right gastric artery (RGA), left gastroepiploic artery (LGEA), and laparoscopic division (LapD) of short gastric arteries (SGA); (2) Min-IGP (n = 5): LGA-embolization, SGA-LapD; (3) Sham (n = 5): angiography, laparoscopy. At day 21 gastric tubulation occurred and GCF perfusion was assessed as: (A) Serosal-tissue-oxygenation (StO2) by hyperspectral-imaging; (B) Serosal time-to-peak (TTP) by fluorescence-imaging; (C) Mucosal functional-capillary-density-area (FCD-A) index by confocal-laser-endomicroscopy. Local capillary lactates (LCL) were sampled. Neovascularization was assessed (histology/immunohistochemistry). Sham presented lower StO2 and FCD-A index (41 ± 10.6%; 0.03 ± 0.03 respectively) than min-IGP (66.2 ± 10.2%, p-value = 0.004; 0.22 ± 0.02, p-value < 0.0001 respectively) and max-IGP (63.8 ± 9.4%, p-value = 0.006; 0.2 ± 0.02, p-value < 0.0001 respectively). Sham had higher LCL (9.6 ± 4.8 mL/mol) than min-IGP (4 ± 3.1, p-value = 0.04) and max-IGP (3.4 ± 1.5, p-value = 0.02). For StO2, FCD-A, LCL, max- and min-IGP did not differ. Sham had higher TTP (24.4 ± 4.9 s) than max-IGP (10 ± 1.5 s, p-value = 0.0008) and min-IGP (14 ± 1.7 s, non-significant). Max- and min-IGP did not differ. Neovascularization was confirmed in both IGP groups. Hybrid IGP improves GCF perfusion, potentially reducing post-esophagectomy AL.

Freshwater lakes provide many important ecosystem functions and services to support biodiversity and human well-being. Proximal and remote sensing methods represent an efficient approach to derive water quality indicators such as optically active substances (OAS). Measurements of above-ground remote and in situ proximal sensors, however, are limited to observations of the uppermost water layer. We tested a hyperspectral imaging system, customized for underwater applications, with the aim to assess concentrations of chlorophyll a (CHLa) and colored dissolved organic matter (CDOM) in the water columns of four freshwater lakes with different trophic conditions in Central Germany. We established a measurement protocol that allowed consistent reflectance retrievals at multiple depths within the water column independent of ambient illumination conditions. Imaging information from the camera proved beneficial for an optimized extraction of spectral information since low signal areas in the sensor’s field of view, e.g., due to non-uniform illumination, and other interfering elements, could be removed from the measured reflectance signal for each layer. Predictive hyperspectral models, based on the 470 nm–850 nm reflectance signal, yielded estimates of both water quality parameters (R² = 0.94, RMSE = 8.9 µg L−1 for CHLa; R² = 0.75, RMSE = 0.22 m−1 for CDOM) that were more accurate than commonly applied waveband indices (R² = 0.83, RMSE = 13.2 µg L−1 for CHLa; R² = 0.66, RMSE = 0.25 m−1 for CDOM). Underwater hyperspectral imaging could thus facilitate future water monitoring efforts through the acquisition of consistent spectral reflectance measurements or derived water quality parameters along the water column, which has the potential to improve the link between above-surface proximal and remote sensing observations and in situ point-based water probe measurements for ground truthing or to resolve the vertical distribution of OAS.