abstract: Image resolution limits the extent to which zooming enhances clarity, restricts the size digital photographs can be printed at, and, in the context of medical images, can prevent a diagnosis. Interpolation is the supplementing of known data with estimated values based on a function or model involving some or all of the known samples. The selection of the contributing data points and the specifics of how they are used to define the interpolated values influences how effectively the interpolation algorithm is able to estimate the underlying, continuous signal. The main contributions of this dissertation are three fold: 1) Reframing edge-directed interpolation of a single image as an intensity-based registration problem. 2) Providing an analytical framework for intensity-based registration using control grid constraints. 3) Quantitative assessment of the new, single-image enlargement algorithm based on analytical intensity-based registration. In addition to single image resizing, the new methods and analytical approaches were extended to address a wide range of applications including volumetric (multi-slice) image interpolation, video deinterlacing, motion detection, and atmospheric distortion correction. Overall, the new approaches generate results that more accurately reflect the underlying signals than less computationally demanding approaches and with lower processing requirements and fewer restrictions than methods with comparable accuracy. / Dissertation/Thesis / Ph.D. Bioengineering 2013

Imaging of cellular samples has for several hundred years been a way for scientists to investigate biological systems. With the discovery of immunofluorescence labeling in the 1940’s and later genetic fluorescent protein labeling in the 1980’s the most important part in imaging, contrast and specificity, was drastically improved. Eversince, we have seen a increased use of fluorescence imaging in biological research, and the application and tools are constantly being developed further. Specific ion imaging has long been a way to discern signaling events in cell systems. Through use of fluorescent ion reporters, ionic concentrations can be measured inliving cells as result of applied stimuli. Using Ca2+ imaging we have demonstrated that there is a inverse influence by plasma membrane voltage gated calcium channels on angiotensin II type 1 receptor (a protein involved in blood pressure regulation). This has direct implications in treatment of hypertension (high blood pressure),one of the most common serious diseases in the western civilization today with approximately one billion afflicted adults world wide in 2016. Extending from this more lower resolution live cell bioimaging I have moved into super resolution imaging. This thesis includes works on the interpretation of super resolution imaging data of the neuronal Na+, K+ - ATPase α3, a receptor responsible for maintaining cell homeostasis during brain activity. The imaging data is correlated with electrophysiological measurements and computer models to point towards possible artefacts in super resolution imaging that needs to be taken into account when interpreting imaging data. Moreover, I proceeded to develop a software for single-molecule localization microscopy analysis aimed for the wider research community and employ this software to identify expression artifacts in transiently transfected cell systems. In the concluding work super-resultion imaging was used to map out the early steps of the intrinsic apoptotic signaling cascade in space and time. Using superresoultion imaging, I mapped out in intact cells at which time points and at which locations the various proteins involved in apoptotic regulation are activated and interact. / Avbildning av biologiska prover har i flera hundra år varit ett sätt för forskare att undersöka biologiska system. Med utvecklingen av immunofluoresens inmärkn-ing och fluoresens-mikroskopi förbättrades de viktigaste aspekterna av mikroskopi,kontrast och specificitet. Sedan 1941 har vi sett kontinuerligt mer mångsidigt och frekvent användning av fluorosense-mikroskopi i biologisk forskning. Jon-mikroskopi har länge varit en metod att studera signalering i cell-system. Genom användning av fluorosenta jon-sensorer går det att mäta variationer avjon koncentrationer i levande celler som resultat av yttre påverkan. Genom att använda Ca2+ mikroskopi har jag visat att det finns en omvänd koppling mellan kalcium-kanaler i plasma-membran och angiotensin II typ 1 receptorn (ett proteininvolverat i blodtrycksreglering). Detta har direkta implikationer för behandlingav högt blodtryck, en av de mer vanliga sjukdomarna i västvärlden idag med överen miljard drabbade patienter i världen 2016. Efter detta projekt vidgades mitt fokus till att inkludera superupplösnings-mikroskopi. Denna avhandling inkluderar ett arbete fokuserat på tolkningen av superupplösnings-mikroskopi data från neuronal Na+, K+ - ATPase α3, en jon-pump som återställer cellernas jonbalans i samband med cell signalering. Mikroskopi-datan korreleras mot elektrofysiologi experiment och modeller för att illustrera möjliga artefakter i superupplösnings-mikroskopi som måste tas i beaktande i samband med tolkning av data. Jag fortsatte med att utveckla mjukvara för analys av data från singel-molekyl-lokalisations-mikroskopi där fokuset för mjukvaran framförallt varit på användarvänligheten. Detta då jag hoppas att den kommer vara användbar för ett bredare forskingsfält. Mjukvaran användes även i ett separat projekt för att identifiera överuttrycks-artefakter i transfekterade celler. I det avslutande arbetet använder jag superupplösnings-mikroskopi för att karakterisera de tidiga stegen i mitokondriell apoptos. Jag identifierar när och var i cellen de olika proteinerna involverade i apoptos signaleringen är aktiverade och interagerar. / <p>QC 20171003</p>

Standard optical microscopes cannot resolve images below 200 nm within the visible wavelengths due to optical diffraction limit. This Thesis reports an investigation into super-resolution imaging beyond the optical diffraction limit by microsphere optical nano-scopy (MONS) and submerged microsphere optical nano-scopy (SMON). The effect of microsphere size, material and the liquid type as well as light illumination conditions and focal plane positions on imaging resolution and magnification have been studied for imaging both biological (viruses and cells) and non-biological (Blu-ray disk patterns and nano-pores of anodised aluminium oxide) samples. In particular, sub-surface imaging of nano-structures (data-recorded Blu-ray) that cannot even be seen by a scanning electron microscope (SEM) has been demonstrated using the SMON technique. Adenoviruses of 75 nm in size have been observed with white light optical microscopy for the first time. High refractive index microsphere materials such as BaTiO3 (refractive index n = 1.9) and TiO2-BaO-ZnO (refractive index n = 2.2) were investigated for the first time for the imaging. The super-resolution imaging of sub-diffraction-limited objects is strongly influenced by the relationship between the far-field propagating wave and the near-field evanescent waves. The diffraction limit free evanescent waves are the key to achieving super-resolution imaging. This work shows that the MONS and SMON techniques can generate super-resolution through converting evanescent waves into propagating wave. The optical interactions with the microspheres were simulated using special software (DSIMie) and finite different in time domain numerical analysis software (CST Microwave Studio). The optical field structures are observed in the near-field of a microsphere. The photonic nanojets waist and the distance between single dielectric microsphere and maximum intensity position were calculated. The theoretical modelling was calculated for comparisons with experimental measurements in order to develop and discover super-resolution potential.

Différentes études précédentes ont démontré que IL-1β et PKA peuvent réduire la transmission synaptique inhibitrice dans la LAMINA II de la moelle épinière, en contribuent de cette manière au développement de douleur chronique de tipe inflammatoire. Au niveau des sites post-synaptiques, les changements dans la transmission synaptique (par exemple suivant le relâchement de IL-1β ou après l’activation de PKA), reflètent donc des changements dans les propriétés et/ou dans le nombre des molécules présentes au niveau de la synapse. Au cours de mon doctorat, j’ai pu profiter des techniques basés sur l’imagerie des molécules uniques afin d’étudier les effets de PKA et IL-1β sur la dynamiques et le nombre absolu de GlyR dans les synapses de la moelle épinière. Mes résultats ont montré que PKA et Il-1β peuvent déplacer les GlyR des sites inhibitoires post-synaptiques ciblent différentes sous-unités α du récepteur de la glycine. Comme les sous-unités GlyRα ne se lient pas directement à la géphyrine, ces effets sont vraisemblablement le résultat d’un changement de conformation du GlyR dépendant de la sous-unité. Pendant mon projet, j’ai utilisé la technique de microscopie de super-résolution PALM pour développer une méthode pour déterminer la stœchiométrie des GlyR et le nombre absolu de récepteurs et des molécules d’échafaudage au niveau des synapse de la moelle épinière. Mes résultats décrivent que les GlyR se composent de 3 sous-unités α et de 2 sous-unités β, et proposent qu’une synapse de la moelle épinière contient en moyenne 80 GlyR et 250 molécules de géphyrine. Ces résultats sont essentiels pour mettre en relation l’ampleur des mécanismes de régulation et de plasticité agissant sur la transmission synaptique, avec les changements en nombre de molécules présentes dans les synapses de la moelle épinière. Sur la base de mes découvertes on pourra maintenant étudier les mécanismes structuraux impliqués dans la régulation de la fonction et la dynamique des GlyR dépendantes des sous-unités α que j’ai démontré. / IL-1β and PKA impair glycine receptor-mediated synaptic transmission in the lamina II of the spinal cord, contributing to the development of inflammatory types of chronic pain. At post-synaptic sites, the strength of synaptic transmission depends on the biophysical properties and on the absolute number of receptors expressed. Consequently, changes in synaptic transmission (i.e. following the release of IL-1β or the activation of PKA), reflect changes in the properties and/or number of molecules present at the synapse. During my PhD I have taken advantage of single-molecule based imaging techniques to study the effects of IL-1β and PKA on the dynamics and absolute numbers of GlyRs at spinal cord synapses.My results show for the first time that both Il-1β and PKA displace GlyRs from inhibitory post-synaptic sites, targeting different α-subunit of GlyRs. Specifically, IL-1β reduces GlyR α-containing receptors at spinal cord synapse, whereas PKA affects GlyR α3L subunit. Given that the GlyR α subunits do not bind to the gephyrin scaffold, these effects likely reflect an α-subunit dependent change in GlyR conformation that decreases the affinity of the GlyR subunits for gephryrin. Glycine receptors are composed of α- and β- subunits that assemble into heteropentameric complexes with an unclear stoichiometry. Using super resolution PALM microscopy I have developed a single-molecule counting approach to determine the stoichiometry of GlyRs and the absolute number of receptor and scaffold molecules at spinal cord synapses. According to my results GlyRs is composed by 3 α and 2 β-subunits, and an average spinal cord synapse contains around 80 GlyRs and 250 scaffold molecules. These data are fundamental to relate the magnitude of regulatory and plasticity mechanisms acting on glycinergic transmission, with quantitative changes in molecule numbers at spinal cord synapses. My research has shown how absolute quantitative approaches can help achieve a more detailed insight into the organization of complex molecular assemblies and their dynamic regulation.

This work applies sparse representations and nonlinear image processing to two inverse imaging problems. The first problem involves image restoration, where the aim is to reconstruct an unknown high-quality image from a low-quality observed image. Sparse representations of images have drawn a considerable amount of interest in recent years. The assumption that natural signals, such as images, admit a sparse decomposition over a redundant dictionary leads to efficient algorithms for handling such sources of data. The standard sparse representation, however, does not consider the intrinsic geometric structure present in the data, thereby leading to sub-optimal results. Using the concept that a signal is block sparse in a given basis —i.e., the non-zero elements occur in clusters of varying sizes — we present a novel and efficient algorithm for learning a sparse representation of natural images, called graph regularized block sparse dictionary (GRBSD) learning. We apply the proposed method towards two image restoration applications: 1) single-Image super-resolution, where we propose a local regression model that uses learned dictionaries from the GRBSD algorithm for super-resolving a low-resolution image without any external training images, and 2) image inpainting, where we use GRBSD algorithm to learn a multiscale dictionary to generate visually plausible pixels to fill missing regions in an image. Experimental results validate the performance of the GRBSD learning algorithm for single-image super-resolution and image inpainting applications. The second problem addressed in this work involves image enhancement for detection and segmentation of objects in images. We exploit the concept that even though data from various imaging modalities have high dimensionality, the data is sufficiently well described using low-dimensional geometrical structures. To facilitate the extraction of objects having such structure, we have developed general structure enhancement methods that can be used to detect and segment various curvilinear structures in images across different applications. We use the proposed method to detect and segment objects of different size and shape in three applications: 1) segmentation of lamina cribrosa microstructure in the eye from second-harmonic generation microscopy images, 2) detection and segmentation of primary cilia in confocal microscopy images, and 3) detection and segmentation of vehicles in wide-area aerial imagery. Quantitative and qualitative results show that the proposed methods provide improved detection and segmentation accuracy and computational efficiency compared to other recent algorithms.

Multi-frame image super-resolution focuses on reconstructing a high-resolution image from a set of low-resolution images with high similarity. Since super-resolution is an ill-posted problem, regularization techniques are widely used to constrain the minimization function. Combining image prior knowledge with fidelity model, Bayesian-based methods can effectively solve this ill-posed problem, which makes this kind of methods more popular than other methods. Our proposed model is based on maximum a posteriori probability (MAP) estimation. In this thesis, we propose a novel initialization method based on median operator to initialize our estimated high-resolution image. For the fidelity term in our proposed algorithm, the half-quadratic estimation is used to choose error norm adaptively instead of using fixed L1 or L2 norm. Furthermore, for our regularization term, we propose a novel regularization method based on Difference Curvature (DC) and Bilateral Total Variation (BTV) to suppress mixed noises and preserve image edges simultaneously. In our experimental results, synthetic data and real data are both tested to demonstrate the superiority of our proposed method in terms of clearer texture and less noise over other state-of-the-art methods.

Video super-resolution (VSR) aims to recover a realistic high-resolution (HR) frame from its corresponding center low-resolution (LR) frame and several neighbouring supporting frames. The neighbouring supporting LR frames can provide extra information to help recover the HR frame. However, these frames are not aligned with the center frame due to the motion of objects. Recently, many video super-resolution methods based on deep learning have been proposed with the rapid development of neural networks. Most of these methods utilize motion estimation and compensation models as preprocessing to handle spatio-temporal alignment problem. Therefore, the accuracy of these motion estimation models are critical for predicting the high-resolution frames. Inaccurate results of motion compensation models will lead to artifacts and blurs, which also will damage the recovery of high-resolution frames. We propose an effective wide activated separate 3 dimensional (3D) Convolution Neural Network (CNN) for video super-resolution to overcome the drawback of utilizing motion compensation models. Separate 3D convolution factorizes the 3D convolution into convolutions in the spatial and temporal domain, which have benefit for the optimization of spatial and temporal convolution components. Therefore, our method can capture temporal and spatial information of input frames simultaneously without additional motion evaluation and compensation model. Moreover, the experimental results demonstrated the effectiveness of the proposed wide activated separate 3D CNN.

Nanoscopic spatial reorganization of selectin ligands, CD44 and PSGL-1, during the initial step of hematopoietic stem/progenitor cell (HSPC) homing, tethering and rolling of migrating cells over E-selectins, has been recently reported. However, the exact spatial distribution of these ligands and their spatial reorganization during the cell rolling on E-selectins are still an open question. The spatiotemporal characterization at the nanoscale level requires high resolution imaging methods. In this study, I quantitatively characterize nanoscopic spatiotemporal behavior of the selectin ligands on the migrating cells to understanding the molecular mechanism of the cell rolling at the nanoscale level by means of a microfluidics-based 3D super-resolution fluorescence microscopy technique. The obtained results suggest that PSGL-1 on the cell shows significant change in the axial distribution on the cell during the cell rolling on E-selectin whereas the spatial distribution of CD44 along the axial direction is not affected significantly by the cell rolling. These findings indicate that each selectin ligand has a distinct contribution to the initial step of the HSPC homing because of their distinct spatial localizations on the cells that regulate at least partly the accessibility of these ligands to the surface E-selectin.

Spatial and temporal dynamics of polymer chains play critical roles in their rheological properties, which have a significant influence on polymer processing and fabrication of polymer-based (nano) materials. Many theoretical and experimental studies have aimed at understanding polymer dynamics at the molecular level that give rise to its bulk phase properties. While much progress has been made in the field over the past ~60 years, many aspects of polymers are still not understood, especially in complicated systems such as entangled fluids and polymers of different topologies. In addition, the physical properties of biological macromolecules, i.e. DNA, are expected to affect the spatial organization of chromosome in a cell, which has the potential impact on a broad epigenetics research. Here, we propose new methods for simultaneous visualization of diffusive motion and conformational dynamics of individual polymer chains, two most important factors that characterize polymer dynamics, based on a new single-molecule tracking technique, cumulative-area (CA) tracking method. We demonstrate the applicability of the CA tracking to the quantitative characterization of the motion and relaxation of individual topological polymer molecules under entangled conditions, which is possible only by using the newly-developed CA tracking, using fluorescently-labeled linear and cyclic dsDNA as model systems. We further extend the technique to multi-color CA tracking that allows for the direct visualization and characterization of motion and conformation of interacting molecules. We also develop a new imaging method based on recently developed 3D super-resolution fluorescence microscopy technique, which allows direct visualization of nanoscale motion and conformation of the single molecules that is not possible by any other methods. Using these techniques, we investigate spatial and temporal dynamics of polymers at the single-molecule level, with special emphasis on the effect of topological forms of the molecules and the confined geometry on their spatiotemporal dynamics. Our results demonstrate that the new methods developed in this thesis provide an experimental platform to address key questions in the entangled topological polymer dynamics. The research will provide a platform for developing new polymer-based materials and open the possibility of studying spatial organization of DNA in a confined geometry from physics point of view.

京都大学 / 新制・課程博士 / 博士(医科学) / 甲第23115号 / 医科博第126号 / 新制||医科||8(附属図書館) / 京都大学大学院医学研究科医科学専攻 / (主査)教授 伊佐 正, 教授 髙橋 良輔, 教授 井上 治久 / 学位規則第4条第1項該当 / Doctor of Medical Science / Kyoto University / DFAM