Return to search

Optimization Techniques for Multi-object Detection and Tracking on Live-cell Fluorescence Microscopy Images and Their Applications

Fluorescence microscopy is a pivotal imaging technique to visualize biological processes and has been extensively utilized in live-cell morphology analysis. Despite its utility, related object detection and tracking tasks still face challenges due to large data scales, inferior data quality, and insufficient annotations, leading to reliance on adaptive thresholding. Current adaptive thresholding approaches have two significant limitations: Firstly, they cannot handle the heteroscedasticity of image data well and result in biased outputs. Secondly, they deal with frames of time-series imaging data independently and result in inconsistent detections over time. We introduce two novel optimization techniques to address these limitations and enhance detection and tracking results in live-cell imaging. The first one, ConvexVST, is a convex optimization approach to transform heteroscedastic data into homoscedastic data, making them more tractable for subsequent analysis. The second one, Joint Thresholding, is a graph-based approach to get the optimal adaptive thresholds while maintaining temporal consistency. Our methods demonstrate superior performance across various object detection and tracking tasks. Specifically, when applied to microglia imaging data, our techniques enable the acquisition of more complete cell morphology and more accurate detection of microglia tips. Furthermore, by integrating these techniques with existing frameworks, we propose an advanced pipeline for embryonic cell detection and tracking in light-sheet microscopy images, which is streets ahead of state-of-the-art peer methods and sets a new benchmark in the field. / Doctor of Philosophy / Fluorescence microscopy is an important imaging tool for observing biological processes and is widely used to study live-cell structures and activities. However, detecting and tracking objects in these images can be difficult because of the large amount of data, poor image quality, and lack of accurate annotations. It leads to the reliance on basic image segmentation approaches, which try to distinguish foreground from background by setting intensity thresholds. These methods have two main problems: they don't handle varying noise in image data well, resulting in inaccurate outputs, and they analyze each frame in a sequence of images independently, causing inconsistencies over time. To solve these issues, we developed two new techniques to improve detection performance in live-cell imaging. The first one, ConvexVST, makes the noise levels in image data more uniform, simplifying the following analysis. The second one, Joint Thresholding, can find the best intensity thresholds while maintaining consistency across frames over time. Our methods have shown significant improvements in detecting and tracking objects. For example, when applied to images of microglia (a type of brain cell), they provide more complete cell shapes and more accurate detection of cell structures. Additionally, by combining these techniques with existing frameworks, we create an advanced pipeline for detecting and tracking embryonic cells that outperforms current leading methods.

Identiferoai:union.ndltd.org:VTETD/oai:vtechworks.lib.vt.edu:10919/120688
Date24 July 2024
CreatorsWang, Mengfan
ContributorsElectrical and Computer Engineering, Yu, Guoqiang, Abbott, Amos L., Wang, Yue J., Lo, ShihChung Benedict, Gerdes, Ryan M.
PublisherVirginia Tech
Source SetsVirginia Tech Theses and Dissertation
LanguageEnglish
Detected LanguageEnglish
TypeDissertation
FormatETD, application/pdf
RightsIn Copyright, http://rightsstatements.org/vocab/InC/1.0/

Page generated in 0.0017 seconds