West Virginia University
A Multiscale AI Framework for Forest and Agriculture Health Monitoring: Drone-Based Object Recognition and Segmentation for Automated Ecological Assessment
Abstract
dc:description.abstractForest and agricultural ecosystems are increasingly at risk due to invasive species, pests, and diseases, necessitating scalable, automated, and intelligent monitoring solutions. Traditional field based forest and agriculture health assessments are limited by cost, time, and spatial coverage. This dissertation presents a multiscale deep learning framework that automates forest and agriculture health monitoring using drone imagery and computer vision techniques. The system operates across three spatial levels: forest level, tree level, and leaf level, combining object detection, segmentation, and classification models to support large scale ecological assessment. At the forest level, high-altitude drone imagery is processed using object detection and segmentation models, leveraging the state-of-the-art Mask2former architecture to detect and map large-scale ecological threats, such as invasive species and pest infestations. At the tree level, two complementary approaches are employed: a semi-supervised learning pipeline using a novel Gaussian Mixture Model (GMM) for limited labeled data, and a deep learning segmentation model optimized for large datasets to provide fine-grained spatial mapping of invasive species presence. Our semi-supervised GMM combines supervised and unsupervised learning, incorporating user input for manual region selection and data augmentation to enhance model robustness. At the leaf level, a classification model based on transformer architectures is used to differentiate invasive species, enabling species-level identification based on visual patterns. Our framework integrates deep learning, semi-supervised learning, and efficient data handling to enable large-scale ecological surveillance. By combining supervised and semi-supervised learning, it adapts to varying data availability, providing accurate monitoring of forest and agriculture health. This scalable system enhances automated ecological surveillance, offering valuable insights for forest conservation and ecosystem resilience.
Degree
thesis:*- Name thesis:degree_name
- PhD
- Level thesis:degree_level
- Dissertation
- Discipline thesis:degree_discipline
- Lane Department of Computer Science and Electrical Engineering
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Valicharla, Sruthi Keerthi
- Contributors dc:contributor
-
- Xin Li
- Natalia Schmid
- Matthew Valenti
- Kevin Bandura
- Yong-Lak Park
Subjects
dc:subject × 11Identifiers
dc:identifier.*- Identifier
-
<p><a href="https://orcid.org/0009-0009-3329-6307">https://orcid.org/0009-0009-3329-6307</a></p>
https://researchrepository.wvu.edu/etd/12845