Back to search

University of Saskatchewan

Semi-Self-Supervised Learning for Deep Models: Reducing Annotation Costs in Dense-Pattern Agricultural Image Analysis

Abstract

dc:description.abstract

Most of the success of deep learning in computer vision depends on supervised learning (SL) and large-scale, manually annotated datasets. Creating such datasets is a major bottleneck due to the substantial cost and labor required, particularly for pixel-level tasks on images with dense and irregular object distributions, as commonly encountered in precision agriculture. While existing semi- and self-supervised methods attempt to reduce this dependency by requiring minimal to no annotation, they still require massive, difficult-to-acquire unlabeled datasets. Self-supervised learning typically involves pretraining on extensive unlabeled data to learn generalizable representations, followed by fine-tuning on task-specific labeled samples, whereas semi-supervised learning combines a small set of labeled data with larger unlabeled collections. To mitigate these challenges, this dissertation introduces a semi-self-supervised learning paradigm that integrates data synthesis, domain adaptation, and spatiotemporal modeling to develop high-performing models across various tasks. Specifically, our paradigm leverages high-frame-rate unannotated video, supplemented with minimal human-annotated static images and video frames, to create large-scale annotated datasets more efficiently than conventional data collection. The produced data includes synthetic training samples, which are rendered through data simulation (synthetic data), and automatically labeled real samples (generated data), where all labels originate from the initial minimal human annotations, thus eliminating the need for further manual labeling and directly addressing the data scarcity problem. We demonstrate the efficacy of our proposed semi-self-supervised paradigm through four key studies on progressively more challenging computer vision tasks within the demanding context of precision agriculture. The framework is first applied to object detection, where a computational synthesis method creates large-scale bounding-box annotated datasets from minimal manually annotated video frames, achieving robust performance of over 80%. Extending this to the pixel-level, the method generates high-quality semantic masks for scenes characterized by dense and overlapping objects, reaching a 91% Dice score with merely 19 annotated video frames and static images. For the more granular task of instance segmentation, our approach enables scalable instance-level object analysis, obtaining over 90% accuracy. Finally, by integrating optical flow and spatiotemporal modeling, our method effectively segments objects in complex video sequences with minimal supervision, outperforming conventional approaches. Together, these studies validate the framework’s ability to deliver high-performing models across diverse and complex tasks while drastically reducing manual labeling effort. These studies establish that our proposed semi-self-supervised paradigm offers a transformative approach for developing DL models. By effectively leveraging video data and supervision derived from minimal human annotations, coupled with domain adaptation, this methodology demonstrates significant scalability and generalizability. It successfully enables instance-level and pixel-level reasoning even with limited annotation, confirming its potential to overcome annotation bottlenecks and advance DL applications in complex, data-constrained real-world scenarios, particularly within the field of precision agriculture.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy (Ph.D.)
Level thesis:degree_level
Doctoral
Discipline thesis:degree_discipline
Computer Science
Department thesis:degree_department
Computer Science
Grantor
University of Saskatchewan
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Najafian, Keyhan
Advisors dc:contributor.advisor
  • Jin, Lingling
  • Stavness, Ian
Committee members dc:contributor.committeemember
  • Gutwin, Carl
  • Gong, Minglun
  • Kusalik, Tony
  • McQuillan, Ian
  • Kutcher, Randy
ORCID person:identifier.orcid

Subjects

dc:subject × 13

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/10388/17546

Chain of custody

source
Harvested from
University of Saskatchewan
Base URL
harvest.usask.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Najafian, Keyhan. Semi-Self-Supervised Learning for Deep Models: Reducing Annotation Costs in Dense-Pattern Agricultural Image Analysis. Doctoral thesis, University of Saskatchewan, 2025. https://hdl.handle.net/10388/17546