{"id":{"repo_id":"birmingham","oai_identifier":"oai:etheses.bham.ac.uk:14922"},"canonical_url":"https://search.ndltd.org/etd/birmingham/oai:etheses.bham.ac.uk:14922","repository":{"repo_id":"birmingham","name":"University of Birmingham","base_url":"https://etheses.bham.ac.uk/cgi/oai2"},"display":{"title":"Advancing multi-domain active learning: strategies and techniques using neural networks for classiﬁcation","abstract":"Dealing with data collected from various domains has emerged as a pervasive challenge in machine learning applications, necessitating the use of multi-domain learning (MDL) to efficiently process and learn from the collected multi-domain data, which have different distributions. Nevertheless, constructing high-quality annotated multi-domain datasets can be both challenging and expensive due to the difficulties in accessing multiple domain experts. Active learning (AL) provides a potential solution to this issue, effectively reducing labeling costs by only selecting and acquiring labels for the most informative data instances. However, conventional AL methods are not designed to handle multi-domain data and cannot be directly applied to multiple domains. Moreover, there is a notable scarcity of studies exploring the intersection of MDL and AL. To fill this gap, the focus of this thesis is on multi-domain active learning (MDAL), an innovative approach that combines active learning and multi-domain learning, enabling cost-effective learning through the use of neural networks. In this thesis, we first conduct a comprehensive review of AL and MDL research, formalizing the problem definitions and settings for MDAL. An open-source awesome active learning knowledge base is also developed to facilitate our research and the community. Second, to address the problem of MDAL, a unified pipeline is proposed to integrate conventional AL methods with neural network-based multi-domain learning models. Extensive comparative experiments reveal that certain model-strategy pairs yield strong performance empirically across domains. Third, to address model limitations under insufficient annotations, the thesis introduces a plug-and-play multi-domain contrastive learning method applicable to various MDL models under share-private architecture. Experimental results demonstrate significant improvement in model performance with insufficient annotations. Fourth, limitations of conventional AL methods in assessing domain-shared information motivate the development of tailored MDAL algorithms. From the labeling strategy perspective, a novel perturbation-based two-stage AL strategy is proposed to select informative cross-domain instances. This approach outperforms conventional methods by explicitly evaluating domain-shared information. Through formalizing the problem, extensive comparative analysis, and introducing new learning methods and strategies, this thesis advances the state-of-the-art in cost-effective MDAL using deep neural networks. The proposed techniques and findings provide valuable insights to facilitate future multi-domain learning applications with limited labeled data.","abstract_html":"Dealing with data collected from various domains has emerged as a pervasive challenge in machine learning applications, necessitating the use of multi-domain learning (MDL) to efficiently process and learn from the collected multi-domain data, which have different distributions. Nevertheless, constructing high-quality annotated multi-domain datasets can be both challenging and expensive due to the difficulties in accessing multiple domain experts. Active learning (AL) provides a potential solution to this issue, effectively reducing labeling costs by only selecting and acquiring labels for the most informative data instances. However, conventional AL methods are not designed to handle multi-domain data and cannot be directly applied to multiple domains. Moreover, there is a notable scarcity of studies exploring the intersection of MDL and AL. To fill this gap, the focus of this thesis is on multi-domain active learning (MDAL), an innovative approach that combines active learning and multi-domain learning, enabling cost-effective learning through the use of neural networks. In this thesis, we first conduct a comprehensive review of AL and MDL research, formalizing the problem definitions and settings for MDAL. An open-source awesome active learning knowledge base is also developed to facilitate our research and the community. Second, to address the problem of MDAL, a unified pipeline is proposed to integrate conventional AL methods with neural network-based multi-domain learning models. Extensive comparative experiments reveal that certain model-strategy pairs yield strong performance empirically across domains. Third, to address model limitations under insufficient annotations, the thesis introduces a plug-and-play multi-domain contrastive learning method applicable to various MDL models under share-private architecture. Experimental results demonstrate significant improvement in model performance with insufficient annotations. Fourth, limitations of conventional AL methods in assessing domain-shared information motivate the development of tailored MDAL algorithms. From the labeling strategy perspective, a novel perturbation-based two-stage AL strategy is proposed to select informative cross-domain instances. This approach outperforms conventional methods by explicitly evaluating domain-shared information. Through formalizing the problem, extensive comparative analysis, and introducing new learning methods and strategies, this thesis advances the state-of-the-art in cost-effective MDAL using deep neural networks. The proposed techniques and findings provide valuable insights to facilitate future multi-domain learning applications with limited labeled data.","abstract_has_math":false,"creators":["He, Rui"],"institution":"University of Birmingham","degree_name":"d_ph","degree_level":"d_ph","degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-07","date_published":"2024-07","updated_at":"2026-11-19T09:32:46Z","subjects":["QA75 Electronic computers. Computer science"],"languages":["eng"],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[{"key":"person:identifier.orcid","label":"ORCID","values":["0000000263381387"],"render_values":[{"text":"0000-0002-6338-1387","href":"https://orcid.org/0000-0002-6338-1387","code":true}]}]},"links":{"outbound_url":null,"outbound_label":null,"outbound_source":null,"record_url":null,"record_label":null,"record_kind":null,"record_source":null,"download_url":"http://etheses.bham.ac.uk//id/eprint/14922/1/He2024PhD.pdf","download_label":"Download PDF","download_source":"dc:identifier.uri","access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://etheses.bham.ac.uk/cgi/oai2?verb=GetRecord&metadataPrefix=uketd_dc&identifier=oai%3Aetheses.bham.ac.uk%3A14922","prefix":"uketd_dc"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.sponsor","label":"Sponsor","values":["na"]},{"key":"dc:creator","label":"Author","values":["He, Rui"]},{"key":"person:identifier.orcid","label":"ORCID","values":["0000000263381387"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-07-11"]},{"key":"dc:date.issued","label":"Date","values":["2024-07"]},{"key":"dc:publisher.department","label":"Dc Publisher Department","values":["College of Engineering & Physical Sciences","School of Computer Science"]},{"key":"dc:publisher.institution","label":"Dc Publisher Institution","values":["University of Birmingham"]},{"key":"dc:relation.isreferencedby","label":"Dc Relation Isreferencedby","values":["http://etheses.bham.ac.uk//id/eprint/14922/"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"dc:type.qualificationlevel","label":"Dc Type Qualificationlevel","values":["d_ph"]},{"key":"dc:type.qualificationname","label":"Dc Type Qualificationname","values":["d_ph"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["QA75 Electronic computers. Computer science"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.dcterms_iso639_2","label":"Language (ISO 639-2)","values":["eng"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://etheses.bham.ac.uk//id/eprint/14922/1/He2024PhD.pdf"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Dealing with data collected from various domains has emerged as a pervasive challenge in machine learning applications, necessitating the use of multi-domain learning (MDL) to efficiently process and learn from the collected multi-domain data, which have different distributions. Nevertheless, constructing high-quality annotated multi-domain datasets can be both challenging and expensive due to the difficulties in accessing multiple domain experts. Active learning (AL) provides a potential solution to this issue, effectively reducing labeling costs by only selecting and acquiring labels for the most informative data instances. However, conventional AL methods are not designed to handle multi-domain data and cannot be directly applied to multiple domains. Moreover, there is a notable scarcity of studies exploring the intersection of MDL and AL. To fill this gap, the focus of this thesis is on multi-domain active learning (MDAL), an innovative approach that combines active learning and multi-domain learning, enabling cost-effective learning through the use of neural networks. In this thesis, we first conduct a comprehensive review of AL and MDL research, formalizing the problem definitions and settings for MDAL. An open-source awesome active learning knowledge base is also developed to facilitate our research and the community. Second, to address the problem of MDAL, a unified pipeline is proposed to integrate conventional AL methods with neural network-based multi-domain learning models. Extensive comparative experiments reveal that certain model-strategy pairs yield strong performance empirically across domains. Third, to address model limitations under insufficient annotations, the thesis introduces a plug-and-play multi-domain contrastive learning method applicable to various MDL models under share-private architecture. Experimental results demonstrate significant improvement in model performance with insufficient annotations. Fourth, limitations of conventional AL methods in assessing domain-shared information motivate the development of tailored MDAL algorithms. From the labeling strategy perspective, a novel perturbation-based two-stage AL strategy is proposed to select informative cross-domain instances. This approach outperforms conventional methods by explicitly evaluating domain-shared information. Through formalizing the problem, extensive comparative analysis, and introducing new learning methods and strategies, this thesis advances the state-of-the-art in cost-effective MDAL using deep neural networks. The proposed techniques and findings provide valuable insights to facilitate future multi-domain learning applications with limited labeled data."]},{"key":"dc:format","label":"Dc Format","values":["text"]},{"key":"dcterms:accessrights","label":"Dcterms Accessrights","values":["public"]},{"key":"dc:title","label":"Title","values":["Advancing multi-domain active learning: strategies and techniques using neural networks for classiﬁcation"]}]}],"canonical_facts":{"dc:contributor.sponsor":["na"],"dc:creator":["He, Rui"],"dc:date":["2024-07-11"],"dc:date.issued":["2024-07"],"dc:description.abstract":["Dealing with data collected from various domains has emerged as a pervasive challenge in machine learning applications, necessitating the use of multi-domain learning (MDL) to efficiently process and learn from the collected multi-domain data, which have different distributions. Nevertheless, constructing high-quality annotated multi-domain datasets can be both challenging and expensive due to the difficulties in accessing multiple domain experts. Active learning (AL) provides a potential solution to this issue, effectively reducing labeling costs by only selecting and acquiring labels for the most informative data instances. However, conventional AL methods are not designed to handle multi-domain data and cannot be directly applied to multiple domains. Moreover, there is a notable scarcity of studies exploring the intersection of MDL and AL. To fill this gap, the focus of this thesis is on multi-domain active learning (MDAL), an innovative approach that combines active learning and multi-domain learning, enabling cost-effective learning through the use of neural networks. In this thesis, we first conduct a comprehensive review of AL and MDL research, formalizing the problem definitions and settings for MDAL. An open-source awesome active learning knowledge base is also developed to facilitate our research and the community. Second, to address the problem of MDAL, a unified pipeline is proposed to integrate conventional AL methods with neural network-based multi-domain learning models. Extensive comparative experiments reveal that certain model-strategy pairs yield strong performance empirically across domains. Third, to address model limitations under insufficient annotations, the thesis introduces a plug-and-play multi-domain contrastive learning method applicable to various MDL models under share-private architecture. Experimental results demonstrate significant improvement in model performance with insufficient annotations. Fourth, limitations of conventional AL methods in assessing domain-shared information motivate the development of tailored MDAL algorithms. From the labeling strategy perspective, a novel perturbation-based two-stage AL strategy is proposed to select informative cross-domain instances. This approach outperforms conventional methods by explicitly evaluating domain-shared information. Through formalizing the problem, extensive comparative analysis, and introducing new learning methods and strategies, this thesis advances the state-of-the-art in cost-effective MDAL using deep neural networks. The proposed techniques and findings provide valuable insights to facilitate future multi-domain learning applications with limited labeled data."],"dc:format":["text"],"dc:identifier.uri":["http://etheses.bham.ac.uk//id/eprint/14922/1/He2024PhD.pdf"],"dc:language.dcterms_iso639_2":["eng"],"dc:publisher.department":["College of Engineering & Physical Sciences","School of Computer Science"],"dc:publisher.institution":["University of Birmingham"],"dc:relation.isreferencedby":["http://etheses.bham.ac.uk//id/eprint/14922/"],"dc:subject":["QA75 Electronic computers. Computer science"],"dcterms:accessrights":["public"],"dc:title":["Advancing multi-domain active learning: strategies and techniques using neural networks for classiﬁcation"],"dc:type":["Thesis"],"dc:type.qualificationlevel":["d_ph"],"dc:type.qualificationname":["d_ph"],"person:identifier.orcid":["0000000263381387"]},"updated_at":"2026-11-19T09:32:46Z"}