{"id":{"repo_id":"msu","oai_identifier":"oai:d.lib.msu.edu:etd_50821"},"canonical_url":"https://search.ndltd.org/etd/msu/oai:d.lib.msu.edu:etd_50821","repository":{"repo_id":"msu","name":"Michigan State University","base_url":"https://d.lib.msu.edu/oai"},"display":{"title":"New perspectives in neural architecture search : architecture embeddings, efficient performance estimations, and their applications","abstract":"Neural architecture search (NAS) has made significant strides in recent years, but challenges remain in terms of the stability of search performance and the high computational requirements of sampling-based NAS. Studying architecture representations offers a promising solution to these challenges, as it encourages neural architectures with similar structures or computations to cluster together. This helps to map neural architectures with similar performance to the same regions in the latent space and leads to smoother transitions in the latent space, benefiting downstream search. Additionally, learning curve extrapolation can accelerate the search process by estimating the final validation accuracy of a neural network from the learning curve of a partially trained network. Overall, understanding the neural architecture representations and their associated learning curves through theoretical analysis and empirical evaluations is crucial for achieving stable and scalable NAS.This dissertation presents our contributions to the field of neural architecture search (NAS), which push the limits of NAS and achieve state-of-the-art performance. Our contributions include efficient one-shot NAS via hierarchical masking, addressing the joint optimization problem of architecture representations and search through unsupervised pre-training, improving the generalization ability of architecture representations with computation-aware self-supervised training, and developing a method for facilitating multi-fidelity NAS research.","abstract_html":"Neural architecture search (NAS) has made significant strides in recent years, but challenges remain in terms of the stability of search performance and the high computational requirements of sampling-based NAS. Studying architecture representations offers a promising solution to these challenges, as it encourages neural architectures with similar structures or computations to cluster together. This helps to map neural architectures with similar performance to the same regions in the latent space and leads to smoother transitions in the latent space, benefiting downstream search. Additionally, learning curve extrapolation can accelerate the search process by estimating the final validation accuracy of a neural network from the learning curve of a partially trained network. Overall, understanding the neural architecture representations and their associated learning curves through theoretical analysis and empirical evaluations is crucial for achieving stable and scalable NAS.This dissertation presents our contributions to the field of neural architecture search (NAS), which push the limits of NAS and achieve state-of-the-art performance. Our contributions include efficient one-shot NAS via hierarchical masking, addressing the joint optimization problem of architecture representations and search through unsupervised pre-training, improving the generalization ability of architecture representations with computation-aware self-supervised training, and developing a method for facilitating multi-fidelity NAS research.","abstract_has_math":false,"creators":["Yan, Shen (Graduate of Michigan State University)"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":["Zhang, Mi"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022","date_published":"2022","updated_at":"2026-11-18T18:57:11Z","subjects":["Computer science","Artificial intelligence","Neural networks (Computer science)"],"languages":["English"],"rights":["Attribution-NonCommercial 4.0 International"],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["etd:50821","isbn:9798358499805","oclc:on1373601787","oclc:1373601787","umi:29993270","local:Yan_grad.msu_0128D_19493"],"render_values":[{"text":"etd:50821","href":null,"code":true},{"text":"isbn:9798358499805","href":null,"code":true},{"text":"oclc:on1373601787","href":null,"code":true},{"text":"oclc:1373601787","href":null,"code":true},{"text":"umi:29993270","href":null,"code":true},{"text":"local:Yan_grad.msu_0128D_19493","href":null,"code":true}]}],"person_identifier_entries":[]},"links":{"outbound_url":"https://doi.org/doi:10.25335/xyr7-mj54","outbound_label":"DOI","outbound_source":"dc:identifier","record_url":"https://doi.org/doi:10.25335/xyr7-mj54","record_label":"Repository record","record_kind":"doi","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://d.lib.msu.edu/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Ad.lib.msu.edu%3Aetd_50821","prefix":"oai_dc"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Zhang, Mi"]},{"key":"dc:creator","label":"Author","values":["Yan, Shen (Graduate of Michigan State University)"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022"]},{"key":"dc:relation","label":"Dc Relation","values":["Electronic Theses & Dissertations"]},{"key":"dc:type","label":"Dc Type","values":["Text","Theses"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Computer science","Artificial intelligence","Neural networks (Computer science)"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["English"]},{"key":"dc:rights","label":"Dc Rights","values":["Attribution-NonCommercial 4.0 International"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["etd:50821","isbn:9798358499805","oclc:on1373601787","oclc:1373601787","umi:29993270","local:Yan_grad.msu_0128D_19493","https://doi.org/doi:10.25335/xyr7-mj54"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Neural architecture search (NAS) has made significant strides in recent years, but challenges remain in terms of the stability of search performance and the high computational requirements of sampling-based NAS. Studying architecture representations offers a promising solution to these challenges, as it encourages neural architectures with similar structures or computations to cluster together. This helps to map neural architectures with similar performance to the same regions in the latent space and leads to smoother transitions in the latent space, benefiting downstream search. Additionally, learning curve extrapolation can accelerate the search process by estimating the final validation accuracy of a neural network from the learning curve of a partially trained network. Overall, understanding the neural architecture representations and their associated learning curves through theoretical analysis and empirical evaluations is crucial for achieving stable and scalable NAS.This dissertation presents our contributions to the field of neural architecture search (NAS), which push the limits of NAS and achieve state-of-the-art performance. Our contributions include efficient one-shot NAS via hierarchical masking, addressing the joint optimization problem of architecture representations and search through unsupervised pre-training, improving the generalization ability of architecture representations with computation-aware self-supervised training, and developing a method for facilitating multi-fidelity NAS research.","Thesis (Ph. D.)--Michigan State University. Computer Science, 2022","Includes bibliographical references (pages 104-116)"]},{"key":"dc:format","label":"Dc Format","values":["vi, 116 pages","application/pdf"]},{"key":"dc:title","label":"Title","values":["New perspectives in neural architecture search : architecture embeddings, efficient performance estimations, and their applications"]}]}],"canonical_facts":{"dc:contributor":["Zhang, Mi"],"dc:creator":["Yan, Shen (Graduate of Michigan State University)"],"dc:date":["2022"],"dc:description":["Neural architecture search (NAS) has made significant strides in recent years, but challenges remain in terms of the stability of search performance and the high computational requirements of sampling-based NAS. Studying architecture representations offers a promising solution to these challenges, as it encourages neural architectures with similar structures or computations to cluster together. This helps to map neural architectures with similar performance to the same regions in the latent space and leads to smoother transitions in the latent space, benefiting downstream search. Additionally, learning curve extrapolation can accelerate the search process by estimating the final validation accuracy of a neural network from the learning curve of a partially trained network. Overall, understanding the neural architecture representations and their associated learning curves through theoretical analysis and empirical evaluations is crucial for achieving stable and scalable NAS.This dissertation presents our contributions to the field of neural architecture search (NAS), which push the limits of NAS and achieve state-of-the-art performance. Our contributions include efficient one-shot NAS via hierarchical masking, addressing the joint optimization problem of architecture representations and search through unsupervised pre-training, improving the generalization ability of architecture representations with computation-aware self-supervised training, and developing a method for facilitating multi-fidelity NAS research.","Thesis (Ph. D.)--Michigan State University. Computer Science, 2022","Includes bibliographical references (pages 104-116)"],"dc:format":["vi, 116 pages","application/pdf"],"dc:identifier":["etd:50821","isbn:9798358499805","oclc:on1373601787","oclc:1373601787","umi:29993270","local:Yan_grad.msu_0128D_19493","https://doi.org/doi:10.25335/xyr7-mj54"],"dc:language":["English"],"dc:relation":["Electronic Theses & Dissertations"],"dc:rights":["Attribution-NonCommercial 4.0 International"],"dc:subject":["Computer science","Artificial intelligence","Neural networks (Computer science)"],"dc:title":["New perspectives in neural architecture search : architecture embeddings, efficient performance estimations, and their applications"],"dc:type":["Text","Theses"]},"updated_at":"2026-11-18T18:57:11Z"}