{"id":{"repo_id":"bu","oai_identifier":"oai:open.bu.edu:2144/53302"},"canonical_url":"https://search.ndltd.org/etd/bu/oai:open.bu.edu:2144/53302","repository":{"repo_id":"bu","name":"Boston University","base_url":"https://open.bu.edu/oai/request"},"display":{"title":"Controllable human image synthesis and editing","abstract":"Controllable human image synthesis is a computer vision task that aims to produce realistic human images while allowing precise manipulation of various attributes, including posture, clothing style, and garment textures. This process involves modifying specific parts of an image based on given conditions, such as fitting a new garment onto a person or altering their hair color. Despite significant progress in this field, two major challenges persist: data limitation and the intricate trade-off between texture control and image quality preservation. The training of controllable human image synthesis models typically requires data of paired images, showcasing subjects before and after specified manipulations (e.g., the same person in pose A and pose B). However, collecting such data would be difficult due to several factors, including copyright restrictions, brand protection concerns, and the inherent difficulty in gathering high-quality, diverse data. Consequently, existing datasets are often limited in scale and variety, which can restrict the generalizability and performance of trained models. While alternative approaches using unpaired data have been explored, these methods introduce additional complexity from unsupervised feature disentanglement. Moreover, another significant challenge in this field is striking the optimal balance between texture control and overall image quality preservation. Manipulating clothing textures to match given conditions, such as new postures or clothing styles, often results in a degradation of overall image quality and authenticity. This trade-off is particularly pronounced in geometric-related manipulations, where maintaining the structural integrity of the human body while implementing desired changes proves exceptionally challenging. Despite numerous efforts in prior work, attaining a high level of controllability without compromising image quality and authenticity remains an unresolved problem. This dissertation presents a comprehensive exploration of these challenges, developing targeted approaches across three key applications: attribute manipulation, pose transfer, and virtual try-on. In Chapter 3, we propose an attribute manipulation approach that can modify certain attributes of the individual while preserving other content unchanged. This is achieved through label-driven feature disentanglement, allowing for precise control over individual image attributes. In Chapter 4, we address the data limitation challenge in the pose transfer application. We propose a data-efficient, self-supervised pose transfer method that achieves accurate appearance transfer without paired human images. This approach significantly reduces the reliance on large, paired datasets, making our method more accessible and scalable. Next, in Chapter 5, we focus on refining the texture of synthesized try-on human images through two avenues: augmenting training data with cost-effective synthetic data and developing an error-aware refinement-based Schrödinger Bridge model. Finally, in Chapter 6, we present a multi-task model capable of performing various human image editing tasks, including prompt-based manipulation, pose transfer, and virtual try-on. Our experiment results on these tasks demonstrate the effectiveness of the proposed approaches. Collectively, we improve the image quality of synthesized human images while achieving precise manipulation of various attributes in the image.","abstract_html":"Controllable human image synthesis is a computer vision task that aims to produce realistic human images while allowing precise manipulation of various attributes, including posture, clothing style, and garment textures. This process involves modifying specific parts of an image based on given conditions, such as fitting a new garment onto a person or altering their hair color. Despite significant progress in this field, two major challenges persist: data limitation and the intricate trade-off between texture control and image quality preservation. The training of controllable human image synthesis models typically requires data of paired images, showcasing subjects before and after specified manipulations (e.g., the same person in pose A and pose B). However, collecting such data would be difficult due to several factors, including copyright restrictions, brand protection concerns, and the inherent difficulty in gathering high-quality, diverse data. Consequently, existing datasets are often limited in scale and variety, which can restrict the generalizability and performance of trained models. While alternative approaches using unpaired data have been explored, these methods introduce additional complexity from unsupervised feature disentanglement. Moreover, another significant challenge in this field is striking the optimal balance between texture control and overall image quality preservation. Manipulating clothing textures to match given conditions, such as new postures or clothing styles, often results in a degradation of overall image quality and authenticity. This trade-off is particularly pronounced in geometric-related manipulations, where maintaining the structural integrity of the human body while implementing desired changes proves exceptionally challenging. Despite numerous efforts in prior work, attaining a high level of controllability without compromising image quality and authenticity remains an unresolved problem. This dissertation presents a comprehensive exploration of these challenges, developing targeted approaches across three key applications: attribute manipulation, pose transfer, and virtual try-on. In Chapter 3, we propose an attribute manipulation approach that can modify certain attributes of the individual while preserving other content unchanged. This is achieved through label-driven feature disentanglement, allowing for precise control over individual image attributes. In Chapter 4, we address the data limitation challenge in the pose transfer application. We propose a data-efficient, self-supervised pose transfer method that achieves accurate appearance transfer without paired human images. This approach significantly reduces the reliance on large, paired datasets, making our method more accessible and scalable. Next, in Chapter 5, we focus on refining the texture of synthesized try-on human images through two avenues: augmenting training data with cost-effective synthetic data and developing an error-aware refinement-based Schrödinger Bridge model. Finally, in Chapter 6, we present a multi-task model capable of performing various human image editing tasks, including prompt-based manipulation, pose transfer, and virtual try-on. Our experiment results on these tasks demonstrate the effectiveness of the proposed approaches. Collectively, we improve the image quality of synthesized human images while achieving precise manipulation of various attributes in the image.","abstract_has_math":false,"creators":["Li, Nannan"],"institution":"Boston University","degree_name":"Doctor of Philosophy","degree_level":"doctoral","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":[],"advisors":["Plummer, Bryan"],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025","date_published":"2025","updated_at":"2026-11-18T20:04:52Z","subjects":["Computer science","Human image","Image editing","Image generation"],"languages":["en_US"],"rights":["Attribution 4.0 International"],"rights_urls":["http://creativecommons.org/licenses/by/4.0/"],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2144/53302","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"https://hdl.handle.net/2144/53302","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://open.bu.edu/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Aopen.bu.edu%3A2144%2F53302","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Plummer, Bryan"]},{"key":"dc:creator","label":"Author","values":["Li, Nannan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2026-07-13T14:55:04Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2026-07-13T14:55:04Z"]},{"key":"dc:date.issued","label":"Date","values":["2025"]},{"key":"dc:date.updated","label":"Dc Date Updated","values":["2026-07-10T19:15:31Z"]},{"key":"dc:type","label":"Dc Type","values":["Thesis/Dissertation"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["doctoral"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Boston University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Computer science","Human image","Image editing","Image generation"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en_US"]},{"key":"dc:rights","label":"Dc Rights","values":["Attribution 4.0 International"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://creativecommons.org/licenses/by/4.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/2144/53302"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["2025"]},{"key":"dc:description.abstract","label":"Abstract","values":["Controllable human image synthesis is a computer vision task that aims to produce realistic human images while allowing precise manipulation of various attributes, including posture, clothing style, and garment textures. This process involves modifying specific parts of an image based on given conditions, such as fitting a new garment onto a person or altering their hair color. Despite significant progress in this field, two major challenges persist: data limitation and the intricate trade-off between texture control and image quality preservation. The training of controllable human image synthesis models typically requires data of paired images, showcasing subjects before and after specified manipulations (e.g., the same person in pose A and pose B). However, collecting such data would be difficult due to several factors, including copyright restrictions, brand protection concerns, and the inherent difficulty in gathering high-quality, diverse data. Consequently, existing datasets are often limited in scale and variety, which can restrict the generalizability and performance of trained models. While alternative approaches using unpaired data have been explored, these methods introduce additional complexity from unsupervised feature disentanglement. Moreover, another significant challenge in this field is striking the optimal balance between texture control and overall image quality preservation. Manipulating clothing textures to match given conditions, such as new postures or clothing styles, often results in a degradation of overall image quality and authenticity. This trade-off is particularly pronounced in geometric-related manipulations, where maintaining the structural integrity of the human body while implementing desired changes proves exceptionally challenging. Despite numerous efforts in prior work, attaining a high level of controllability without compromising image quality and authenticity remains an unresolved problem. This dissertation presents a comprehensive exploration of these challenges, developing targeted approaches across three key applications: attribute manipulation, pose transfer, and virtual try-on. In Chapter 3, we propose an attribute manipulation approach that can modify certain attributes of the individual while preserving other content unchanged. This is achieved through label-driven feature disentanglement, allowing for precise control over individual image attributes. In Chapter 4, we address the data limitation challenge in the pose transfer application. We propose a data-efficient, self-supervised pose transfer method that achieves accurate appearance transfer without paired human images. This approach significantly reduces the reliance on large, paired datasets, making our method more accessible and scalable. Next, in Chapter 5, we focus on refining the texture of synthesized try-on human images through two avenues: augmenting training data with cost-effective synthetic data and developing an error-aware refinement-based Schrödinger Bridge model. Finally, in Chapter 6, we present a multi-task model capable of performing various human image editing tasks, including prompt-based manipulation, pose transfer, and virtual try-on. Our experiment results on these tasks demonstrate the effectiveness of the proposed approaches. Collectively, we improve the image quality of synthesized human images while achieving precise manipulation of various attributes in the image."]},{"key":"dc:title","label":"Title","values":["Controllable human image synthesis and editing"]}]}],"canonical_facts":{"dc:contributor.advisor":["Plummer, Bryan"],"dc:creator":["Li, Nannan"],"dc:date.accessioned":["2026-07-13T14:55:04Z"],"dc:date.available":["2026-07-13T14:55:04Z"],"dc:date.issued":["2025"],"dc:date.updated":["2026-07-10T19:15:31Z"],"dc:description":["2025"],"dc:description.abstract":["Controllable human image synthesis is a computer vision task that aims to produce realistic human images while allowing precise manipulation of various attributes, including posture, clothing style, and garment textures. This process involves modifying specific parts of an image based on given conditions, such as fitting a new garment onto a person or altering their hair color. Despite significant progress in this field, two major challenges persist: data limitation and the intricate trade-off between texture control and image quality preservation. The training of controllable human image synthesis models typically requires data of paired images, showcasing subjects before and after specified manipulations (e.g., the same person in pose A and pose B). However, collecting such data would be difficult due to several factors, including copyright restrictions, brand protection concerns, and the inherent difficulty in gathering high-quality, diverse data. Consequently, existing datasets are often limited in scale and variety, which can restrict the generalizability and performance of trained models. While alternative approaches using unpaired data have been explored, these methods introduce additional complexity from unsupervised feature disentanglement. Moreover, another significant challenge in this field is striking the optimal balance between texture control and overall image quality preservation. Manipulating clothing textures to match given conditions, such as new postures or clothing styles, often results in a degradation of overall image quality and authenticity. This trade-off is particularly pronounced in geometric-related manipulations, where maintaining the structural integrity of the human body while implementing desired changes proves exceptionally challenging. Despite numerous efforts in prior work, attaining a high level of controllability without compromising image quality and authenticity remains an unresolved problem. This dissertation presents a comprehensive exploration of these challenges, developing targeted approaches across three key applications: attribute manipulation, pose transfer, and virtual try-on. In Chapter 3, we propose an attribute manipulation approach that can modify certain attributes of the individual while preserving other content unchanged. This is achieved through label-driven feature disentanglement, allowing for precise control over individual image attributes. In Chapter 4, we address the data limitation challenge in the pose transfer application. We propose a data-efficient, self-supervised pose transfer method that achieves accurate appearance transfer without paired human images. This approach significantly reduces the reliance on large, paired datasets, making our method more accessible and scalable. Next, in Chapter 5, we focus on refining the texture of synthesized try-on human images through two avenues: augmenting training data with cost-effective synthetic data and developing an error-aware refinement-based Schrödinger Bridge model. Finally, in Chapter 6, we present a multi-task model capable of performing various human image editing tasks, including prompt-based manipulation, pose transfer, and virtual try-on. Our experiment results on these tasks demonstrate the effectiveness of the proposed approaches. Collectively, we improve the image quality of synthesized human images while achieving precise manipulation of various attributes in the image."],"dc:identifier.uri":["https://hdl.handle.net/2144/53302"],"dc:language.iso":["en_US"],"dc:rights":["Attribution 4.0 International"],"dc:rights.uri":["http://creativecommons.org/licenses/by/4.0/"],"dc:subject":["Computer science","Human image","Image editing","Image generation"],"dc:title":["Controllable human image synthesis and editing"],"dc:type":["Thesis/Dissertation"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["doctoral"],"thesis:degree_name":["Doctor of Philosophy"],"thesis:institution_name":["Boston University"]},"updated_at":"2026-11-18T20:04:52Z"}