{"id":{"repo_id":"cornell","oai_identifier":"oai:ecommons.cornell.edu:1813/121055"},"canonical_url":"https://search.ndltd.org/etd/cornell/oai:ecommons.cornell.edu:1813/121055","repository":{"repo_id":"cornell","name":"Cornell University","base_url":"https://ecommons.cornell.edu/server/oai/request"},"display":{"title":"Fine-grained wireless perception for human tracking","abstract":"In the network and mobile system community, wireless perception is an active field of research that uses wireless signals for motion tracking, such as ultrasound, mmWave, and WiFi. It enables applications like gesture recognition, breath rate and heart rate detection, intrusion detection, mixed reality (MR) interaction, etc.This dissertation focus on wireless perception for human tracking, addressing key challenges in accuracy, practicality, and scalability towards fine-grained tracking using deep learning. First, we develop an acoustic sensing system, Beyond-Voice, that enables commodity devices to track 3D hand poses with millimeter precision using only built-in microphones and speakers. Next, we aim to dive deep into the individual building blocks in such wireless perception systems and develop methods that can be reused. To elaborate, we tackle the interference problem between acoustic sensing and concurrent audio playback with CoPlay, a deep learning–based optimization method that preserves both sensing performance and media quality. To reduce costly data collection and improve model generalization, we propose WixUp, a audio-agnostic data augmentation framework applicable to both acoustic and mmWave sensing, also enabling unsupervised domain adaptation. Finally, I extend the sensing range to egocentric full-body tracking in mixed reality headset with BodyWave, a mmWave radar–based system that overcomes camera occlusion limitations while maintaining competitive accuracy. Together, these contributions bring wireless perception closer to practical, robust, and privacy-preserving human tracking in real-world environments.","abstract_html":"In the network and mobile system community, wireless perception is an active field of research that uses wireless signals for motion tracking, such as ultrasound, mmWave, and WiFi. It enables applications like gesture recognition, breath rate and heart rate detection, intrusion detection, mixed reality (MR) interaction, etc.This dissertation focus on wireless perception for human tracking, addressing key challenges in accuracy, practicality, and scalability towards fine-grained tracking using deep learning. First, we develop an acoustic sensing system, Beyond-Voice, that enables commodity devices to track 3D hand poses with millimeter precision using only built-in microphones and speakers. Next, we aim to dive deep into the individual building blocks in such wireless perception systems and develop methods that can be reused. To elaborate, we tackle the interference problem between acoustic sensing and concurrent audio playback with CoPlay, a deep learning–based optimization method that preserves both sensing performance and media quality. To reduce costly data collection and improve model generalization, we propose WixUp, a audio-agnostic data augmentation framework applicable to both acoustic and mmWave sensing, also enabling unsupervised domain adaptation. Finally, I extend the sensing range to egocentric full-body tracking in mixed reality headset with BodyWave, a mmWave radar–based system that overcomes camera occlusion limitations while maintaining competitive accuracy. Together, these contributions bring wireless perception closer to practical, robust, and privacy-preserving human tracking in real-world environments.","abstract_has_math":false,"creators":["Li, Yin"],"institution":"Cornell University","degree_name":"Ph. D., Information Science","degree_level":"Doctor of Philosophy","degree_discipline":"Information Science","degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":["Nandakumar, Rajalakshmi"],"committee_members":["Choudhury, Tanzeem","Zhang, Cheng"],"year":2025,"date_issued":"2025-12","date_published":"2025-12","updated_at":"2026-11-19T03:13:28Z","subjects":["body tracking","machine perception","mobile system","wireless perception"],"languages":["en"],"rights":["Attribution-NonCommercial-ShareAlike 4.0 International"],"rights_urls":["https://creativecommons.org/licenses/by-nc-sa/4.0/"],"identifier_entries":[{"key":"dc:identifier.doi","label":"DOI","values":["https://doi.org/10.7298/kmgr-ar64"],"render_values":[{"text":"https://doi.org/10.7298/kmgr-ar64","href":"https://doi.org/10.7298/kmgr-ar64","code":true}]},{"key":"dc:identifier.bibid","label":"Dc Identifier Bibid","values":["17423284"],"render_values":[{"text":"17423284","href":null,"code":true}]},{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["ProQuest Submission ID: 15289","ProQuest Publication ID: 32244081"],"render_values":[{"text":"ProQuest Submission ID: 15289","href":null,"code":true},{"text":"ProQuest Publication ID: 32244081","href":null,"code":true}]}],"person_identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/1813/121055","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"https://hdl.handle.net/1813/121055","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://ecommons.cornell.edu/server/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Aecommons.cornell.edu%3A1813%2F121055","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.chair","label":"Chair","values":["Nandakumar, Rajalakshmi"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Choudhury, Tanzeem","Zhang, Cheng"]},{"key":"dc:creator","label":"Author","values":["Li, Yin"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2026-04-03T18:52:44Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2026-04-03T18:52:44Z"]},{"key":"dc:date.issued","label":"Date","values":["2025-12"]},{"key":"dc:type","label":"Dc Type","values":["dissertation or thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Information Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Doctor of Philosophy"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph. D., Information Science"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Cornell University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["body tracking","machine perception","mobile system","wireless perception"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Attribution-NonCommercial-ShareAlike 4.0 International"]},{"key":"dc:rights.uri","label":"Rights URI","values":["https://creativecommons.org/licenses/by-nc-sa/4.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.bibid","label":"Dc Identifier Bibid","values":["17423284"]},{"key":"dc:identifier.doi","label":"DOI","values":["https://doi.org/10.7298/kmgr-ar64"]},{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["ProQuest Submission ID: 15289","ProQuest Publication ID: 32244081"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1813/121055"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"cerif:openaire","label":"Cerif Openaire","values":["<Publication xmlns=\"https://www.openaire.eu/cerif-profile/1.1/\" id=\"7aaa49bf-1a8c-4e47-a632-ad94e6250970\"> <Type xmlns=\"https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types\">http://purl.org/coar/resource_type/c_1843</Type> <Language>en</Language> <Title>Fine-grained wireless perception for human tracking</Title> <PublishedIn> <Publication> </Publication> </PublishedIn> <PublicationDate>2025-12</PublicationDate> <DOI>https://doi.org/10.7298/kmgr-ar64</DOI> <Authors> <Author> <DisplayName>Li, Yin</DisplayName> <Affiliation> <OrgUnit> </OrgUnit> </Affiliation> </Author> </Authors> <Editors> </Editors> <Publishers> <Publisher> <OrgUnit /> </Publisher> </Publishers> <License>https://creativecommons.org/licenses/by-nc-sa/4.0/</License> <Keyword>body tracking</Keyword> <Keyword>machine perception</Keyword> <Keyword>mobile system</Keyword> <Keyword>wireless perception</Keyword> <Abstract>In the network and mobile system community, wireless perception is an active field of research that uses wireless signals for motion tracking, such as ultrasound, mmWave, and WiFi. It enables applications like gesture recognition, breath rate and heart rate detection, intrusion detection, mixed reality (MR) interaction, etc.This dissertation focus on wireless perception for human tracking, addressing key challenges in accuracy, practicality, and scalability towards fine-grained tracking using deep learning. First, we develop an acoustic sensing system, Beyond-Voice, that enables commodity devices to track 3D hand poses with millimeter precision using only built-in microphones and speakers. Next, we aim to dive deep into the individual building blocks in such wireless perception systems and develop methods that can be reused. To elaborate, we tackle the interference problem between acoustic sensing and concurrent audio playback with CoPlay, a deep learning–based optimization method that preserves both sensing performance and media quality. To reduce costly data collection and improve model generalization, we propose WixUp, a audio-agnostic data augmentation framework applicable to both acoustic and mmWave sensing, also enabling unsupervised domain adaptation. Finally, I extend the sensing range to egocentric full-body tracking in mixed reality headset with BodyWave, a mmWave radar–based system that overcomes camera occlusion limitations while maintaining competitive accuracy. Together, these contributions bring wireless perception closer to practical, robust, and privacy-preserving human tracking in real-world environments.</Abstract> <Access xmlns=\"http://purl.org/coar/access_right\" > </Access> </Publication>"]},{"key":"cris:virtual.author","label":"Cris Virtual Author","values":["Li, Yin"]},{"key":"cris:virtualsource.collection","label":"Cris Virtualsource Collection","values":["5893a6ea-7af3-41d7-abc6-04bcd26ab5df"]},{"key":"dc:description","label":"Description","values":["160 pages"]},{"key":"dc:description.abstract","label":"Abstract","values":["In the network and mobile system community, wireless perception is an active field of research that uses wireless signals for motion tracking, such as ultrasound, mmWave, and WiFi. It enables applications like gesture recognition, breath rate and heart rate detection, intrusion detection, mixed reality (MR) interaction, etc.This dissertation focus on wireless perception for human tracking, addressing key challenges in accuracy, practicality, and scalability towards fine-grained tracking using deep learning. First, we develop an acoustic sensing system, Beyond-Voice, that enables commodity devices to track 3D hand poses with millimeter precision using only built-in microphones and speakers. Next, we aim to dive deep into the individual building blocks in such wireless perception systems and develop methods that can be reused. To elaborate, we tackle the interference problem between acoustic sensing and concurrent audio playback with CoPlay, a deep learning–based optimization method that preserves both sensing performance and media quality. To reduce costly data collection and improve model generalization, we propose WixUp, a audio-agnostic data augmentation framework applicable to both acoustic and mmWave sensing, also enabling unsupervised domain adaptation. Finally, I extend the sensing range to egocentric full-body tracking in mixed reality headset with BodyWave, a mmWave radar–based system that overcomes camera occlusion limitations while maintaining competitive accuracy. Together, these contributions bring wireless perception closer to practical, robust, and privacy-preserving human tracking in real-world environments."]},{"key":"dc:description.collection","label":"Dc Description Collection","values":["Cornell Theses and Dissertations"]},{"key":"dc:format.mimetype","label":"Dc Format Mimetype","values":["application/pdf"]},{"key":"dcterms:license","label":"Dcterms License","values":["https://hdl.handle.net/1813/59810.2"]},{"key":"dc:title","label":"Title","values":["Fine-grained wireless perception for human tracking"]},{"key":"dspace:entity.type","label":"Dspace Entity Type","values":["Publication"]},{"key":"others:access_status","label":"Others Access Status","values":["open.access"]}]}],"canonical_facts":{"cerif:openaire":["<Publication xmlns=\"https://www.openaire.eu/cerif-profile/1.1/\" id=\"7aaa49bf-1a8c-4e47-a632-ad94e6250970\"> <Type xmlns=\"https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types\">http://purl.org/coar/resource_type/c_1843</Type> <Language>en</Language> <Title>Fine-grained wireless perception for human tracking</Title> <PublishedIn> <Publication> </Publication> </PublishedIn> <PublicationDate>2025-12</PublicationDate> <DOI>https://doi.org/10.7298/kmgr-ar64</DOI> <Authors> <Author> <DisplayName>Li, Yin</DisplayName> <Affiliation> <OrgUnit> </OrgUnit> </Affiliation> </Author> </Authors> <Editors> </Editors> <Publishers> <Publisher> <OrgUnit /> </Publisher> </Publishers> <License>https://creativecommons.org/licenses/by-nc-sa/4.0/</License> <Keyword>body tracking</Keyword> <Keyword>machine perception</Keyword> <Keyword>mobile system</Keyword> <Keyword>wireless perception</Keyword> <Abstract>In the network and mobile system community, wireless perception is an active field of research that uses wireless signals for motion tracking, such as ultrasound, mmWave, and WiFi. It enables applications like gesture recognition, breath rate and heart rate detection, intrusion detection, mixed reality (MR) interaction, etc.This dissertation focus on wireless perception for human tracking, addressing key challenges in accuracy, practicality, and scalability towards fine-grained tracking using deep learning. First, we develop an acoustic sensing system, Beyond-Voice, that enables commodity devices to track 3D hand poses with millimeter precision using only built-in microphones and speakers. Next, we aim to dive deep into the individual building blocks in such wireless perception systems and develop methods that can be reused. To elaborate, we tackle the interference problem between acoustic sensing and concurrent audio playback with CoPlay, a deep learning–based optimization method that preserves both sensing performance and media quality. To reduce costly data collection and improve model generalization, we propose WixUp, a audio-agnostic data augmentation framework applicable to both acoustic and mmWave sensing, also enabling unsupervised domain adaptation. Finally, I extend the sensing range to egocentric full-body tracking in mixed reality headset with BodyWave, a mmWave radar–based system that overcomes camera occlusion limitations while maintaining competitive accuracy. Together, these contributions bring wireless perception closer to practical, robust, and privacy-preserving human tracking in real-world environments.</Abstract> <Access xmlns=\"http://purl.org/coar/access_right\" > </Access> </Publication>"],"cris:virtual.author":["Li, Yin"],"cris:virtualsource.collection":["5893a6ea-7af3-41d7-abc6-04bcd26ab5df"],"dc:contributor.chair":["Nandakumar, Rajalakshmi"],"dc:contributor.committeemember":["Choudhury, Tanzeem","Zhang, Cheng"],"dc:creator":["Li, Yin"],"dc:date.accessioned":["2026-04-03T18:52:44Z"],"dc:date.available":["2026-04-03T18:52:44Z"],"dc:date.issued":["2025-12"],"dc:description":["160 pages"],"dc:description.abstract":["In the network and mobile system community, wireless perception is an active field of research that uses wireless signals for motion tracking, such as ultrasound, mmWave, and WiFi. It enables applications like gesture recognition, breath rate and heart rate detection, intrusion detection, mixed reality (MR) interaction, etc.This dissertation focus on wireless perception for human tracking, addressing key challenges in accuracy, practicality, and scalability towards fine-grained tracking using deep learning. First, we develop an acoustic sensing system, Beyond-Voice, that enables commodity devices to track 3D hand poses with millimeter precision using only built-in microphones and speakers. Next, we aim to dive deep into the individual building blocks in such wireless perception systems and develop methods that can be reused. To elaborate, we tackle the interference problem between acoustic sensing and concurrent audio playback with CoPlay, a deep learning–based optimization method that preserves both sensing performance and media quality. To reduce costly data collection and improve model generalization, we propose WixUp, a audio-agnostic data augmentation framework applicable to both acoustic and mmWave sensing, also enabling unsupervised domain adaptation. Finally, I extend the sensing range to egocentric full-body tracking in mixed reality headset with BodyWave, a mmWave radar–based system that overcomes camera occlusion limitations while maintaining competitive accuracy. Together, these contributions bring wireless perception closer to practical, robust, and privacy-preserving human tracking in real-world environments."],"dc:description.collection":["Cornell Theses and Dissertations"],"dc:format.mimetype":["application/pdf"],"dc:identifier.bibid":["17423284"],"dc:identifier.doi":["https://doi.org/10.7298/kmgr-ar64"],"dc:identifier.other":["ProQuest Submission ID: 15289","ProQuest Publication ID: 32244081"],"dc:identifier.uri":["https://hdl.handle.net/1813/121055"],"dc:language.iso":["en"],"dc:rights":["Attribution-NonCommercial-ShareAlike 4.0 International"],"dc:rights.uri":["https://creativecommons.org/licenses/by-nc-sa/4.0/"],"dc:subject":["body tracking","machine perception","mobile system","wireless perception"],"dcterms:license":["https://hdl.handle.net/1813/59810.2"],"dc:title":["Fine-grained wireless perception for human tracking"],"dc:type":["dissertation or thesis"],"dspace:entity.type":["Publication"],"others:access_status":["open.access"],"thesis:degree_discipline":["Information Science"],"thesis:degree_level":["Doctor of Philosophy"],"thesis:degree_name":["Ph. D., Information Science"],"thesis:institution_name":["Cornell University"]},"updated_at":"2026-11-19T03:13:28Z"}