{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-11723"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-11723","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Exploring Scalability of Multimodal User Interface Design in Virtual and Augmented Reality","abstract":"Use of Extended Reality (XR) technology such as Augmented Reality (AR) and Virtual Reality (VR) has experienced significant growth, with continuous advances in mobile technology and head-mounted display (HMD) headset development. As applications that span more than one type of reality have started to emerge, there is a need for additional research regarding the user interfaces (UIs) developed for these multimodal systems. While some work exists towards the creation of UI design guidelines in AR and in VR, little to no work has been done in providing recommendations for designing interfaces that work successfully across multiple XR modalities. To explore this, three studies were conducted using an existing military system, the Battlespace Visualization and Interaction (BVI) architecture. Interviews were conducted with User Experience (UX) experts to gain insights into key design aspects required across modalities, resulting in a set of five initial UI design recommendations for multimodal applications that provide guidance to researchers and developers in initial stages of XR interface design. Created rapid prototypes were tested in a remote usability study using Army subject-matter experts (SMEs) to determine additional considerations to mission planning requirements and inform iterative interface designs. Implemented UIs in AR and VR modalities were tested using active duty Army soldiers to collect user interaction and usability data. Results suggest the tested UI is effective and usable for military mission planning across both VR and AR modalities, as shown by high self-reported usability metrics and mostly statistically-insignificant differences when comparing modalities.","abstract_html":"Use of Extended Reality (XR) technology such as Augmented Reality (AR) and Virtual Reality (VR) has experienced significant growth, with continuous advances in mobile technology and head-mounted display (HMD) headset development. As applications that span more than one type of reality have started to emerge, there is a need for additional research regarding the user interfaces (UIs) developed for these multimodal systems. While some work exists towards the creation of UI design guidelines in AR and in VR, little to no work has been done in providing recommendations for designing interfaces that work successfully across multiple XR modalities. To explore this, three studies were conducted using an existing military system, the Battlespace Visualization and Interaction (BVI) architecture. Interviews were conducted with User Experience (UX) experts to gain insights into key design aspects required across modalities, resulting in a set of five initial UI design recommendations for multimodal applications that provide guidance to researchers and developers in initial stages of XR interface design. Created rapid prototypes were tested in a remote usability study using Army subject-matter experts (SMEs) to determine additional considerations to mission planning requirements and inform iterative interface designs. Implemented UIs in AR and VR modalities were tested using active duty Army soldiers to collect user interaction and usability data. Results suggest the tested UI is effective and usable for military mission planning across both VR and AR modalities, as shown by high self-reported usability metrics and mostly statistically-insignificant differences when comparing modalities.","abstract_has_math":false,"creators":["Garcia, Sarah M."],"institution":"University of South Florida","degree_name":"Doctor of Philosophy (Ph.D.)","degree_level":"Dissertation","degree_discipline":"Computer Science and Engineering","degree_department":null,"school":null,"contributors":["Marvin Andujar, Ph.D.","Paul Rosen, Ph.D.","Sylvia Thomas, Ph.D.","Shaun Canavan, Ph.D.","Michael Boyce, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2023,"date_issued":"2023-03-30T07:00:00Z","date_published":"2023-03-30T07:00:00Z","updated_at":"2026-11-19T08:49:56Z","subjects":["Cross Reality","Design Guidelines","Extended Reality","Usability","User Experience","Computer Sciences"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/10436","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/10436","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-11723","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Marvin Andujar, Ph.D.","Paul Rosen, Ph.D.","Sylvia Thomas, Ph.D.","Shaun Canavan, Ph.D.","Michael Boyce, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Garcia, Sarah M."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2023-03-30T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science and Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation","Ph.D."]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy (Ph.D.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Cross Reality","Design Guidelines","Extended Reality","Usability","User Experience","Computer Sciences"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/10436"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Use of Extended Reality (XR) technology such as Augmented Reality (AR) and Virtual Reality (VR) has experienced significant growth, with continuous advances in mobile technology and head-mounted display (HMD) headset development. As applications that span more than one type of reality have started to emerge, there is a need for additional research regarding the user interfaces (UIs) developed for these multimodal systems. While some work exists towards the creation of UI design guidelines in AR and in VR, little to no work has been done in providing recommendations for designing interfaces that work successfully across multiple XR modalities. To explore this, three studies were conducted using an existing military system, the Battlespace Visualization and Interaction (BVI) architecture. Interviews were conducted with User Experience (UX) experts to gain insights into key design aspects required across modalities, resulting in a set of five initial UI design recommendations for multimodal applications that provide guidance to researchers and developers in initial stages of XR interface design. Created rapid prototypes were tested in a remote usability study using Army subject-matter experts (SMEs) to determine additional considerations to mission planning requirements and inform iterative interface designs. Implemented UIs in AR and VR modalities were tested using active duty Army soldiers to collect user interaction and usability data. Results suggest the tested UI is effective and usable for military mission planning across both VR and AR modalities, as shown by high self-reported usability metrics and mostly statistically-insignificant differences when comparing modalities."]},{"key":"dc:title","label":"Title","values":["Exploring Scalability of Multimodal User Interface Design in Virtual and Augmented Reality"]}]}],"canonical_facts":{"dc:contributor":["Marvin Andujar, Ph.D.","Paul Rosen, Ph.D.","Sylvia Thomas, Ph.D.","Shaun Canavan, Ph.D.","Michael Boyce, Ph.D."],"dc:creator":["Garcia, Sarah M."],"dc:date":["2023-03-30T07:00:00Z"],"dc:description":["Use of Extended Reality (XR) technology such as Augmented Reality (AR) and Virtual Reality (VR) has experienced significant growth, with continuous advances in mobile technology and head-mounted display (HMD) headset development. As applications that span more than one type of reality have started to emerge, there is a need for additional research regarding the user interfaces (UIs) developed for these multimodal systems. While some work exists towards the creation of UI design guidelines in AR and in VR, little to no work has been done in providing recommendations for designing interfaces that work successfully across multiple XR modalities. To explore this, three studies were conducted using an existing military system, the Battlespace Visualization and Interaction (BVI) architecture. Interviews were conducted with User Experience (UX) experts to gain insights into key design aspects required across modalities, resulting in a set of five initial UI design recommendations for multimodal applications that provide guidance to researchers and developers in initial stages of XR interface design. Created rapid prototypes were tested in a remote usability study using Army subject-matter experts (SMEs) to determine additional considerations to mission planning requirements and inform iterative interface designs. Implemented UIs in AR and VR modalities were tested using active duty Army soldiers to collect user interaction and usability data. Results suggest the tested UI is effective and usable for military mission planning across both VR and AR modalities, as shown by high self-reported usability metrics and mostly statistically-insignificant differences when comparing modalities."],"dc:identifier":["https://digitalcommons.usf.edu/etd/10436"],"dc:subject":["Cross Reality","Design Guidelines","Extended Reality","Usability","User Experience","Computer Sciences"],"dc:title":["Exploring Scalability of Multimodal User Interface Design in Virtual and Augmented Reality"],"thesis:degree_discipline":["Computer Science and Engineering"],"thesis:degree_level":["Dissertation","Ph.D."],"thesis:degree_name":["Doctor of Philosophy (Ph.D.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:49:56Z"}