{"id":{"repo_id":"gatech","oai_identifier":"oai:repository.gatech.edu:1853/37101"},"canonical_url":"https://search.ndltd.org/etd/gatech/oai:repository.gatech.edu:1853/37101","repository":{"repo_id":"gatech","name":"Georgia Tech","base_url":"https://repository.gatech.edu/server/oai/request"},"display":{"title":"\"Spindex\" (speech index) enhances menu navigation user experience of touch screen devices in various input gestures: tapping, wheeling, and flicking","abstract":"In a large number of electronic devices, users interact with the system by navigating through various menus. Auditory menus can complement or even replace visual menus, so research on auditory menus has recently increased with mobile devices as well as desktop computers. Despite the potential importance of auditory displays on touch screen devices, little research has been attempted to enhance the effectiveness of auditory menus for those devices. In the present study, I investigated how advanced auditory cues enhance auditory menu navigation on a touch screen smartphone, especially for new input gestures such as tapping, wheeling, and flicking methods for navigating a one-dimensional menu. Moreover, I examined if advanced auditory cues improve user experience, not only for visuals-off situations, but also for visuals-on contexts. To this end, I used a novel auditory menu enhancement called a \"spindex\" (i.e., speech index), in which brief audio cues inform the users of where they are in a long menu. In this study, each item in a menu was preceded by a sound based on the item's initial letter. One hundred and twenty two undergraduates navigated through an alphabetized list of 150 song titles. The study was a split-plot design with manipulated auditory cue type (text-to-speech (TTS) alone vs. TTS plus spindex), visual mode (on vs. off), and input gesture style (tapping, wheeling, and flicking). Target search time and subjective workload for the TTS + spindex were lower than those of the TTS alone in all input gesture types regardless of visual type. Also, on subjective ratings scales, participants rated the TTS + spindex condition higher than the plain TTS on being 'effective' and 'functionally helpful'. The interaction between input methods and output modes (i.e., auditory cue types) and its effects on navigation behaviors was also analyzed based on the two-stage navigation strategy model used in auditory menus. Results were discussed in analogy with visual search theory and in terms of practical applications of spindex cues.","abstract_html":"In a large number of electronic devices, users interact with the system by navigating through various menus. Auditory menus can complement or even replace visual menus, so research on auditory menus has recently increased with mobile devices as well as desktop computers. Despite the potential importance of auditory displays on touch screen devices, little research has been attempted to enhance the effectiveness of auditory menus for those devices. In the present study, I investigated how advanced auditory cues enhance auditory menu navigation on a touch screen smartphone, especially for new input gestures such as tapping, wheeling, and flicking methods for navigating a one-dimensional menu. Moreover, I examined if advanced auditory cues improve user experience, not only for visuals-off situations, but also for visuals-on contexts. To this end, I used a novel auditory menu enhancement called a &quot;spindex&quot; (i.e., speech index), in which brief audio cues inform the users of where they are in a long menu. In this study, each item in a menu was preceded by a sound based on the item&#x27;s initial letter. One hundred and twenty two undergraduates navigated through an alphabetized list of 150 song titles. The study was a split-plot design with manipulated auditory cue type (text-to-speech (TTS) alone vs. TTS plus spindex), visual mode (on vs. off), and input gesture style (tapping, wheeling, and flicking). Target search time and subjective workload for the TTS + spindex were lower than those of the TTS alone in all input gesture types regardless of visual type. Also, on subjective ratings scales, participants rated the TTS + spindex condition higher than the plain TTS on being &#x27;effective&#x27; and &#x27;functionally helpful&#x27;. The interaction between input methods and output modes (i.e., auditory cue types) and its effects on navigation behaviors was also analyzed based on the two-stage navigation strategy model used in auditory menus. Results were discussed in analogy with visual search theory and in terms of practical applications of spindex cues.","abstract_has_math":false,"creators":["Jeon, Myounghoon"],"institution":"Georgia Institute of Technology","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Psychology","school":null,"contributors":[],"advisors":["Walker, Bruce N."],"committee_chairs":[],"committee_members":["Frank Durso","Corso, Gregory M."],"year":2010,"date_issued":"2010-11-11","date_published":"2010-11-11","updated_at":"2026-11-19T05:16:37Z","subjects":["Sonification","Auditory menu","Auditory displays","Multimodal user interfaces (Computer systems)","Haptic devices","User interfaces","Human-computer interaction","Computer sound processing","Smartphones"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/1853/37101","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"http://hdl.handle.net/1853/37101","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://repository.gatech.edu/server/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Arepository.gatech.edu%3A1853%2F37101","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Walker, Bruce N."]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Frank Durso","Corso, Gregory M."]},{"key":"dc:contributor.department","label":"Department","values":["Psychology"]},{"key":"dc:contributor.other","label":"Dc Contributor Other","values":["College of Sciences","School of Psychology"]},{"key":"dc:creator","label":"Author","values":["Jeon, Myounghoon"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2011-03-04T20:09:28Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2011-03-04T20:09:28Z"]},{"key":"dc:date.issued","label":"Date","values":["2010-11-11"]},{"key":"dc:publisher","label":"Institution","values":["Georgia Institute of Technology"]},{"key":"dc:relation.advisorentity","label":"Dc Relation Advisorentity","values":["5bedf397-416e-498e-aa60-c67c0ee43473"]},{"key":"dc:relation.ispartofseries","label":"Dc Relation Ispartofseries","values":["Master of Science in Psychology"]},{"key":"dc:relation.orgunit","label":"Dc Relation Orgunit","values":["85042be6-2d68-4e07-b384-e1f908fae48a","768a3cd1-8d73-4d47-b418-0fc859ce897d"]},{"key":"dc:relation.seriesentity","label":"Dc Relation Seriesentity","values":["1461dfba-6429-4149-9db6-0123356d3c77"]},{"key":"dc:type","label":"Dc Type","values":["Text","Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Sonification","Auditory menu","Auditory displays"]},{"key":"dc:subject.lcsh","label":"Dc Subject Lcsh","values":["Multimodal user interfaces (Computer systems)","Haptic devices","User interfaces","Human-computer interaction","Computer sound processing","Smartphones"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/1853/37101"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["In a large number of electronic devices, users interact with the system by navigating through various menus. Auditory menus can complement or even replace visual menus, so research on auditory menus has recently increased with mobile devices as well as desktop computers. Despite the potential importance of auditory displays on touch screen devices, little research has been attempted to enhance the effectiveness of auditory menus for those devices. In the present study, I investigated how advanced auditory cues enhance auditory menu navigation on a touch screen smartphone, especially for new input gestures such as tapping, wheeling, and flicking methods for navigating a one-dimensional menu. Moreover, I examined if advanced auditory cues improve user experience, not only for visuals-off situations, but also for visuals-on contexts. To this end, I used a novel auditory menu enhancement called a \"spindex\" (i.e., speech index), in which brief audio cues inform the users of where they are in a long menu. In this study, each item in a menu was preceded by a sound based on the item's initial letter. One hundred and twenty two undergraduates navigated through an alphabetized list of 150 song titles. The study was a split-plot design with manipulated auditory cue type (text-to-speech (TTS) alone vs. TTS plus spindex), visual mode (on vs. off), and input gesture style (tapping, wheeling, and flicking). Target search time and subjective workload for the TTS + spindex were lower than those of the TTS alone in all input gesture types regardless of visual type. Also, on subjective ratings scales, participants rated the TTS + spindex condition higher than the plain TTS on being 'effective' and 'functionally helpful'. The interaction between input methods and output modes (i.e., auditory cue types) and its effects on navigation behaviors was also analyzed based on the two-stage navigation strategy model used in auditory menus. Results were discussed in analogy with visual search theory and in terms of practical applications of spindex cues."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["M.S."]},{"key":"dc:title","label":"Title","values":["\"Spindex\" (speech index) enhances menu navigation user experience of touch screen devices in various input gestures: tapping, wheeling, and flicking"]},{"key":"dspace:entity.type","label":"Dspace Entity Type","values":["Publication"]}]}],"canonical_facts":{"dc:contributor.advisor":["Walker, Bruce N."],"dc:contributor.committeemember":["Frank Durso","Corso, Gregory M."],"dc:contributor.department":["Psychology"],"dc:contributor.other":["College of Sciences","School of Psychology"],"dc:creator":["Jeon, Myounghoon"],"dc:date.accessioned":["2011-03-04T20:09:28Z"],"dc:date.available":["2011-03-04T20:09:28Z"],"dc:date.issued":["2010-11-11"],"dc:description.abstract":["In a large number of electronic devices, users interact with the system by navigating through various menus. Auditory menus can complement or even replace visual menus, so research on auditory menus has recently increased with mobile devices as well as desktop computers. Despite the potential importance of auditory displays on touch screen devices, little research has been attempted to enhance the effectiveness of auditory menus for those devices. In the present study, I investigated how advanced auditory cues enhance auditory menu navigation on a touch screen smartphone, especially for new input gestures such as tapping, wheeling, and flicking methods for navigating a one-dimensional menu. Moreover, I examined if advanced auditory cues improve user experience, not only for visuals-off situations, but also for visuals-on contexts. To this end, I used a novel auditory menu enhancement called a \"spindex\" (i.e., speech index), in which brief audio cues inform the users of where they are in a long menu. In this study, each item in a menu was preceded by a sound based on the item's initial letter. One hundred and twenty two undergraduates navigated through an alphabetized list of 150 song titles. The study was a split-plot design with manipulated auditory cue type (text-to-speech (TTS) alone vs. TTS plus spindex), visual mode (on vs. off), and input gesture style (tapping, wheeling, and flicking). Target search time and subjective workload for the TTS + spindex were lower than those of the TTS alone in all input gesture types regardless of visual type. Also, on subjective ratings scales, participants rated the TTS + spindex condition higher than the plain TTS on being 'effective' and 'functionally helpful'. The interaction between input methods and output modes (i.e., auditory cue types) and its effects on navigation behaviors was also analyzed based on the two-stage navigation strategy model used in auditory menus. Results were discussed in analogy with visual search theory and in terms of practical applications of spindex cues."],"dc:description.degree":["M.S."],"dc:identifier.uri":["http://hdl.handle.net/1853/37101"],"dc:publisher":["Georgia Institute of Technology"],"dc:relation.advisorentity":["5bedf397-416e-498e-aa60-c67c0ee43473"],"dc:relation.ispartofseries":["Master of Science in Psychology"],"dc:relation.orgunit":["85042be6-2d68-4e07-b384-e1f908fae48a","768a3cd1-8d73-4d47-b418-0fc859ce897d"],"dc:relation.seriesentity":["1461dfba-6429-4149-9db6-0123356d3c77"],"dc:subject":["Sonification","Auditory menu","Auditory displays"],"dc:subject.lcsh":["Multimodal user interfaces (Computer systems)","Haptic devices","User interfaces","Human-computer interaction","Computer sound processing","Smartphones"],"dc:title":["\"Spindex\" (speech index) enhances menu navigation user experience of touch screen devices in various input gestures: tapping, wheeling, and flicking"],"dc:type":["Text","Thesis"],"dspace:entity.type":["Publication"]},"updated_at":"2026-11-19T05:16:37Z"}