{"id":{"repo_id":"mtu","oai_identifier":"oai:digitalcommons.mtu.edu:etdr-2411"},"canonical_url":"https://search.ndltd.org/etd/mtu/oai:digitalcommons.mtu.edu:etdr-2411","repository":{"repo_id":"mtu","name":"Michigan Technological University","base_url":"https://digitalcommons.mtu.edu/do/oai/"},"display":{"title":"Detecting Surface Interactions via a Wearable Microphone to Improve Augmented Reality Text Entry","abstract":"This thesis investigates whether we can detect and distinguish between surface interaction events such as tapping or swiping using a wearable mic from a surface. Also, what are the advantages of new text entry methods such as tapping with two fingers simultaneously to enter capital letters and punctuation? For this purpose, we conducted a remote study to collect audio and video of three different ways people might interact with a surface. We also built a CNN classifier to detect taps. Our results show that we can detect and distinguish between surface interaction events such as tap or swipe via a wearable mic on the user's head.","abstract_html":"This thesis investigates whether we can detect and distinguish between surface interaction events such as tapping or swiping using a wearable mic from a surface. Also, what are the advantages of new text entry methods such as tapping with two fingers simultaneously to enter capital letters and punctuation? For this purpose, we conducted a remote study to collect audio and video of three different ways people might interact with a surface. We also built a CNN classifier to detect taps. Our results show that we can detect and distinguish between surface interaction events such as tap or swipe via a wearable mic on the user&#x27;s head.","abstract_has_math":false,"creators":["Habibi, R."],"institution":null,"degree_name":"Master of Science in Computer Science (MS)","degree_level":"Open Access Master's Thesis","degree_discipline":"Department of Computer Science","degree_department":null,"school":null,"contributors":["Keith Vertanen","Scott Kuhl"],"advisors":[],"committee_chairs":[],"committee_members":["Guy Hembroff"],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T08:18:27Z","subjects":["Augmented Reality","Head-mounted display","Text Entry","Audio detection","Machine Learning","Mixed Reality","Surface Interaction","Wearable Microphone","Smart Glasses","HCI","Human Computer Interaction","Artificial Intelligence and Robotics","Graphics and Human Computer Interfaces"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.mtu.edu/etdr/1240"],"render_values":[{"text":"https://digitalcommons.mtu.edu/etdr/1240","href":"https://digitalcommons.mtu.edu/etdr/1240","code":true}]}],"person_identifier_entries":[]},"links":{"outbound_url":"https://doi.org/10.37099/mtu.dc.etdr/1240","outbound_label":"DOI","outbound_source":"dc:identifier","record_url":"https://doi.org/10.37099/mtu.dc.etdr/1240","record_label":"Repository record","record_kind":"doi","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.mtu.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.mtu.edu%3Aetdr-2411","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Keith Vertanen","Scott Kuhl"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Guy Hembroff"]},{"key":"dc:creator","label":"Author","values":["Habibi, R."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.created","label":"Dc Date Created","values":["2021-01-01T08:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Department of Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Open Access Master's Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science in Computer Science (MS)"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Augmented Reality","Head-mounted display","Text Entry","Audio detection","Machine Learning","Mixed Reality","Surface Interaction","Wearable Microphone","Smart Glasses","HCI","Human Computer Interaction","Artificial Intelligence and Robotics","Graphics and Human Computer Interfaces"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["10.37099/mtu.dc.etdr/1240","https://digitalcommons.mtu.edu/etdr/1240"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["This thesis investigates whether we can detect and distinguish between surface interaction events such as tapping or swiping using a wearable mic from a surface. Also, what are the advantages of new text entry methods such as tapping with two fingers simultaneously to enter capital letters and punctuation? For this purpose, we conducted a remote study to collect audio and video of three different ways people might interact with a surface. We also built a CNN classifier to detect taps. Our results show that we can detect and distinguish between surface interaction events such as tap or swipe via a wearable mic on the user's head."]},{"key":"dc:description.note","label":"Dc Description Note","values":["<p>Original comments below abstract:</p> <p>TRANSLATE with x English <a>Arabic</a> <a>Hebrew</a> <a>Polish</a> <a>Bulgarian</a> <a>Hindi</a> <a>Portuguese</a> <a>Catalan</a> <a>Hmong Daw</a> <a>Romanian</a> <a>Chinese Simplified</a> <a>Hungarian</a> <a>Russian</a> <a>Chinese Traditional</a> <a>Indonesian</a> <a>Slovak</a> <a>Czech</a> <a>Italian</a> <a>Slovenian</a> <a>Danish</a> <a>Japanese</a> <a>Spanish</a> <a>Dutch</a> <a>Klingon</a> <a>Swedish</a> <a>English</a> <a>Korean</a> <a>Thai</a> <a>Estonian</a> <a>Latvian</a> <a>Turkish</a> <a>Finnish</a> <a>Lithuanian</a> <a>Ukrainian</a> <a>French</a> <a>Malay</a> <a>Urdu</a> <a>German</a> <a>Maltese</a> <a>Vietnamese</a> <a>Greek</a> <a>Norwegian</a> <a>Welsh</a> <a>Haitian Creole</a> <a>Persian</a> TRANSLATE with COPY THE URL BELOW <a id=\"x-x-x-x-ShareBack\" title=\"Back To Translation\">Back</a> EMBED THE SNIPPET BELOW IN YOUR SITE Enable collaborative features and customize widget: <a href=\"http://www.bing.com/widget/translator\" target=\"_blank\">Bing Webmaster Portal</a> <a title=\"Back To Translation\">Back</a></p> <p>--comments from author--</p> <p>TRANSLATE with <strong>missing image.gif</strong> x English <a>Arabic</a> <a>Hebrew</a> <a>Polish</a> <a>Bulgarian</a> <a>Hindi</a> <a>Portuguese</a> <a>Catalan</a> <a>Hmong Daw</a> <a>Romanian</a> <a>Chinese Simplified</a> <a>Hungarian</a> <a>Russian</a> <a>Chinese Traditional</a> <a>Indonesian</a> <a>Slovak</a> <a>Czech</a> <a>Italian</a> <a>Slovenian</a> <a>Danish</a> <a>Japanese</a> <a>Spanish</a> <a>Dutch</a> <a>Klingon</a> <a>Swedish</a> <a>English</a> <a>Korean</a> <a>Thai</a> <a>Estonian</a> <a>Latvian</a> <a>Turkish</a> <a>Finnish</a> <a>Lithuanian</a> <a>Ukrainian</a> <a>French</a> <a>Malay</a> <a>Urdu</a> <a>German</a> <a>Maltese</a> <a>Vietnamese</a> <a>Greek</a> <a>Norwegian</a> <a>Welsh</a> <a>Haitian Creole</a> <a>Persian</a> <strong>missing image.gif</strong> <a href=\"https://go.microsoft.com/?linkid=9722454\" id=\"x-x-x-x-HelpLink\" target=\"_blank\" title=\"Help\"> <strong>missing image.gif</strong></a> <a id=\"x-x-x-x-EmbedLink\" title=\"Get this widget for your own site\"> <strong>missing image.gif</strong></a> <a id=\"x-x-x-x-ShareLink\" title=\"Share translated page with friends\"> <strong>missing image.gif</strong></a> TRANSLATE with <strong>missing image.gif</strong> COPY THE URL BELOW <a id=\"x-x-x-x-EmailLink\" title=\"Email this translation\"> <strong>missing image.gif</strong></a> <a id=\"x-x-x-x-ShareHelpLink\"> <strong>missing image.gif</strong></a> <a id=\"x-x-x-x-ShareBack\" title=\"Back To Translation\"> Back</a> EMBED THE SNIPPET BELOW IN YOUR SITE <a id=\"x-x-x-x-EmbedHelpLink\" title=\"Copy this code and place it into your HTML.\"> <strong>missing image.gif</strong></a> Enable collaborative features and customize widget: <a href=\"http://www.bing.com/widget/translator\" target=\"_blank\">Bing Webmaster Portal</a> <a title=\"Back To Translation\">Back</a></p>"]},{"key":"dc:title","label":"Title","values":["Detecting Surface Interactions via a Wearable Microphone to Improve Augmented Reality Text Entry"]}]}],"canonical_facts":{"dc:contributor":["Keith Vertanen","Scott Kuhl"],"dc:contributor.committeemember":["Guy Hembroff"],"dc:creator":["Habibi, R."],"dc:date.created":["2021-01-01T08:00:00Z"],"dc:description.abstract":["This thesis investigates whether we can detect and distinguish between surface interaction events such as tapping or swiping using a wearable mic from a surface. Also, what are the advantages of new text entry methods such as tapping with two fingers simultaneously to enter capital letters and punctuation? For this purpose, we conducted a remote study to collect audio and video of three different ways people might interact with a surface. We also built a CNN classifier to detect taps. Our results show that we can detect and distinguish between surface interaction events such as tap or swipe via a wearable mic on the user's head."],"dc:description.note":["<p>Original comments below abstract:</p> <p>TRANSLATE with x English <a>Arabic</a> <a>Hebrew</a> <a>Polish</a> <a>Bulgarian</a> <a>Hindi</a> <a>Portuguese</a> <a>Catalan</a> <a>Hmong Daw</a> <a>Romanian</a> <a>Chinese Simplified</a> <a>Hungarian</a> <a>Russian</a> <a>Chinese Traditional</a> <a>Indonesian</a> <a>Slovak</a> <a>Czech</a> <a>Italian</a> <a>Slovenian</a> <a>Danish</a> <a>Japanese</a> <a>Spanish</a> <a>Dutch</a> <a>Klingon</a> <a>Swedish</a> <a>English</a> <a>Korean</a> <a>Thai</a> <a>Estonian</a> <a>Latvian</a> <a>Turkish</a> <a>Finnish</a> <a>Lithuanian</a> <a>Ukrainian</a> <a>French</a> <a>Malay</a> <a>Urdu</a> <a>German</a> <a>Maltese</a> <a>Vietnamese</a> <a>Greek</a> <a>Norwegian</a> <a>Welsh</a> <a>Haitian Creole</a> <a>Persian</a> TRANSLATE with COPY THE URL BELOW <a id=\"x-x-x-x-ShareBack\" title=\"Back To Translation\">Back</a> EMBED THE SNIPPET BELOW IN YOUR SITE Enable collaborative features and customize widget: <a href=\"http://www.bing.com/widget/translator\" target=\"_blank\">Bing Webmaster Portal</a> <a title=\"Back To Translation\">Back</a></p> <p>--comments from author--</p> <p>TRANSLATE with <strong>missing image.gif</strong> x English <a>Arabic</a> <a>Hebrew</a> <a>Polish</a> <a>Bulgarian</a> <a>Hindi</a> <a>Portuguese</a> <a>Catalan</a> <a>Hmong Daw</a> <a>Romanian</a> <a>Chinese Simplified</a> <a>Hungarian</a> <a>Russian</a> <a>Chinese Traditional</a> <a>Indonesian</a> <a>Slovak</a> <a>Czech</a> <a>Italian</a> <a>Slovenian</a> <a>Danish</a> <a>Japanese</a> <a>Spanish</a> <a>Dutch</a> <a>Klingon</a> <a>Swedish</a> <a>English</a> <a>Korean</a> <a>Thai</a> <a>Estonian</a> <a>Latvian</a> <a>Turkish</a> <a>Finnish</a> <a>Lithuanian</a> <a>Ukrainian</a> <a>French</a> <a>Malay</a> <a>Urdu</a> <a>German</a> <a>Maltese</a> <a>Vietnamese</a> <a>Greek</a> <a>Norwegian</a> <a>Welsh</a> <a>Haitian Creole</a> <a>Persian</a> <strong>missing image.gif</strong> <a href=\"https://go.microsoft.com/?linkid=9722454\" id=\"x-x-x-x-HelpLink\" target=\"_blank\" title=\"Help\"> <strong>missing image.gif</strong></a> <a id=\"x-x-x-x-EmbedLink\" title=\"Get this widget for your own site\"> <strong>missing image.gif</strong></a> <a id=\"x-x-x-x-ShareLink\" title=\"Share translated page with friends\"> <strong>missing image.gif</strong></a> TRANSLATE with <strong>missing image.gif</strong> COPY THE URL BELOW <a id=\"x-x-x-x-EmailLink\" title=\"Email this translation\"> <strong>missing image.gif</strong></a> <a id=\"x-x-x-x-ShareHelpLink\"> <strong>missing image.gif</strong></a> <a id=\"x-x-x-x-ShareBack\" title=\"Back To Translation\"> Back</a> EMBED THE SNIPPET BELOW IN YOUR SITE <a id=\"x-x-x-x-EmbedHelpLink\" title=\"Copy this code and place it into your HTML.\"> <strong>missing image.gif</strong></a> Enable collaborative features and customize widget: <a href=\"http://www.bing.com/widget/translator\" target=\"_blank\">Bing Webmaster Portal</a> <a title=\"Back To Translation\">Back</a></p>"],"dc:identifier":["10.37099/mtu.dc.etdr/1240","https://digitalcommons.mtu.edu/etdr/1240"],"dc:subject":["Augmented Reality","Head-mounted display","Text Entry","Audio detection","Machine Learning","Mixed Reality","Surface Interaction","Wearable Microphone","Smart Glasses","HCI","Human Computer Interaction","Artificial Intelligence and Robotics","Graphics and Human Computer Interfaces"],"dc:title":["Detecting Surface Interactions via a Wearable Microphone to Improve Augmented Reality Text Entry"],"thesis:degree_discipline":["Department of Computer Science"],"thesis:degree_level":["Open Access Master's Thesis"],"thesis:degree_name":["Master of Science in Computer Science (MS)"]},"updated_at":"2026-11-19T08:18:27Z"}