Back to search

Rochester Institute of Technology

Discovering real-world usage scenarios for a multimodal math search interface

Abstract

dc:description.abstract

To use math expressions in search, current search engines require knowing expression names or using a structure editor or string encoding (e.g., LaTeX) to enter expressions. This is unfortunate for people who are not math experts, as this can lead to an "intention gap" between the math query they wish to express, and what the interface will allow. min is a search interface that supports drawing expressions on a canvas using a mouse/touch, keyboard and images. We designed a user study to examine how the multimodal interface of min changes search behavior for mathematical non-experts, and discover real-world usage scenarios. Participants demonstrated increased use of math expressions in queries when using min. There was little difference in task success reported by participants using min vs. text-based search, but the majority of participants appreciated the multimodal input, and identified real-world scenarios in which they would like to use systems like min.

Degree

thesis:*
Name thesis:degree_name
Human-Computer Interaction (MS)
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Information Sciences and Technologies (GCCIS)

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Wangari, Keita Del Valle
Contributors dc:contributor
  • Richard Zanibbi

Subjects

dc:subject × 6

Identifiers

dc:identifier.*
Repository record dc:identifier
https://repository.rit.edu/theses/7808

Chain of custody

source
Harvested from
Rochester Institute of Technology
Base URL
repository.rit.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Wangari, Keita Del Valle. Discovering real-world usage scenarios for a multimodal math search interface. Thesis thesis, https://repository.rit.edu/theses/7808