Back to search

Rochester Institute of Technology

GenUI: Customizing and Improving User Interfaces in Real-Time with Generative AI

Abstract

dc:description.abstract

MOTIVATION: Users must conform to the interfaces they are given, which are designed for a generalized user base rather than individual workflows or preferences. Existing UI customizations are often limited to fixed options predetermined by developers, restricting meaningful user control. Advances in generative AI introduce the possibility of modifying the underlying code of a production system that defines interfaces, enabling more flexible and targeted adaptations. However, the feasibility, scalability, and usability of such user-driven customization remain open questions. GOAL: The goal of this work is to help people customize their user interfaces, by investigating how they can linguistically specify the presentation and behavior of software interfaces beyond predefined design constraints METHODS: We developed GenUI, a generative AI system that enables users to modify web interfaces through natural language by generating and applying code-level changes. We conducted a user study to evaluate this approach in practice. Participants used GenUI to perform interface customization tasks, allowing us to assess task feasibility, cost, customization workflows, user opinion, failure modes, and sensitivity to randomness. RESULTS: Users were generally able to successfully perform interface modifications using natural language, with a median task success rate of 92%. GenUI enabled a wide range of customization types, including aesthetic, layout, content, and workflow changes, and led to an overall increase in perceived usability. However, modifications often involved substantial code changes, which did lead to the 8% failure rate (primarily type-related errors). Interaction costs were moderate, with noticeable latency and variability in generation time. CONCLUSIONS: Overall, GenUI is a promising approach for user-driven interface customization. However, current limitations in reliability, performance, and scalability suggest that further improvements in model specialization, system design, and computational infrastructure are necessary for practical deployment.

Degree

thesis:*
Name thesis:degree_name
Software Engineering (MS)
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Software Engineering, Department of

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Parker, Ursula
Contributors dc:contributor
  • Andy Meneely

Subjects

dc:subject × 6

Identifiers

dc:identifier.*
Repository record dc:identifier
https://repository.rit.edu/theses/12638

Chain of custody

source
Harvested from
Rochester Institute of Technology
Base URL
repository.rit.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Parker, Ursula. GenUI: Customizing and Improving User Interfaces in Real-Time with Generative AI. Thesis thesis, https://repository.rit.edu/theses/12638