Return to search

Backdrop Explorer:  A Human-AI Collaborative Approach for Exploring Studio Backdrops in Civil War Portraits

In historical photo research, the presence of painted backdrops have the potential to help identify subjects, photographers, locations, and jl{events surrounding} certain photographs. Yet, research processes around these backdrops are poorly documented, with no known tools to aid in the task. We propose a four-step human-AI collaboration workflow to support the jl{discovery} and clustering of these backdrops. Focusing on the painted backdrops of the American Civil War (1861 -- 1865), we present Backdrop Explorer, a content-based image retrieval (CBIR) system incorporating computer vision and novel user interactions. We evaluated Backdrop Explorer on nine users of diverse experience levels and found that all were able to effectively utilize Backdrop Explorer to find photos with similar backdrops. We also document current practices and pain points in Civil War backdrop research through user interviews. Finally, we discuss how our findings and workflow can be applied to other topics and domains. / Master of Science / In historical photo research, the presence of painted backdrops have the potential to help identify subjects, photographers, locations, and events surrounding certain photographs. Yet, research processes around these backdrops are poorly documented, with no known tools to aid in the largely manual task. We present Backdrop Explorer, a reverse image search system that helps users discover and subsequently group photos with similar backdrops. We evaluated the system and found that it effectively supported the tasks. We also document current practices and pain points in Civil War backdrop research. Finally, we discuss how our findings and system can be applied to other domains.

Identiferoai:union.ndltd.org:VTETD/oai:vtechworks.lib.vt.edu:10919/115427
Date14 June 2023
CreatorsLim, Ken Yoong
ContributorsComputer Science and Applications, Luther, Kurt, Lee, Sang Won, Gitre, Edward Joseph Khair
PublisherVirginia Tech
Source SetsVirginia Tech Theses and Dissertation
LanguageEnglish
Detected LanguageEnglish
TypeThesis
FormatETD, application/pdf
RightsIn Copyright, http://rightsstatements.org/vocab/InC/1.0/

Page generated in 0.002 seconds