Back to search

University of Central Florida

Leveraging Human-Centered Insights and Vision Transformers to Understand and Detect Online Risks in Teens' Private Social Media Conversations On Instagram

Abstract

dc:description.abstract

With the growing ubiquity of the internet and internet enabled devices, the issue of online risk and the need for safety measures against such risks has grown paramount. Many researchers have analyzed the scope and characteristics of online risk, especially with respect to demographics, yet few have studied the risky media itself. This work sets out to move the conversation from surveys and interviews to content analysis and automation through a comprehensive thematic analysis of online multi-media risks (images and videos) sent to and from teens in private messages on Instagram. These messages, along with demographic information such as age and gender, were collected to form the Instagram Data Donation (IGDD) dataset. The findings from this analysis were used to inform semi- and self-supervised state-of-the-art vision transformers to produce validated labeled data for use in downstream risk detection and classification tasks. The results from this study show that online multi-media risks can be characterized by a myriad of content and contextual factors including media types (memes, screenshots, etc.), sender information (friend, acquaintance, etc.), and use of comedy and directed language. Our results also show that vision transformers are capable of learning complex image features and are capable of correctly attending to key, differentiable aspects of the images for use in risk detection and classification. Trigger Warning: This work includes graphic images of pornography, violence, self-harm, and bullying. We recognize that this material may not be appropriate for all readers and encourage readers to proceed with caution. Ethical Considerations: Our dataset consists of primarily private media messages that may contain personally identifiable information (PII). Because of this, we have chosen to use only the images that were publicly available on the web prior to the participant joining the study or have recreated the images ourselves with fully redacted PII.

Degree

thesis:*
Grantor dc:publisher
University of Central Florida

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Gracie, Joshua
Contributors dc:contributor
  • Wisniewski, Pamela

Subjects

dc:subject × 3

Rights

Language dc:language
English

Identifiers

dc:identifier.*
Identifier
CFE0008986; DP0026319

Chain of custody

source
Harvested from
Central Florida
Base URL
stars.library.ucf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Gracie, Joshua. Leveraging Human-Centered Insights and Vision Transformers to Understand and Detect Online Risks in Teens' Private Social Media Conversations On Instagram. University of Central Florida, https://stars.library.ucf.edu/etd2020/1015