Back to search

University of Strathclyde

Financial sentiment beyond text : a multimodal approach to understanding financial market dynamics and investor behaviours

Abstract

dc:description.abstract

Over the past two decades, financial literature has extensively examined textual data to identify key drivers of market activity, with sentiment analysis emerging as a pivotal analytical tool. This thesisinvestigates the application of a multimodal sentiment analysis model for earnings conference calls, combining textual and audio data, to enhance the accuracy of sentiment classification and allow for deeper insights into financial behaviours to be examined. The research identifies a critical gap in existing literature, in that basic sentiment analysis methods dominate despite their underperformance when compared to state-of-the-art natural language processing (NLP) techniques (El-Haj et al. 2018).Advancing sentiment analysis in the financial domain, Chapter 4 shows that multimodal sentiment analysis significantly outperforms commonly used classifiers in extant literature, in terms of classification accuracy and forecasting capabilities. Chapter 5 reveals that the multimodal model is highly adept at forecasting Cumulative Abnormal Returns (CARs), uncovering a return reversaldynamic between sentiment and CARs that lends support to behavioural theory. This chapter also identifies that framing bias—discrepancies in how information is presented by managers and analysts—intensifies market reactions, emphasizing the role of framing in financial decision-making and providing evidence towards a potential driver of the returns reversal dynamic. Chapter 6 explores the relationship between multimodal sentiment and Cumulative Abnormal Volume (CAV). The findings demonstrate a significant association between multimodal sentiment and long-term trading volume, underscoring the impact of non-verbal communication on investor behaviour. Furthermore, it establishes that sentiment divergence, indicative of disagreement, leads to heightened volume, underscoring the market's sensitivity to conflicting signals. This research demonstrates the power of multimodal approaches in capturing nuanced financial sentiment and its implications for market behaviour. The findings advance both the technical and theoretical understanding of financial sentiment analysis, particularly highlighting the importance ofincorporating audio characteristics alongside textual data in the financial domain.

Degree

thesis:*
Name dc:type.qualificationname
phd
Level dc:type.qualificationlevel
doctoral-pg
Grantor dc:publisher.institution
University of Strathclyde
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Todd, Andrew
Advisors dc:contributor.advisor
  • Bowden, James
  • Cummins, Mark, 1968-
Author Identifier dc:creator.authoridentifier
  • 202053449

Rights

Identifiers

dc:identifier.*
Identifier
T17422

Chain of custody

source
Harvested from
University of Strathclyde
Base URL
stax.strath.ac.uk/catalog/oai
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Todd, Andrew. Financial sentiment beyond text : a multimodal approach to understanding financial market dynamics and investor behaviours. doctoral-pg thesis, University of Strathclyde, 2025. https://stax.strath.ac.uk/concern/theses/00000058d