Back to search

University of Waterloo

On the Effect of Hyperparameters in Language Modeling for Computational Linguistics

Abstract

dc:description.abstract

Experimental linguistics serves as a vital resource and evaluation criterion for natural language understanding in contemporary machine learning. While linguistically motivated experiments often use controlled settings to explore how models learn, they frequently overlook the role of training hyperparameters as a source of randomness. In this study, by replicating three representative experiments [14, 41, 47] with hyperparameters varied over a practical range, we show that modest hyperparameter changes can alter qualitative conclusions about models’ linguistic abilities or even reverse cross-model comparisons, while other findings remain stable across the explored space. These results suggest that some prior studies in this field may partly reflect optimization artifacts rather than the inductive bias of a model class. We argue that hyperparameter sensitivity is an under-examined factor that can meaningfully influence model behaviors, and thus call for future linguistically motivated experiments with neural models to attend to hyperparameter selection and the stability of the findings across the configuration space.

Degree

thesis:*
Grantor dc:publisher
University of Waterloo
Year dc:date.issued
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Ning, Ruoxi

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/10012/23110

Chain of custody

source
Harvested from
University of Waterloo
Base URL
dspacemainprd01.lib.uwaterloo.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Ning, Ruoxi. On the Effect of Hyperparameters in Language Modeling for Computational Linguistics. University of Waterloo, 2026. https://hdl.handle.net/10012/23110