On the Effect of Hyperparameters in Language Modeling for Computational Linguistics

dc.contributor.authorNing, Ruoxi
dc.date.accessioned2026-04-29T18:27:44Z
dc.date.available2026-04-29T18:27:44Z
dc.date.issued2026-04-29
dc.date.submitted2026-04-27
dc.description.abstractExperimental linguistics serves as a vital resource and evaluation criterion for natural language understanding in contemporary machine learning. While linguistically motivated experiments often use controlled settings to explore how models learn, they frequently overlook the role of training hyperparameters as a source of randomness. In this study, by replicating three representative experiments [14, 41, 47] with hyperparameters varied over a practical range, we show that modest hyperparameter changes can alter qualitative conclusions about models’ linguistic abilities or even reverse cross-model comparisons, while other findings remain stable across the explored space. These results suggest that some prior studies in this field may partly reflect optimization artifacts rather than the inductive bias of a model class. We argue that hyperparameter sensitivity is an under-examined factor that can meaningfully influence model behaviors, and thus call for future linguistically motivated experiments with neural models to attend to hyperparameter selection and the stability of the findings across the configuration space.
dc.identifier.urihttps://hdl.handle.net/10012/23110
dc.language.isoen
dc.pendingfalse
dc.publisherUniversity of Waterlooen
dc.titleOn the Effect of Hyperparameters in Language Modeling for Computational Linguistics
dc.typeMaster Thesis
uws-etd.degreeMaster of Mathematics
uws-etd.degree.departmentDavid R. Cheriton School of Computer Science
uws-etd.degree.disciplineComputer Science
uws-etd.degree.grantorUniversity of Waterlooen
uws-etd.embargo.terms0
uws.contributor.advisorShi, Freda
uws.contributor.affiliation1Faculty of Mathematics
uws.peerReviewStatusUnrevieweden
uws.published.cityWaterlooen
uws.published.countryCanadaen
uws.published.provinceOntarioen
uws.scholarLevelGraduateen
uws.typeOfResourceTexten

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Ning_Ruoxi.pdf
Size:
667.41 KB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
6.4 KB
Format:
Item-specific license agreed upon to submission
Description: