How social context shapes value-related content in Large Language Model outputs

dc.contributor.authorGhorbansabagh, Maryam
dc.date.accessioned2026-08-14T14:59:36Z
dc.date.issued2026-08-14
dc.date.submitted2026-07-31
dc.description.abstractLarge language models (LLMs) are increasingly used in settings where their output must align with specific values, goals, or preferences. Whether the text produced by these models reliably reflects the values they are instructed to follow, and whether another model can identify those values from the generated text, are open questions in value alignment research. Most prior work evaluates value alignment by comparing model outputs to human-labelled data collected in settings where the social context is not systematically varied, leaving open the question of how the social context of an interaction affects whether a model's output reflects the intended value and whether that value can be recognized from the text. In this thesis, I study whether social context affects the value-related content that appears in language model outputs and how reliably another model can identify it. To this end, I introduce a Generator-Inquisitor framework, in which one instance of a model is instructed to generate text that reflects a target value and another instance infers the underlying value from that text. I ground the framework in two established and cross-culturally validated psychological theories. The first is Schwartz's Theory of Basic Values, which organizes values into four higher-order dimensions---Openness to Change, Conservation, Self-Enhancement, and Self-Transcendence. The second is Fiske's Relational Models Theory, which distinguishes four fundamental relational contexts---Communal Sharing, Equality Matching, Authority Ranking, and Market Pricing. Crossing these yields a fully factorial $4 \times 4$ design, which I use to evaluate six state-of-the-art LLMs (GPT-4o, GPT-5-Mini, GPT-5, Gemini 2.0, Mistral Large 2512, and Llama 3.3 70B) across five experiments. Value recognition accuracy was generally high, well above the 25\% chance level, but varied systematically across value dimensions and relational contexts. Self-Enhancement was consistently the value dimension with the lowest recognition accuracy across all six models, with the difficulty most pronounced in Communal Sharing contexts. Valence scoring of generated texts revealed higher positivity for Self-Enhancement outputs compared to other value dimensions. Cross-model evaluation showed that value signals transferred reliably between models from different families (i.e., models from distinct developers and architectures), and a perturbation experiment showed that accurate classification depended on value-relevant content rather than superficial lexical cues. Together, these results show that the value-related content in LLM outputs, and how reliably it can be recognized, vary systematically with relational context, suggesting that evaluation of value alignment should be sensitive to the social context rather than treating values as fixed model attributes.
dc.identifier.urihttps://hdl.handle.net/10012/23968
dc.language.isoen
dc.pendingfalse
dc.publisherUniversity of Waterlooen
dc.titleHow social context shapes value-related content in Large Language Model outputs
dc.typeMaster Thesis
uws-etd.degreeMaster of Applied Science
uws-etd.degree.departmentElectrical and Computer Engineering
uws-etd.degree.disciplineElectrical and Computer Engineering
uws-etd.degree.grantorUniversity of Waterlooen
uws-etd.embargo.terms0
uws.contributor.advisorKarimi, Amir-Hossein
uws.contributor.advisorGrossmann, Igor
uws.contributor.affiliation1Faculty of Engineering
uws.peerReviewStatusUnrevieweden
uws.published.cityWaterlooen
uws.published.countryCanadaen
uws.published.provinceOntarioen
uws.scholarLevelGraduateen
uws.typeOfResourceTexten

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Ghorbansabagh_Maryam.pdf
Size:
1.27 MB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
6.4 KB
Format:
Item-specific license agreed upon to submission
Description: