Susceptibility to Influence of Large Language Models

Understand

Two studies tested the hypothesis that a Large Language Model (LLM) can be used to model psychological change following exposure to influential input.

• The first study tested a generic mode of influence - the Illusory Truth Effect (ITE) - where earlier exposure to a statement (through, for example, rating its interest) boosts a later truthfulness test rating.
• Data was collected from 1000 human participants using an online experiment, and 1000 simulated participants using engineered prompts and LLM completion.
• 64 ratings per participant were collected, using all exposure-test combinations of the attributes: truth, interest, sentiment and importance.