Do large language models resemble humans in language use?

Understand

Large language models (LLMs) such as ChatGPT and Vicuna have shown remarkable capacities in comprehending and producing language.

• However, their internal workings remain a black box, and it is unclear whether LLMs and chatbots can develop humanlike characteristics in language use.
• Cognitive scientists have devised many experiments that probe, and have made great progress in explaining, how people comprehend and produce language.
• We subjected ChatGPT and Vicuna to 12 of these experiments ranging from sounds to dialogue, preregistered and with 1000 runs (i.e., iterations) per experiment.