Editing Arbitrary Propositions in LLMs without Subject Labels

Understand

Large Language Model (LLM) editing modifies factual information in LLMs.

• Locate-and-Edit (L\&E) methods accomplish this by finding where relevant information is stored within the neural network, and editing the weights at that location.
• The goal of editing is to modify the response of an LLM to a proposition independently of its phrasing, while not modifying its response to other related propositions.
• Existing methods are limited to binary propositions, which represent straightforward binary relations between a subject and an object.