Thinking LLMs: General Instruction Following with Thought Generation

Understand

LLMs are typically trained to answer user questions or follow instructions similarly to how human experts respond.

• However, in the standard alignment framework they lack the basic ability of explicit thinking before answering.
• Thinking is important for complex questions that require reasoning and planning -- but can be applied to any task.
• We propose a training method for equipping existing LLMs with such thinking abilities for general instruction following without use of additional human data.