GeoSteer: Faithful Chain-of-Thought Steering via Latent Manifold Gradients

Understand

Recent advances in Large Language Models (LLMs) have demonstrated remarkable progress in their reasoning capabilities, such as Chain-of-Thought (CoT).

• Most approaches rely on CoT rationales.
• Previous studies have shown that LLMs often generate logically inconsistent reasoning steps even when their final answers are correct.
• These inconsistencies reduce the reliability of the reasoning process.