Chain-of-thought reasoning

Chain of thought (CoT) prompting elicits reasoning by appending "Let's think step by step" or providing reasoning examples. The model generates an explicit reasoning trace before the final answer, which dramatically improves performance on arithmetic, commonsense, and symbolic reasoning tasks.