Reasoning
How artificial intelligence moves from automatic word reflexes to deliberate, step-by-step logic and problem-solving.
Easy questions use reflexes; hard problems need a napkin.
For simple questions, an AI uses fast pattern matching. For complex logic, it must write out its work step-by-step to avoid guessing.
Why can't models calculate silently in their heads?
A neural network gets a fixed amount of computing power per token. It cannot run a loop or pause to think internally. The only way it gets more computation time is by writing out its intermediate thinking steps into words.
Reasoning models write their thinking before answering.
New reasoning models generate an internal "chain of thought" behind the scenes, testing formulas and verifying assumptions before showing you the result.
What are thinking tokens?
In models like OpenAI o1 or DeepSeek-R1, the model emits hundreds or thousands of internal tokens before producing the final response. These thinking tokens are billed on compute, but are collapsed or hidden in the user interface.
Backtracking when an idea hits a dead end.
Reasoning models can catch their own mistakes mid-thought, say "Wait, that does not balance," and pivot down a better path.
How models learn self-correction
Models are trained using Reinforcement Learning with automated verifiers. If a math answer is wrong, the whole chain receives a zero score. Over millions of training rounds, the model discovers that actively questioning its previous steps leads to higher success scores.
Trading waiting time for rock-solid accuracy.
Older models answer in 1 second with a 60% chance of guessing wrong. Reasoning models think for 15 seconds to deliver near-perfect results.
What is test-time compute scaling?
In traditional machine learning, models only got smarter if you made them bigger during training. Test-time compute scaling proved that a smaller model can outperform a giant model if you give it more time to think and verify its answers at inference time.