Slow Thinking with LLMs: Lessons from Imitation, Exploration, and Self-Improvement
Reasoning systems such as o1 from OpenAI were recently introduced to solve complex tasks using slow-thinking processes. However, it is clear that large language models have limitations, as they cannot…