Decoding Arithmetic Reasoning in LLMs: The Role of Heuristic Circuits over Generalized Algorithms
A key question about LLMs is whether they solve reasoning tasks by learning transferable algorithms or simply memorizing training data. This distinction matters: while memorization might handle familiar tasks, true…