Can We Understand How Large Language Models Reason?
Researchers are using tools from causality theory to understand the keys to an algorithm working at a higher level of abstraction.
Credit: Kravchenko Tetiana / Getty Images
Large language models can write essays, solve math problems, and generate computer code, but it’s not fully understood how they do it. Researchers can observe the billions of parameters inside these systems changing during training, yet the internal logic of the models remains largely hidden. In a sense, the engineering is ah...
Read more at cacm.acm.org