article thumbnail

What Is ChatGPT Doing … and Why Does It Work?

Stephen Wolfram

It’s not obvious that it would be feasible to find the path of the steepest descent on the “weight landscape” But calculus comes to the rescue. It turns out that the chain rule of calculus in effect lets us “unravel” the operations done by successive layers in the neural net. There are several key parts.

Computer 145
article thumbnail

The Concept of the Ruliad

Stephen Wolfram

But what about other models of computation—like cellular automata or register machines or lambda calculus? But it’s a fundamental claim that we’re making—that can be thought of as a matter of natural science—that in our universe only computation can occur, not hypercomputation.

Physics 122