Remove Calculus Remove Computer Science Remove Flexibility Remove Natural Sciences
article thumbnail

What Is ChatGPT Doing … and Why Does It Work?

Stephen Wolfram

It’s not obvious that it would be feasible to find the path of the steepest descent on the “weight landscape” But calculus comes to the rescue. As we mentioned above, one can always think of a neural net as computing a mathematical function—that depends on its inputs, and its weights.

Computer 145
article thumbnail

The Physicalization of Metamathematics and Its Implications for the Foundations of Mathematics

Stephen Wolfram

And if we’re going to make a “general theory of mathematics” a first step is to do something like we’d typically do in natural science, and try to “drill down” to find a uniform underlying model—or at least representation—for all of them. From a computer science perspective, we can think of it as being like a type hierarchy.