Jeff Hawkins interview.
Here’s what we do inside Grok: we build this 60,000-neuron neural network that emulates a very small part of one layer of the neocortex. It’s about a thousandth the size of a mouse brain and a millionth the size of a human brain. So: not super-intelligent, but we’re using the principle by which the brain does all the inference and motor behavior. I’m very confident that this sequence memory we use is the core of how all intelligence works. The brain’s taking in streaming data, they’re noisy, they’re constantly changing, and it has to figure out what the patterns are and make predictions from them.
Here is a more detailed interview.