Knowledge only takes you so far

My guess is that our creativity and leaps of insight come not from what we know — knowledge — but from how we know it. Unlike current LLMs, our brains are capable of continuous learning. Right now, the smartness of LLMs is based primarily on their encyclopedic knowledge — on extracting the intelligence humans have structured into our encyclopedias, books, and everything we write. That will probably not be enough to go all the way to the kind of creativity and insight human brains can produce. That variety of intelligence will likely require algorithms for continuous learning, or a different design than neural nets alone. -Kevin Kelly