Discussion about this post

User's avatar
Simon's avatar

“Scaling neural network models—making them bigger—has made their faux writing more and more authoritative-sounding, but not more and more truthful.”

Hero-level posting.

Expand full comment
Rebel Science's avatar

Great read, although I was expecting to find the actual reason that Google bombed but Microsoft didn't. Was it because Google rolled out an inferior version of a BS generator? Or was it because Google has been gradually losing the trust of the general public?

This being said, is it just me or has anyone else noticed that deep learning is the AI technology that drives both autonomous vehicles and LLMs? In spite of the hype and the successes in some automation fields, DL has failed miserably in the intelligence arena. Isn't it time for AI to change clothes, so to speak? I got all excited when I heard that John Carmack was working on a new path to AI only to find out that he got his inspiration from OpenAI's deep learning guru, Ilya Sutskever, who gave him a reading list of 40 DL research papers. Lord have mercy.

I really don't understand the obsession with deep learning in AI research. The brain generalizes but a deep neural net optimizes objective functions. They could not be more polar opposites. I'd say it's high time for AGI researchers to drop DL and find something else to work with but maybe it's just me.

Expand full comment
38 more comments...

No posts