23 Comments

The "pessimists" you named are just die-hard optimists in disguise, as in ludicrously optimistic in the capabilities of AI. Well, perhaps they ARE pessimists, in that they're pessimistic about the intelligence of human beings. Allow me to explain... The subtext behind AI apocalypse scenarios is "system architects are idiots." For example, taking nuclear weapon launch controls away from human hands and hooking them directly to AI. The surface message is that of "architects are idiots, except me, who will save the rest of you from dumb setups that I dream up." The real message is one of "AI is so powerful it's scary, and so obscure in its workings as to parallel witchcraft. Therefore, worship warlocks like me if you value your life."

Expand full comment
Apr 15Liked by Gary Marcus

Any particular reason you're not speaking this year, Gary? The world is in need of sobering assessments more than ever.

Expand full comment
Apr 16·edited Apr 16

It seems like LLM's would take the discovery part out of education if they are used there. The feeling of discovery is the most important part of learning and becoming motivated to learn. The fact that LLM's are often wrong is secondary to the part where people are relying on them to think. That's how you turn people into passive recepter's (the opposite of education).

I don't understand why/how sal khan would think they are useful for online education.

Expand full comment

The scam being perpetrated on creators is enticing them to train ChatGPT to write in the creator's style and voice -- on the pretense that the creators who do so will be able to use Ai as a "writing assistant" to speed up the creator's work. Big pile of bull chips ... what it will accomplish is enabling copyright violators and plagiarism scoffers to instruct ChatGPT to write something -- anything -- in the style and voice of someone who has not authorized it to be done. In other words, enable the dumb and the lazy to steal the core, indeed only, unique product which a creator has -- his or her style and voice. Bad shit, if you ask me.

Expand full comment

ShatGPT, and you can quote me. ;)

Expand full comment

I agree with all your points except for the desirability of global governance for AI. That just means more layers of idiotic and corrupt politicians trying to steer AI in ways that they hope buy votes.

Expand full comment

Regarding math...I guess before we let it solve Khan academy problems, we need to solve the encryption issue. What are we going to do when these machines are so good at math that current encryption is useless? Haven't you thought that maybe we are already there but it's being held back?

Expand full comment

"lady you can make baby without that much mental power you don t need to know math or biology" The first comment on my TedX talk I gave a few weeks ago about the challenges to our continued relationship with AI. Inspired by a lot of what you say Gary, I hope you like it (and long live women in STEM!). https://www.youtube.com/watch?v=9DXm54ZkSiU

Expand full comment

What very few people know: "Marcus on AI" is actually written by a non-public GPT-5 engine making fun of AI skeptics! :-D Love your work, Marcus!

Expand full comment

Thanks for the shout out Gary. I'm writing this after attending (more like crashing) the ASU+GSV conference which devoted three full days to enthusiastic hyping of AI in education, largely through use of personalized tutors. I predict this won't end well. Additional thoughts can be found here: https://buildcognitiveresonance.substack.com/ and here: https://www.educationnext.org/generative-ai-in-education-another-mindless-mistake/

Expand full comment

The culprit of the poor performance of the Humane AI Pin is the AI model rather than the hardware. To me it should serve as a reality check for the hyped up expectations of AI. Not sure everyone got it since most just blamed Humane which really is just responsible for the hardware. Few blamed OpenAI on their model.

Expand full comment

“Together, I believe that we can achieve the OpenAI mission of ensuring that artificial general intelligence benefits all of humanity”

2004 sees more people going to the polls worldwide than any other year in decades, if they really believed this then they wouldn’t be releasing their buggy unregulated and unreliable products and upgrades this year of all years

But seeing as their sole motivation is ‘can’t wait to get obscenely rich’ then this is precisely what they are doing

Expand full comment

"' frequently wrong, never in doubt,' and that’s just about the worst quality I can imagine for an educator.” Yeah but perfect for a fascist dictator. Hey perhaps we’ve found it a niche after all. 😂

Expand full comment

There were a couple of articles regarding AI, and MLLU in today's NYT. It would be great if you had the time and inclination to give us some feedback on both of them.

Expand full comment

Humane: what if we put an Alexa on your shirt 🤔

Expand full comment
Apr 15·edited Apr 15

I very much agree that the realists (and pragmatists) are the ones to trust the most, rather than pessimists and optimists.

By this token, warnings about how generative AI will destroy society with scams and such aren't any better.

It is worth noting though that this is a long game.

Multi-modal AI needs work. Any time something is created, it must be verified. Such as an image, math proof, generated citations, assertions that were made. Easier said than done, of course, but I don't think people are really trying, so far.

LLM in math exhibit promise, especially, such as with Khanmigo. The number of strategies mathematicians use is not that large, and formal verification exists.

It was indeed good to have a wide range of spearkers. Yudkowsky is a bit on the fringe, but calls for him not to be given a voice (from the woke left) were very distasteful.

Expand full comment