The Road to AI We Can Trust

Share this post

A temporary pause on training extra large language models

garymarcus.substack.com

A temporary pause on training extra large language models

Gary Marcus
Mar 29, 2023
45
55
Share
Share this post

A temporary pause on training extra large language models

garymarcus.substack.com

Breaking news: The letter that I mentioned earlier today is now public. It calls for a 6 month moratorium on training systems that are “more powerful than GPT-4”. A lot of notable people signed. I joined in.

I had no hand in drafting it, and there are things to fuss over (e.g., what exactly counts as more powerful than GPT-4? and how would we know, given that no details of GPT-4’s architecture or training set have been published?)—but the spirit of the letter is one that I support: until we get a better handle on the risks and benefits, we should proceed with caution.

It will be very interesting to see what happens next.

Twitter avatar for @GaryMarcus
Gary Marcus @GaryMarcus
a big deal: @elonmusk, Y. Bengio, S. Russell, ⁦⁦@tegmark⁩, V. Kraknova, P. Maes, ⁦@Grady_Booch, ⁦@AndrewYang⁩, ⁦@tristanharris⁩ & over 1,000 others, including me, have called for a temporary pause on training systems exceeding GPT-4
futureoflife.orgPause Giant AI Experiments: An Open Letter - Future of Life InstituteWe call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.
1:10 AM ∙ Mar 29, 2023
175Likes65Retweets

Gary Marcus (@garymarcus), scientist, bestselling author, and entrepreneur, is deeply, deeply concerned about current AI but really hoping that we might do better.

Watch for his new podcast, Humans versus Machines, debuting later this Spring.

Share

45
55
Share
Share this post

A temporary pause on training extra large language models

garymarcus.substack.com
55 Comments
J Rainstar
Writes J’s Substack
Mar 29

A honor-bound system will do absolutely nothing in a world where selfish actors prevail.

This is purely a political gesture on the part of those promoting this letter. And AI is not the only crisis facing us in this moment- we have MRNA-based technology(merck, others) proliferating in the food chain under continued emergency use authorizations(where rigorous testing is not required), and an increasingly global economy with all of the political implications that come with corporations engineering the media to ensure political success for individuals with the mouth of an elephant and the brain of a mouse. All anyone and everyone does is talk, because the only wealth generating potential anyone has in this modern world is to have and use their social influence. It's time to raise your hand. AI is a sign of the times, a sign that humanity needs to exit stage left.. before it is too late.

Expand full comment
Reply
Mike Cheponis
Mar 29

It's absolutely rich that the labs that are behind want OpenAI to slow down. Ohhh, that's really rich.....

Expand full comment
Reply
53 more comments…
Top
New
Community

No posts

Ready for more?

© 2023 Gary Marcus
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing