Discover more from Marcus on AI
A Few Words About Bullshit
How MetaAI’s Galactica just jumped the shark
“what I find is that it's a very bizarre mixture of ideas that are solid and good with ideas that are crazy. It's as if you took a lot of very good food and some dog excrement and blended it all up so that you can't possibly figure out what's good or bad."
– Douglas Hofstadter
MetaAI has got a new AI system—trained on a hardcore diet of science, no less—and Yann LeCun is really, really proud of it:
Sounds great! I can’t wait to see the fawning New York Times story tomorrow morning.
But…wait…well, um, how do I put this politely? It prevaricates. A lot.
Just like every other large language model I have seen. And, to be honest, it’s kind of scary seeing an LLM confabulate math and science. High school students will love it, and use it to fool and intimidate (some of) their teachers. The rest of us should be terrified.
Perhaps first to point this out, earlier this evening, was David Chapman. Click through to find out what Galactica fabricated about bears in space!
Minutes after I noticed Chapman’s post, My friend Andrew Sundstrom began flooding me with a stream of examples of his own, too good for me not to share (with his permission):
Pitch perfect and utterly bogus imitations of science and math, presented as the real thing. (More examples: https://cs.nyu.edu/~davise/papers/ExperimentWithGalactica.html)
Is this really what AI has come to, automatically mixing reality with bullshit so finely we can no longer recognize the difference?