Nope, the Turing Test has not been solved
though it might not matter that much if it did
Just now, from Sam Altman himself
Let that sink in. ELIZA (built in 1965-1966) beat GPT 3.5. That’s embarrassing! 1966 software that could easily run on my watch running competitively with multi-million GPU clusters trained on a large fraction of the internet. (Full article at https://arxiv.org/abs/2310.20216)
And, sorry Sam, when you actually look at the data. humans are still ahead.
But honestly, who cares?
Here’s what I wrote about this almost a decade ago, at The New Yorker, the last time someone tried to hype a result on the Turing Test
and very much anticipating the current situation
What I proposed then, as a replacement to the Turing Test, was a Comprehension Challenge; even now, no software would be able to meet that challenge.
Dubious Google Gemini videos aside, nobody is close to passing that yet.
Plus ça change, plus c'est la même chose.
Gary Marcus can’t believe that the articles he wrote in 2014 are still so directly relevant. But there you go.
Marcus on AI is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.