Hot take on Google’s Gemini and GPT-4
Gemini was just announced. Here’s my hot take:
Gemini seems to have by many measures matched (or slightly exceeded) GPT-4, but not to have blown it away.
From a commercial standpoint GPT-4 is no longer unique. That’s a huge problem for OpenAI, especially post drama, when many customers are now seeking a backup plan. From a technical standpoint, the key question is: are LLMs close to a plateau?
Note that Gates and Altman have both been dropping hints, and GPT-5 isn’t here after a year despite immense commercial desire. The fact that Google, with all its resources, did NOT blow away GPT-4 could be telling.
Gary Marcus apologizes for all the typos in recent essays, and looks forward to a time at which he is not burning his candle at three ends. He promisees that his forthcoming book will be professionally copy-edited, and is sorry that these brief posts are not.
When he finally has a free moment, he will hire an editor.
The problem is they are consuming all the internet data, leaving no space for creating independent test sets to really evaluate these models.
Let's solve the simple productivity issue at hand. I apply to be your professional editor. For more details, kindly check your webmail.