๐๐ ๐๐ฒ๐ผ๐ฝ๐ผ๐น๐ถ๐๐ถ๐ฐ๐ ๐ฑ๐ฒ๐ฏ๐ฎ๐๐ฒ! My conversation with Chinaโs Victor Gao plus a hot take on new essay by Anthropicโs CEO Dario Amodei
[Sorry to swamp your mailboxes today, but there is a lot of important AI stuff happening.]
Victor Gao is a lawyer and former translator for Deng Xiaoping. We had a panel yesterday on UKโs Channel 4. I wish we had more time (and that I had had more time to respond), but we covered a lot of ground: censorship, the nature of intelligence, tariffs and more.
Fascinating preview of how things may start to play out. And one of the first East-West conversations I have seen, post DeepSeek.
ยง
Meanwhile, on related topics, Dario Amodei, CEO of Anthropic, just posted a long essay also on China, DeepSeek etc.
ยง
My hot take on his essay:
โข DeepSeek definitely has him rattled. The piece is a long and articulate, but also quite defensive.
โข To his credit, however, it is vastly more substantive than Altman's reply.
โข Some of his points are valid, e.g. Amodei is correct that DeepSeek didn't do anything in terms of cost reductions that wouldn't have happened here before too long, anyway. (Still embarrassing to the US giants though that a leaner, hungrier startup abroad got there first.)
โข That said, some of Amodei's individual arguments are much weaker than he lets on. For example he writes authoritatively (chatbot-style!) that "Making AI that is smarter than almost all humans at almost all things will require millions of chips, tens of billions of dollars (at least), and is most likely to happen in 2026-2027." We don't actual KNOW this; we humans are flexible, general, resourceful thinkers but it is not at all clear that we actually need the equivalent of millions of chips to achieve what we do. (And we humans only need about 20 watts, not gigawatts).
โข The real lesson of DeepSeek is that we can still make vast improvements in efficency. When all is said and done, with the right software, we might be able to build intelligence with hundreds or even dozens of GPUs. I seriously doubt that the best algorithm will require millions of high-end GPUs.
โข 2026-2027 are made up dates. ๐ ๐ต๐ฒ๐ฟ๐ฒ๐ฏ๐ ๐ผ๐ณ๐ณ๐ฒ๐ฟ ๐๐ฎ๐ฟ๐ถ๐ผ ๐ฎ $๐ญ๐ฌ๐ฌ,๐ฌ๐ฌ๐ฌ ๐ฏ๐ฒ๐ ๐๐ต๐ฎ๐ ๐๐ฒ ๐๐ถ๐น๐น ๐ป๐ผ๐ ๐ต๐ฎ๐๐ฒ ๐๐ ๐๐ต๐ฎ๐ ๐ถ๐ '๐๐บ๐ฎ๐ฟ๐๐ฒ๐ฟ ๐๐ต๐ฎ๐ป ๐ฎ๐น๐บ๐ผ๐๐ ๐ฎ๐น๐น ๐ต๐๐บ๐ฎ๐ป ๐ฏ๐ฒ๐ถ๐ป๐ด๐' ๐ฏ๐ ๐๐ต๐ฒ ๐ฒ๐ป๐ฑ ๐ผ๐ณ ๐ฎ๐ฌ๐ฎ๐ณ (per criteria I laid out previously with @milesbrundage).
โข Amodei's takeaway is to urge the U.S. to double down on export controls that would help his company. But the truth is that so far those controls have not been terribly successful; and may even have had paradoxical effects. China just largely caught up despite existing controls, and indeed were perhaps forced harder towards important efficiency gains precisely because necessity is the mother of invention.
My takeaway is different: the LLM race is an enormously expensive effort to win a race that can no longer be won. The country that does its best to develop a new tech that is more reliable and more difficult to replicate will win.
We should be thinking about how to sponsor innovation, and recognize that the best funded companies aren't always the most innovative. Going all in on them is a mistake.
Amodei's biggest advantage is having more chips, and I understand him wanting to prosecute that advantage, but what we really need are better ideas, and the oxygen for innovative startups to breathe.
Gary Marcus is the author of six books on natural and artificial intelligence, and founder of two AI startups, currently pondering the launch of a third.
โAutocomplete on steroidsโ. What we (edit laypersons) need so much are simple and efficient metaphors. Thank you very much for this one.
@garymarcus I wrote something yesterday and had DeepSeek R1 rewrite it.
My version's teaser was: "What if the very controls meant to stifle AI development are fueling a new wave of innovation instead?"
Here is my original version: https://bit.ly/3Cie44l
DeepSeek R1's teaser for its version was: "U.S. sanctions aimed to cripple China's AI ambitionsโinstead, they forged an antifragile juggernaut. Discover how DeepSeek R1 turned chip shortages into a blueprint for dominance."
Here is DeepSeek R1's version: https://bit.ly/4hvPvQ6
While DeepSeek R1's version has a notably patriotic tone from a Chinese perspective, that's not my main point.
Rather, I argue that sanctions only serve to make China antifragile. If they were allowed the ease and comfort of being dependent on NVIDIA, they would likely take the path of least resistance and inadvertently support the U.S. economy. This isn't to suggest China is lazy; they are extremely hard-working and smart. It's simply human nature, regardless of nationality, to take the easier path when it's available.
There is no doubt everyone has taken DeepSeek R1 seriously. NVIDIA shareholders certainly did and worked quite hard to defuse the wave of fear. U.S. frontier labs certainly did too.