Wow. Interesting read. I'm much more optimistic than Marcus even though I disagree with his neuro-symbolic approach. It's always darkest before dawn. The AI field is on the cusp of another one of Kuhn's proverbial paradigm shifts. I think the time has come for a few brave maverick thinkers to throw the whole field out the window and start anew.
The AI community's obsession with language is a perfect example of putting the cart before the horse. Perceptual generalization should come first. It is the most important component of intelligence but the community, as a whole, has largely ignored it. The representationalist approach, which deep learning embodies, is the notion that *everything* in the world must be represented in the system. It should be the first thing to be thrown out, I'm sorry to say. Corner cases and adversarial patterns have proved deadly to DL, something that the autonomous vehicle industry found out the hard way after spending over 100 billion dollars by betting on DL. Combining DL with symbolic AI will not solve this problem.
Consider that a lowly honeybee's brain has less than 1 million neurons and yet it can navigate and survive in highly complex 3D environments. The bee can do it because it can generalize. It has to because its tiny brain cannot possibly store millions of learned representations of all the objects and patterns it might encounter in its lifetime. In other words, generalization is precisely what is required when scaling is too costly or is not an option. Emulating the generalizing ability of a bee’s tiny brain would be tantamount to solving AGI in my opinion. Cracking generalized perception alone would be a monumental achievement. Scaling and adding motor control, goal-oriented behavior and even a language learning capability would be a breeze in comparison.
The exciting thing is that one does need expensive supercomputers to achieve true perceptual generalization. There's no reason it cannot be demonstrated on a desktop computer with a few thousands neurons. Scaling can come later. I think a breakthrough can happen at any time because some of us AGI researchers see the current AI paradigm merely as examples of what not to do. We're taking a different route altogether. Systematic generalization is a growing subfield of AI. My prediction is that cracking AGI on an insect level can happen within 10 years. Scaling to human-level intelligence and beyond will mostly be an engineering problem with a known solution.
AGI is a race and only the best approach will win. Good luck to all participants.
Gary, I meant to respond to this when it first arrived. This is a particularly well written piece. Couldnt agree with you more about databases of machine interpretable knowledge. and the need for hand crafted knowledge combined with learning from data if it made sense. Exactly what I had characterized as 'computational abstractions' in one of my papers.
You mentioned adaptability. I agree with you there. It's one of the keys or hallmarks of AGI. However, we will not get that anytime soon.
The limitation is that everything is centered around explicit architectures and optimization objectives. As a result, I currently cannot see the rise of an optimization objective that brings broad adaptivity across domains and tasks.
A human can change objectives based on external factors and the environment. For example, say a human wants to become a professional soccer player because it's fun. At some point, the objective is maybe maximizing the income, and when the soccer player becomes too old for professional soccer, a new job needs to be learned.
Is there an overarching far-goal objective that makes humans switch between near-goal goals? An overarching objective like achieving happiness in life? How do we program a broad, vague overarching objective into an AGI that facilitates choosing between near-goal, explicit objectives for adaptivity? An evolutionary programming approach may be necessary to let the systems evolve in a controlled random fashion.
I do think that certain domain-specific capabilities will emerge automatically (for example, how some general language skills emerge in decoder-style transformers if they are trained on next-word prediction). But it's hard to imagine how we can get to adaptivity across domains and tasks. And then, there is also the question of whether an adaptive system is helpful. It will undoubtedly be useful as a marketing stunt. Still, is a system that can adapt to a specific task (and do a somewhat good job at it) better/more economical/more useful than a special-purpose, more narrow AI designed specifically for the task at hand?
Anyways, I am just thinking out loud and just wanted to say that I really liked this interview! Thanks for sharing!
What is intelligence? The ability to make choices for survival and reproduction. Plants are intelligent; they make chemicals to chase off insects and other plants. Insects are intelligent; they manage to invade your kitchen for food. Animals are intelligent; they survive and thrive in the wild, finding food every day. Humans are intelligent; well, maybe... unless they manage to bomb themselves or set the planet on fire.
I've been involved with robots. I used to be a researcher at Unimation. I've been involved in AI. I published work in Expert Systems and Knowledge Representation. I've done research in task planning. I've done work in Robot/Human cooperation on changing a tire. Now I'm working on self-reproducing systems that self-survive.
In all the areas I've seen there are only "imitations" of intelligent behavior. Hey, we made it speak! Oh, look, the robot can walk! Oh, look, it now spouts perfectly formed nonsense (we made a politician!).
Wake me when we make something that self-survives and self-reproduces. The closest I've seen is work by Craig Venter on finding the minimal viable DNA sequence that self-survives and self-reproduces. Once it gets out of the lab and survives then we will have created an intelligence. As Darwin noted, once the survival pressure arrives, it will evolve or die.
We will know intelligence has arrived when we see it exponentially reproduce and when we can't shut it off. Venter's 'bacteria robot' won't have an off switch. If it can make dopamine, people will want it so badly that it will survive and reproduce. Game over.
Now we just need a 'Venter robot' to destroy Pineapple crops and save the Pizza business.
Speaking of the neuro stuff, count me as unimpressed.
I audited Minsky and Pappert's graduate AI seminar fall term 1972. In it, Minsky spent an inordinate amount of time pointing out that as a computational model, perceptrons couldn't actually compute the things people insisted they could. IMHO, things haven't improved much. (Only 50 years ago, not 75, so this doesn't count as a data point on 75 years being enough or not for major change.)
In real life, the average mammalian neuron has hundreds of inputs and thousands of outputs, a cubic millimeter of grey matter has multiple _kilometers_ of wiring (axons). The idea that the "neural net" model is a model of neurons is silly** in the extreme. (One article I read the other day pointed to research that indicates that human neurons may be quite a bit more complex that rat neurons. Since "mammalian neuron" is a rat neuron*, things are probably even worse than I think. (On the other hand, avian neurons may be better still: bird brains manage to pack the same functionality (as non-homo mammals) into, if anything, less space without needing to resort to the mammalian trick of macroscopic folds in the grey matter.))
Like climate change, with every article I read, things are shown to be worse than I thought they possibly could be. (I advise against subscribing to Science: it's too depressing.)
*: Oh, yes. Rat neurons. Rat brain researchers found individual neurons that lit up in correspondence with points in local 3D space, and said researchers thought they were making progress. More recently, they found that it seems that the same neuron that (presumably) represents a point in 3D local space, also functions to represent a point in 3D global space as well. That is, a rat's representation of space in its neurons is still something beyond what we can understand just yet. Oops. (I love the folks who try to figure this stuff out: it's impossibly hard, but they try anyway. And sometimes find kewl stuff.)
**: The sum-and-threshold operation that's the basis of both Perceptrons and neural nets is only one of the many computational (and logic!) functions performed by neurons. So "silly" here really is the right term.
The CNET debacle really brought the point home for me, which made it all the more surprising to discover you went ahead and use an LLM to produce the interview above!
It was surely an unreliable neural network, dozing off in his comfy Markov blanket, to dream up figures like the "golum", which is some sort of superimposition of the Golem, Gollum, and perhaps Talos (closest i could get in Greek mythology); attribute souls to tibiae; misspell Shelley and Wiener.
Also, the context seems to be affecting the output on a merely correlational basis: the generally pessimistic approach leaks into a common imported idiom in "scaling-über-alas"; there are slips of the tongue typical of a model who's unable to map grammar and syntax to Forms through the rigorous application of Propositional Calculus, thus producing aberrations such as "whose's".
Not even the human-in-the loop doing "light editing" managed to help on this!
In conclusion, you proved your point. Language models are unreliable. You could have just said that and avoided such snarky mise en scène, that's all.
Since you all briefly mention the "singularity" idea, I thought I'd make my snarky comment on it.
I like the "singularity" idea: that intelligent systems reach a threshold beyond which their abilities become significantly and qualitatively superior; up on another plane, so to speak. I think it's dead-on correct.
The problem is that it's already happened and the folks talking about it have missed it. It's us. We just don't get how incredibly far beyond the rest of the animals on this planet we are. My favorite example of this is the trivia item that we're the only animals on the planet that understands that sex leads to pregnancy, and pregnancy leads to childbirth. No other animal on this planet can deal with family relationships, can understand that this thing is their kith and kin. That reasoning is simply nor there. Outside of homo sapiens.
So the idea that there's something "smarter than people" around the corner is problematic, since we don't even get it how smart homo sapiens is. (The point that people can be idiots is well taken, we can be, but it doesn't disprove that we figured out QM and Galois theory.) Watching all the ethnologists and philosophers freaking out when they find some animal that can remember were it hid three acorns and get all hot and bothered exclaiming "animals can do mathematics!" is hilarious. The foundational question of our field is still there laughing at us: "What is a number than a man may know it, and a man that he may know a number."
Very interesting read indeed - so much so that it became a discussion point in my interview with Dr. Denise Cook based on the Xzistor Concept brain model.
My take-away: on several occasions, both mr. Booch an mr. Marcus are implicitly predicting the next AI-winter. Hype-funding of LLM (and neural nets in general) will become disillusioned, and this will infect all progress for 2 decades. Next jump: > 2049 (past predicted singularity). Rinse and repeat, and we’re > 150 years.
Tim Daly has a point – this post sounds deeply anthropocentric, coloring otherwise sound points. The most sound point being 'architecture is all' which Gary and Grady seem to agree. The problem is 'architecture of what exactly?' which I do not see really specified.
> Legg and Hutter’s definition “Intelligence is an agent’s ability to achieve goals in a wide range of environments.”<
This heads in the right direction by specifying 'agent' (generic) instead of a heavily implied 'human agent' . . . but 'wide range of environments' – as a *context* for intelligence – is hopelessly vague. So again, no specific architecture.
> I also don’t see you entirely defining your terms.<
Can be said about almost ALL AGI discussions . . . swimming in confused word soup.
For an architectural alternative, one might consider:
'Entropy – a scientific base for super-intelligence'
ABSTRACT
This paper frames Super-Intelligence via three scientific roles. It starts by defining key terms: general and super intelligence, knowledge, and informatic process. It next names thermodynamic entropy, Signal Entropy, and Darwinian evolution, as scientific roles (informatic processes) that can be joined as an ‘Entropic continuum’ – making Entropy (as detailed below) the model’s core principle. The continuum maps general percepts of falling-apart, joining, and selective functioning as respective ‘levels’, each with differed Entropic Degrees of Freedom (DoF). The paper next notes the continuum entails a Bateson-like ‘pattern that connects’ the cosmos – a dualist-triune (2-3), where 2-3 functional DoF analysis offers a means for General and Super-Intelligence modeling. Further continuum details arise via progressively deeper DoF analysis. This approach does not envision an autonomous ‘singleton’ arising to dominate humanity. It instead targets a general ‘insight engine’ to aid human innovation and discovery, in a Naturally creative/contiguous simple-to-complex manner (3,700 words).
The key question here - what is intelligence and how it works - and that leads to the main scientific question - what is life and what is its key function. The answer is transformation - it's a universal mechanism that any system in the universe features - a life cycle.
For example - a biological cell as a basis of life. No matter, artificial or natural - all anywhere is functioning using the same principle of transformation. Just compare the architectures of a cell and a network using OSI model.
Cell network architecture - OSI model
= Membrane = Protein receptors =
7 - Application layer - Protein
High-level protocols such as for resource sharing or remote file access, e.g. HTTP.
6 - Presentation layer - Translation - tRNA
Translation of data between a networking service and an application; including character encoding, data compression and encryption/decryption
5 - Session layer - Ribosome - mRNA
Managing communication sessions, i.e., continuous exchange of information in the form of multiple back-and-forth transmissions between two nodes
Interesting that my own AGI project generates the critical Java business rules' source code from controlled English specifications using Booch UML activity models as the basis for specifying Java methods.
So cool. Thank you Grady.
If it happens in my remaining lifetime you had a role.
It’s a great conversation to put out there even if it seems a reply or a chat between two individuals. When I had opportunity to learn a little bit about Artificial intelligence (AI) in one of IBM certification, I kept on mind three aspects: weak AI , Artificial general intelligence (AGI) and Artificial super intelligence(ASI).
Although, weak AI has been with us daily and for a while through chatbots , intelligent assistant services ( Alexa ,Siri , …) and other dissimulated products. What’s been now a debate is AGI ?
As far as I’m concerned AGI is the artificial intelligence that could or have the expertise of human in a specific domain. An intelligent system that can help expert in some tasks which impossible without a gained expertise for another human. As an example a system that can diagnose with a perfect accuracy a disease in medical field. And may be later this definition could be extended to replace or not that expert. I’ve followed the article till the end which extends the ability of sentience to the AGI.
In fact, when AGI has this possibility. That means it can achieve also self-awareness. At this level it’s no more AGI but ASI.
When we see the development of AI in general we were focused most times towards a sense of kind of intelligence.
Thus lead us from the perceptron to the complex architecture we have now. I’m aware that all the way we had some visions to improve things and to tackle other problems by taking different approaches ( expert systems for example). We could agree that none of them focused on sentience or self-awareness at the beginning. We’re somewhat overloaded by breakthroughs in AI following the path ( Machine-deep Learning) that thankfully being facilitated by maths and the improvement in the area, that we’re thinking AI in that way. I approve that intelligence is about reasoning and not just an improved weak AI.
For the time right now, intelligence can be more or less embodied in system softwares like ChatGPT. Everyone will agree that AGI will be achieved when a physical system like robots 🤖 will have a total or a slight part of self-awareness. I’m not sceptical and aligned with Gary that we have to be part of it in rethinking of what ideas have to be delivered. Anyway we’re driving by supply & demand. The fast we realize that, the better we will be prepared.
If one can’t agree. Though, it’s happening and it’s matter of time. Nonetheless , Neuralink is another way to fight back when AI is overtaken humans. But I’m definitely sceptical on this one.
AGI will not happen in your lifetime. Or will it?
Wow. Interesting read. I'm much more optimistic than Marcus even though I disagree with his neuro-symbolic approach. It's always darkest before dawn. The AI field is on the cusp of another one of Kuhn's proverbial paradigm shifts. I think the time has come for a few brave maverick thinkers to throw the whole field out the window and start anew.
The AI community's obsession with language is a perfect example of putting the cart before the horse. Perceptual generalization should come first. It is the most important component of intelligence but the community, as a whole, has largely ignored it. The representationalist approach, which deep learning embodies, is the notion that *everything* in the world must be represented in the system. It should be the first thing to be thrown out, I'm sorry to say. Corner cases and adversarial patterns have proved deadly to DL, something that the autonomous vehicle industry found out the hard way after spending over 100 billion dollars by betting on DL. Combining DL with symbolic AI will not solve this problem.
Consider that a lowly honeybee's brain has less than 1 million neurons and yet it can navigate and survive in highly complex 3D environments. The bee can do it because it can generalize. It has to because its tiny brain cannot possibly store millions of learned representations of all the objects and patterns it might encounter in its lifetime. In other words, generalization is precisely what is required when scaling is too costly or is not an option. Emulating the generalizing ability of a bee’s tiny brain would be tantamount to solving AGI in my opinion. Cracking generalized perception alone would be a monumental achievement. Scaling and adding motor control, goal-oriented behavior and even a language learning capability would be a breeze in comparison.
The exciting thing is that one does need expensive supercomputers to achieve true perceptual generalization. There's no reason it cannot be demonstrated on a desktop computer with a few thousands neurons. Scaling can come later. I think a breakthrough can happen at any time because some of us AGI researchers see the current AI paradigm merely as examples of what not to do. We're taking a different route altogether. Systematic generalization is a growing subfield of AI. My prediction is that cracking AGI on an insect level can happen within 10 years. Scaling to human-level intelligence and beyond will mostly be an engineering problem with a known solution.
AGI is a race and only the best approach will win. Good luck to all participants.
Gary, I meant to respond to this when it first arrived. This is a particularly well written piece. Couldnt agree with you more about databases of machine interpretable knowledge. and the need for hand crafted knowledge combined with learning from data if it made sense. Exactly what I had characterized as 'computational abstractions' in one of my papers.
This is the most genuinely generally intelligent (GGI) piece on AGI I have read in recent memory.
This interview is a real treat!
You mentioned adaptability. I agree with you there. It's one of the keys or hallmarks of AGI. However, we will not get that anytime soon.
The limitation is that everything is centered around explicit architectures and optimization objectives. As a result, I currently cannot see the rise of an optimization objective that brings broad adaptivity across domains and tasks.
A human can change objectives based on external factors and the environment. For example, say a human wants to become a professional soccer player because it's fun. At some point, the objective is maybe maximizing the income, and when the soccer player becomes too old for professional soccer, a new job needs to be learned.
Is there an overarching far-goal objective that makes humans switch between near-goal goals? An overarching objective like achieving happiness in life? How do we program a broad, vague overarching objective into an AGI that facilitates choosing between near-goal, explicit objectives for adaptivity? An evolutionary programming approach may be necessary to let the systems evolve in a controlled random fashion.
I do think that certain domain-specific capabilities will emerge automatically (for example, how some general language skills emerge in decoder-style transformers if they are trained on next-word prediction). But it's hard to imagine how we can get to adaptivity across domains and tasks. And then, there is also the question of whether an adaptive system is helpful. It will undoubtedly be useful as a marketing stunt. Still, is a system that can adapt to a specific task (and do a somewhat good job at it) better/more economical/more useful than a special-purpose, more narrow AI designed specifically for the task at hand?
Anyways, I am just thinking out loud and just wanted to say that I really liked this interview! Thanks for sharing!
Wow, such human-centric thinking!
What is intelligence? The ability to make choices for survival and reproduction. Plants are intelligent; they make chemicals to chase off insects and other plants. Insects are intelligent; they manage to invade your kitchen for food. Animals are intelligent; they survive and thrive in the wild, finding food every day. Humans are intelligent; well, maybe... unless they manage to bomb themselves or set the planet on fire.
I've been involved with robots. I used to be a researcher at Unimation. I've been involved in AI. I published work in Expert Systems and Knowledge Representation. I've done research in task planning. I've done work in Robot/Human cooperation on changing a tire. Now I'm working on self-reproducing systems that self-survive.
In all the areas I've seen there are only "imitations" of intelligent behavior. Hey, we made it speak! Oh, look, the robot can walk! Oh, look, it now spouts perfectly formed nonsense (we made a politician!).
Wake me when we make something that self-survives and self-reproduces. The closest I've seen is work by Craig Venter on finding the minimal viable DNA sequence that self-survives and self-reproduces. Once it gets out of the lab and survives then we will have created an intelligence. As Darwin noted, once the survival pressure arrives, it will evolve or die.
We will know intelligence has arrived when we see it exponentially reproduce and when we can't shut it off. Venter's 'bacteria robot' won't have an off switch. If it can make dopamine, people will want it so badly that it will survive and reproduce. Game over.
Now we just need a 'Venter robot' to destroy Pineapple crops and save the Pizza business.
-- Tim Daly
Speaking of the neuro stuff, count me as unimpressed.
I audited Minsky and Pappert's graduate AI seminar fall term 1972. In it, Minsky spent an inordinate amount of time pointing out that as a computational model, perceptrons couldn't actually compute the things people insisted they could. IMHO, things haven't improved much. (Only 50 years ago, not 75, so this doesn't count as a data point on 75 years being enough or not for major change.)
In real life, the average mammalian neuron has hundreds of inputs and thousands of outputs, a cubic millimeter of grey matter has multiple _kilometers_ of wiring (axons). The idea that the "neural net" model is a model of neurons is silly** in the extreme. (One article I read the other day pointed to research that indicates that human neurons may be quite a bit more complex that rat neurons. Since "mammalian neuron" is a rat neuron*, things are probably even worse than I think. (On the other hand, avian neurons may be better still: bird brains manage to pack the same functionality (as non-homo mammals) into, if anything, less space without needing to resort to the mammalian trick of macroscopic folds in the grey matter.))
Like climate change, with every article I read, things are shown to be worse than I thought they possibly could be. (I advise against subscribing to Science: it's too depressing.)
*: Oh, yes. Rat neurons. Rat brain researchers found individual neurons that lit up in correspondence with points in local 3D space, and said researchers thought they were making progress. More recently, they found that it seems that the same neuron that (presumably) represents a point in 3D local space, also functions to represent a point in 3D global space as well. That is, a rat's representation of space in its neurons is still something beyond what we can understand just yet. Oops. (I love the folks who try to figure this stuff out: it's impossibly hard, but they try anyway. And sometimes find kewl stuff.)
**: The sum-and-threshold operation that's the basis of both Perceptrons and neural nets is only one of the many computational (and logic!) functions performed by neurons. So "silly" here really is the right term.
AGI is already here; not due to intelligent computers, but due to incedibly STUPID HUMANS.
"Human intelligence" has disappeared
The CNET debacle really brought the point home for me, which made it all the more surprising to discover you went ahead and use an LLM to produce the interview above!
It was surely an unreliable neural network, dozing off in his comfy Markov blanket, to dream up figures like the "golum", which is some sort of superimposition of the Golem, Gollum, and perhaps Talos (closest i could get in Greek mythology); attribute souls to tibiae; misspell Shelley and Wiener.
Also, the context seems to be affecting the output on a merely correlational basis: the generally pessimistic approach leaks into a common imported idiom in "scaling-über-alas"; there are slips of the tongue typical of a model who's unable to map grammar and syntax to Forms through the rigorous application of Propositional Calculus, thus producing aberrations such as "whose's".
Not even the human-in-the loop doing "light editing" managed to help on this!
In conclusion, you proved your point. Language models are unreliable. You could have just said that and avoided such snarky mise en scène, that's all.
Since you all briefly mention the "singularity" idea, I thought I'd make my snarky comment on it.
I like the "singularity" idea: that intelligent systems reach a threshold beyond which their abilities become significantly and qualitatively superior; up on another plane, so to speak. I think it's dead-on correct.
The problem is that it's already happened and the folks talking about it have missed it. It's us. We just don't get how incredibly far beyond the rest of the animals on this planet we are. My favorite example of this is the trivia item that we're the only animals on the planet that understands that sex leads to pregnancy, and pregnancy leads to childbirth. No other animal on this planet can deal with family relationships, can understand that this thing is their kith and kin. That reasoning is simply nor there. Outside of homo sapiens.
So the idea that there's something "smarter than people" around the corner is problematic, since we don't even get it how smart homo sapiens is. (The point that people can be idiots is well taken, we can be, but it doesn't disprove that we figured out QM and Galois theory.) Watching all the ethnologists and philosophers freaking out when they find some animal that can remember were it hid three acorns and get all hot and bothered exclaiming "animals can do mathematics!" is hilarious. The foundational question of our field is still there laughing at us: "What is a number than a man may know it, and a man that he may know a number."
Very interesting read indeed - so much so that it became a discussion point in my interview with Dr. Denise Cook based on the Xzistor Concept brain model.
See here: The Uneasy Road to AGI
https://www.youtube.com/watch?v=HKI8z3Nm5hg
My take-away: on several occasions, both mr. Booch an mr. Marcus are implicitly predicting the next AI-winter. Hype-funding of LLM (and neural nets in general) will become disillusioned, and this will infect all progress for 2 decades. Next jump: > 2049 (past predicted singularity). Rinse and repeat, and we’re > 150 years.
Tim Daly has a point – this post sounds deeply anthropocentric, coloring otherwise sound points. The most sound point being 'architecture is all' which Gary and Grady seem to agree. The problem is 'architecture of what exactly?' which I do not see really specified.
> Legg and Hutter’s definition “Intelligence is an agent’s ability to achieve goals in a wide range of environments.”<
This heads in the right direction by specifying 'agent' (generic) instead of a heavily implied 'human agent' . . . but 'wide range of environments' – as a *context* for intelligence – is hopelessly vague. So again, no specific architecture.
> I also don’t see you entirely defining your terms.<
Can be said about almost ALL AGI discussions . . . swimming in confused word soup.
For an architectural alternative, one might consider:
'Entropy – a scientific base for super-intelligence'
ABSTRACT
This paper frames Super-Intelligence via three scientific roles. It starts by defining key terms: general and super intelligence, knowledge, and informatic process. It next names thermodynamic entropy, Signal Entropy, and Darwinian evolution, as scientific roles (informatic processes) that can be joined as an ‘Entropic continuum’ – making Entropy (as detailed below) the model’s core principle. The continuum maps general percepts of falling-apart, joining, and selective functioning as respective ‘levels’, each with differed Entropic Degrees of Freedom (DoF). The paper next notes the continuum entails a Bateson-like ‘pattern that connects’ the cosmos – a dualist-triune (2-3), where 2-3 functional DoF analysis offers a means for General and Super-Intelligence modeling. Further continuum details arise via progressively deeper DoF analysis. This approach does not envision an autonomous ‘singleton’ arising to dominate humanity. It instead targets a general ‘insight engine’ to aid human innovation and discovery, in a Naturally creative/contiguous simple-to-complex manner (3,700 words).
link to current draft:
https://drive.google.com/file/d/1wNtaOib67CMsBe0SudNDl6ZVWrbXmdNw/view?usp=share_link
Good conversation. Gary Marcus, how do you define consciousness versus sentience?
The key question here - what is intelligence and how it works - and that leads to the main scientific question - what is life and what is its key function. The answer is transformation - it's a universal mechanism that any system in the universe features - a life cycle.
For example - a biological cell as a basis of life. No matter, artificial or natural - all anywhere is functioning using the same principle of transformation. Just compare the architectures of a cell and a network using OSI model.
Cell network architecture - OSI model
= Membrane = Protein receptors =
7 - Application layer - Protein
High-level protocols such as for resource sharing or remote file access, e.g. HTTP.
6 - Presentation layer - Translation - tRNA
Translation of data between a networking service and an application; including character encoding, data compression and encryption/decryption
5 - Session layer - Ribosome - mRNA
Managing communication sessions, i.e., continuous exchange of information in the form of multiple back-and-forth transmissions between two nodes
Data - 5 - 7
= Nucleus =
4 - Transport layer - Segments, Datagrams - Spliceosome - Splicing - mRNA
Reliable transmission of data segments between points on a network, including segmentation, acknowledgement and multiplexing
3 - Network layer - Packets - Transcription - pre-mRNA
Structuring and managing a multi-node network, including addressing, routing and traffic control
2 - Data link layer - Frames - DNA
Transmission of data frames between two nodes connected by a physical layer
= Nucleus =
1 - Physical layer - Bits, Symbols - Signal cascades
= Membrane = Protein receptors =
Interesting that my own AGI project generates the critical Java business rules' source code from controlled English specifications using Booch UML activity models as the basis for specifying Java methods.
So cool. Thank you Grady.
If it happens in my remaining lifetime you had a role.
It’s a great conversation to put out there even if it seems a reply or a chat between two individuals. When I had opportunity to learn a little bit about Artificial intelligence (AI) in one of IBM certification, I kept on mind three aspects: weak AI , Artificial general intelligence (AGI) and Artificial super intelligence(ASI).
Although, weak AI has been with us daily and for a while through chatbots , intelligent assistant services ( Alexa ,Siri , …) and other dissimulated products. What’s been now a debate is AGI ?
As far as I’m concerned AGI is the artificial intelligence that could or have the expertise of human in a specific domain. An intelligent system that can help expert in some tasks which impossible without a gained expertise for another human. As an example a system that can diagnose with a perfect accuracy a disease in medical field. And may be later this definition could be extended to replace or not that expert. I’ve followed the article till the end which extends the ability of sentience to the AGI.
In fact, when AGI has this possibility. That means it can achieve also self-awareness. At this level it’s no more AGI but ASI.
When we see the development of AI in general we were focused most times towards a sense of kind of intelligence.
Thus lead us from the perceptron to the complex architecture we have now. I’m aware that all the way we had some visions to improve things and to tackle other problems by taking different approaches ( expert systems for example). We could agree that none of them focused on sentience or self-awareness at the beginning. We’re somewhat overloaded by breakthroughs in AI following the path ( Machine-deep Learning) that thankfully being facilitated by maths and the improvement in the area, that we’re thinking AI in that way. I approve that intelligence is about reasoning and not just an improved weak AI.
For the time right now, intelligence can be more or less embodied in system softwares like ChatGPT. Everyone will agree that AGI will be achieved when a physical system like robots 🤖 will have a total or a slight part of self-awareness. I’m not sceptical and aligned with Gary that we have to be part of it in rethinking of what ideas have to be delivered. Anyway we’re driving by supply & demand. The fast we realize that, the better we will be prepared.
If one can’t agree. Though, it’s happening and it’s matter of time. Nonetheless , Neuralink is another way to fight back when AI is overtaken humans. But I’m definitely sceptical on this one.