Bruce, your architecture sounds extremely *plausible*, brain-like [unlike NNs that are brain-like in name only!]. Curious how you represent experiences, including non-verbal ones (eg the experience of tripping on a rock, or feeling the wind - there's no data, or more generally, no symbols in these).
Bruce, your architecture sounds extremely *plausible*, brain-like [unlike NNs that are brain-like in name only!]. Curious how you represent experiences, including non-verbal ones (eg the experience of tripping on a rock, or feeling the wind - there's no data, or more generally, no symbols in these).
In my model, I view memories as “complex, streaming, associated, time-based, “perception experiences”. That is, what both humans and vertebrate animals “perceive” as an “experience” is the flow of all sensory signals through some pretty limited place in the brain, possibly at the “output” of the parietal lobe. Tripping on a rock, or feeling the wind, is simply the “experience” of the flow of signals from the entire body’s sensory system after the parietal lobe has processed them into a spatially coherent organization. As you say, there are no symbols at that point.
Now, continue the experience of “feeling the wind”. The parietal processed sensory nerve signals from the million sensors on the surface of the skin, that feel the fluttering coolness, are individually “streamed” into the volume of the brain that “memorizes” skin sensation. They are “output” into this volume as individual real-time data streams in exactly the same way tactile cells code their sensations. At the same time, on what computers would call a “parallel buss”, all those thousands of immediate sensations are broadcast individually to the chain of nerves memorizing the history for that individual nerve, for the entire sensory brain. When similar matches are detected, for the entire life memory of the individual animal, that prior experience is also sent back, in parallel fashion, to the parietal lobe, which just considers them an “associated” experience.
The result is, when we “feel” the wind, our primary “sensation” is just the signals from our skin cells. BUT, for every past experience, that the “comparator” nerves determine to be similar, those past experiences are blended into the current sensation. AND, what is actually stored as the current experience, is the BLENDED experience.
To address the “symbolic” issue, while the skin sensing process is occurring, other parts of the brain are simultaneously capturing input from all the other sensory systems: vision, balance and motion, temperature, sound, etc. The complex factor we call emotion is also being captured. A special part of the brain, that make us "human", is simultaneously capturing summaries of all of these.
A way to understand “symbology”, in this context, is to view “symbols” as just “unique” combinations of multiple sensations that we have been “trained” to memorize as important for particular experiences.
Bruce, your architecture sounds extremely *plausible*, brain-like [unlike NNs that are brain-like in name only!]. Curious how you represent experiences, including non-verbal ones (eg the experience of tripping on a rock, or feeling the wind - there's no data, or more generally, no symbols in these).
Saty,
In my model, I view memories as “complex, streaming, associated, time-based, “perception experiences”. That is, what both humans and vertebrate animals “perceive” as an “experience” is the flow of all sensory signals through some pretty limited place in the brain, possibly at the “output” of the parietal lobe. Tripping on a rock, or feeling the wind, is simply the “experience” of the flow of signals from the entire body’s sensory system after the parietal lobe has processed them into a spatially coherent organization. As you say, there are no symbols at that point.
Now, continue the experience of “feeling the wind”. The parietal processed sensory nerve signals from the million sensors on the surface of the skin, that feel the fluttering coolness, are individually “streamed” into the volume of the brain that “memorizes” skin sensation. They are “output” into this volume as individual real-time data streams in exactly the same way tactile cells code their sensations. At the same time, on what computers would call a “parallel buss”, all those thousands of immediate sensations are broadcast individually to the chain of nerves memorizing the history for that individual nerve, for the entire sensory brain. When similar matches are detected, for the entire life memory of the individual animal, that prior experience is also sent back, in parallel fashion, to the parietal lobe, which just considers them an “associated” experience.
The result is, when we “feel” the wind, our primary “sensation” is just the signals from our skin cells. BUT, for every past experience, that the “comparator” nerves determine to be similar, those past experiences are blended into the current sensation. AND, what is actually stored as the current experience, is the BLENDED experience.
To address the “symbolic” issue, while the skin sensing process is occurring, other parts of the brain are simultaneously capturing input from all the other sensory systems: vision, balance and motion, temperature, sound, etc. The complex factor we call emotion is also being captured. A special part of the brain, that make us "human", is simultaneously capturing summaries of all of these.
A way to understand “symbology”, in this context, is to view “symbols” as just “unique” combinations of multiple sensations that we have been “trained” to memorize as important for particular experiences.