Share this comment
“The act of referring involves (at least) the speaker, the utterance, the context, and some properties of the external world; the interactions and dependencies between such things simply are not present in most current AI models. Reference is about much more than predicting the next word; it’s about connecting words with (internal repres…
“The act of referring involves (at least) the speaker, the utterance, the context, and some properties of the external world; the interactions and dependencies between such things simply are not present in most current AI models.
Reference is about much more than predicting the next word; it’s about connecting words with (internal representations) of the external world. When we tell you there is a cat on the mat, we ask you to think about a specific cat in the world, in a specific place, and expect that you build an internal cognitive model that satisfies those expectations.”
These are exactly the components of a symbolic language model - Neural network for interpreting sentences of a natural language - https://patentscope.wipo.int/search/en/detail.jsf?docId=US339762244&_fid=WO2020106180