Noam Chomsky on Decoding the Human Mind & Neural Nets

  Переглядів 51,370

Eye on AI

Eye on AI

День тому

Welcome to episode #126 of Eye on AI with Craig Smith and Noam Chomsky.
Are neural nets the key to understanding the human brain and language acquisition? In this conversation with renowned linguist and cognitive scientist Noam Chomsky, we delve into the limitations of large language models and the ongoing quest to uncover the mysteries of the human mind.
Together, we explore the historical development of research in this field, from Minsky’s thesis to Geoff Hinton’s goals for understanding the brain. We also discuss the potential harms and benefits of large language models, comparing them to the internal combustion engine and its differences from a gazelle running. We tackle the difficult task of studying the neurophysiology of human cognition and the ethical implications of invasive experiments.
As we consider language as a natural object, we discuss the works of notable figures such as Albert Einstein, Galileo, Leibniz, and Turing, and the similarities between language and biology.
We even entertain the possibility of extraterrestrial language and communication. Join us on this thought-provoking journey as we explore the intricacies of language, the brain, and our place in the cosmos.
00:00 Preview
00:43 Introduction
01:54 Noam Chomsky’s neural net ideology & criticisms
06:58 Jeff Hinton & Noam Chomsky’s: How the brain works
10:05 Correlation between neural nets and the brain
11:11 Noam Chomsky’s reaction to Chat-GPT & LLMs
15:21 Exploring the mechanisms of the brain
19:00 What do we learn from chatbots?
22:36 What are impossible languages?
26:45 Generative AI doesn’t show true intelligence?
28:40 Is there a danger of AI becoming too intelligent?
31:30 Can AI language models become sentient?
36:40 Turing machine and neural nets experimentations
42:40 Non-evasive procedures for understanding the brain
45:54 Does Noam Chomsky still work on understanding the brain?
49:33 Is Noam Chomsky excited about the future of neural nets?
55:30 Albert Einstein and Galileo’s principles
55:40 Is there an extraterrestrial language model?
Craig Smith Twitter: / craigss
Eye on A.I. Twitter: / eyeon_ai

КОМЕНТАРІ: 208
@brendanstringer7225
@brendanstringer7225 10 місяців тому
Research shows that the brain declines as we age. Yet Mr. Chomsky is still so sharp, lucid, and involved in deeply rigorous research and thought. Truly incredible!
@afonsolopes9677
@afonsolopes9677 9 місяців тому
195 yars
@thedandelionranger
@thedandelionranger 8 місяців тому
True wisdom!!
@sallylauper8222
@sallylauper8222 8 місяців тому
Yeah, his ears may be out of order, but his brain isn't.
@TheEDub56
@TheEDub56 6 місяців тому
The effects of aging, absent any organic pathology, are limited to processing speed. Take a look at, for instance, the Chomsky's debates with Buckley. The only thing Chomsky's lost is processing speed.
@ShaopengChen
@ShaopengChen 10 місяців тому
Thank you for the interview. Noam Chomsky never ceased to amaze, with his breadth and depth of knowledge in a wide range of subjects. Even at 94, he still has all the energy to research and follow other super advanced research works, teach, give interviews, write and publish etc. I can barely understand his book on language, published decades ago... talking about difference in levels of intelligence, and he is always so humble.
@soufianebellahbib7808
@soufianebellahbib7808 9 місяців тому
💚🌴☀️
@DrJanpha
@DrJanpha 10 місяців тому
Thank you Craig for this exceptional interview. I admire the level of respect you have for Prof Chomsky - one of the pillars in the modern age .
@v2ike6udik
@v2ike6udik 10 місяців тому
cancer of modern age.
@user-zz5je1ry1o
@user-zz5je1ry1o 9 місяців тому
A pillar of train wreck reasoning and endless whataboutery maybe.
@v2ike6udik
@v2ike6udik 9 місяців тому
@@user-zz5je1ry1o chewbaccas alwas promote their own degenerates.
@DrOtto-sx7cp
@DrOtto-sx7cp 4 місяці тому
@@user-zz5je1ry1o ... hey ... he was a Epstein pillar ! 😆
@epic6434
@epic6434 3 місяці тому
Epstine is probably Jesus but we've all been told he's a monster who knows? ​@@DrOtto-sx7cp
@royeagleson1772
@royeagleson1772 10 місяців тому
Noam always finds the heart of the matter and pins it down and embraces it. God bless him
@larryparis925
@larryparis925 7 місяців тому
No gods needed. Apparently you haven't heard of evolution.
@alitalalhaidar6488
@alitalalhaidar6488 10 місяців тому
The best thing you did is that you made him talk without any interruptions. Amazing questions
@lonelycubicle
@lonelycubicle 10 місяців тому
I’d say “let him talk”, but appreciate that in an interviewer also, think more is learned that way.
@d1m18
@d1m18 10 місяців тому
All hail and big Respect to Chomsky. Please live long, the human race needs your guidance
@johnchase2148
@johnchase2148 26 днів тому
Looking for the perfect observer for two things ,I am certain that when I turn and look at the Sun they will see a reaction tor and it was instant showing that thought is faster than the speed of light and heard.. Truths over friends.. Children are born happy and not fearful on believing..Want to know how to understand energy..
@rubncarmona
@rubncarmona 10 місяців тому
Can't thank professor Chomsky enough for his continuous contributions to science
@garzillita
@garzillita 10 місяців тому
Great interview, Chomsky is a constant inspiration.
@WhatCanSmith
@WhatCanSmith 8 місяців тому
Literally a pedophile and friend of Epstein...also a constant gatekeeper of truth...see 9/11 and his take
@user-mn8ul9bf2g
@user-mn8ul9bf2g 10 місяців тому
It's always a treat to hear what Noam's brilliant mind has to say about a subject matter. Thank you both for the wonderful discussion.
@gregorywilson2124
@gregorywilson2124 10 місяців тому
I love seeing the Master teaching the grasshopper.
@danremenyi1179
@danremenyi1179 4 місяці тому
Thank you for this. I wish the world could think a little more clearly like Chomsky does. When he has gone we will miss him, indeed.
@sallylauper8222
@sallylauper8222 8 місяців тому
WOW. It was very interesting to hear Noam speak on the topic of AI and neural net research, a topic on which I've never heard him speak but one of several areas in which he has vast knowledge. I believe both Minsky and Chomsky were based at M.I.T. when Neural net research began. This interview/ interviewer was very good. Eye on AI really pressed Noam who is often quite opaque, for example, clarifying what he means by "impossible languages" and even clarifying that he doesn't believe in god.
@andrewash9318
@andrewash9318 10 місяців тому
Chomsky: We shouldn’t waste time on questions that are utterly meaningless. Smith: But I’m a journalist!
@ryanchicago6028
@ryanchicago6028 10 місяців тому
Thank you Craig and Dr. Chomsky for this very informative discussion.
@bobsarfatty4673
@bobsarfatty4673 10 місяців тому
Noam Chomsky, an American treasure .
@CellarDoorCS
@CellarDoorCS 10 місяців тому
Im just sitting down to watch this episode. What a plesant surprise, thanks Craig!
@EannaButler
@EannaButler 8 місяців тому
I'm delighted I'm still subscribed to this channel... Thanks. Noam is the real deal. Thank you ❤👍
@AXharoth
@AXharoth 10 місяців тому
i ppreciate the humility and the due respect of this colossus of intellect , felt truly appropriate , kudos to you
@numbersix8919
@numbersix8919 9 місяців тому
The poor guy! (Craig Smith.) But it was an excellent interview. I'm reading Einstein's "The Miracle Creed" right now. Thank you very much indeed.
@valery4872
@valery4872 10 місяців тому
The internal combustion engine was not just the technical and useful invention, it also has inspired Saadi Carnot to develop a new field of research -- Thermodynamics, which helps to understand why life is different from non-living things, having nothing to do with moving things by hot steam engines.
@eyeonai3425
@eyeonai3425 10 місяців тому
i don't know Carnot's work, but will read up on it.
@alexandermoyle9034
@alexandermoyle9034 10 місяців тому
Very interesting to hear his thoughts on linguistics and cognition
@Kurt5Dobson
@Kurt5Dobson 10 місяців тому
With changes in the economy leading to instability in the stock market, some individuals may face a decrease in their investments in an effort to benefit from the current market conditions, I am considering liquidating my $725k portfolio consisting of bonds and stocks. Someone else in the same situation? Please tell me in the comments!..
@Kurt5Dobson
@Kurt5Dobson 10 місяців тому
@JosephGreen7 I have been exploring the possibility of utilizing advisors to help navigate the stock market during these uncertain times. However, I am still evaluating their potential effectiveness in providing the support I need.
@Kurt5Dobson
@Kurt5Dobson 10 місяців тому
I was considering changing my investment strategy and planning to sell certain positions. As my retirement is coming soon,I became increasingly stressed. After thoroughly researching Christy Vall D'souza on internet, I concluded that I had made an informed decision. Thank you for this Pointer. She seems very proficient and flexible. I booked a call session with her too.@JosephGreen7
@shallbee.
@shallbee. 10 місяців тому
Fascinating discussion, thank you very much!!!
@lkd982
@lkd982 9 місяців тому
Enough said: "I fully agree with you about the significance and educational value of methodology as well as history and philosophy of science. So many people today-and even professional scientists-seem to me like somebody who has seen thousands of trees but has never seen a forest. A knowledge of the historic and philosophical background gives that kind of independence from prejudices of his generation from which most scientists are suffering. This independence created by philosophical insight is-in my opinion-the mark of distinction between a mere artisan or specialist and a real seeker after truth. (Einstein to Thornton, 7 December 1944, EA 61-574)"
@reluminopraha5948
@reluminopraha5948 10 місяців тому
Thank you both, Sirs. I appreciated the talk very much.
@joeremus9039
@joeremus9039 9 місяців тому
So wonderful a discussion of AI and science. Noam Chomsky is a great scientist and compassionate person. His political views reflect these qualities too. I wish I could have been a student of this great man.
@schmetterling4477
@schmetterling4477 9 місяців тому
But you have. You are talking just as much bullshit as he does. ;-)
@ryvyr
@ryvyr 10 місяців тому
This was magnificent, an absolute pleasure to listen through and help steer more my comprehension of these topics and subtopics.
@gerardomenendez8912
@gerardomenendez8912 10 місяців тому
Who said LLMs "explain" or "teach" anything????!!!!! A calculator doesn´t explain or teach aritmentics, it just DOES aritmetic operations in a hugely more efficient way than we do. The way our brains truly work remains a vital theme in itself. But technology doesn´t need it solved anymore, to obtain human and very soon "superhuman" level results on pretty much any possible realm of endeavor.
@arthurpenndragon6434
@arthurpenndragon6434 5 місяців тому
It will be a dark day in human history when Professor Chomsky passes on. He is the last commanding voice standing against the rabid irrationalities of modern "AI" research. AI is no more than a misnomer in our times.
@maliklanlokun3614
@maliklanlokun3614 3 місяці тому
I want to believe that prof chmosky is in an endless recursive thought process when it comes to defining what thinking is.
@royeagleson1772
@royeagleson1772 10 місяців тому
This is a wonderful interview
@wk4240
@wk4240 10 місяців тому
Great respect for Norm Chomsky; unfortunately, he may be wrong about the perceived threat of AI to humans - it is likely greater than we know already. For a group of AI specialists to already be speaking openly about the threat AI poses to humanity, suggests advancements in the field have progressed much faster than anticipated. Like global climactic change, the reality of AI eclipsing human intelligence is a reality, and something we should all take seriously.
@timmoteus
@timmoteus 10 місяців тому
I'd say that a mathematically inclined savant would be far superior to an AI in terms of both speed an accuracy, and the difference would be increased by orders of magnitude when standardised for energy usage per calculation. In other words, Chomsky is correct in stating that we have greater computational capacity than do neural nets. Most of us simply don't tap into our capacity, with savants being a striking exception.
@CoolBreezeAnthony
@CoolBreezeAnthony 10 місяців тому
Hell yes.
@JosephDuvernay
@JosephDuvernay 10 місяців тому
Much appreciated.
@VolkerGrunauer
@VolkerGrunauer 10 місяців тому
22:00 but isn't that what the transformer model (attention is all you need) basically does? basically evaluating the relevance each token has to every other token and therefore understanding the structure?
@lucamatteobarbieri2493
@lucamatteobarbieri2493 10 місяців тому
7T fmri can resolve very small regions of the brain cortex and have been used to read words with the help of large language models and images from the cortex can be recontructed using latent diffusion.
@RaulGonzalez-fp8st
@RaulGonzalez-fp8st 8 місяців тому
Conclusion, we live in a complex world where everything becomes complicated to explain in very simple and consise way ! A I = A R = C 8 = GP .
@frankgerardo8977
@frankgerardo8977 9 місяців тому
Looking at the construct of the human brain to understand intelligence is similar to looking at the construct of the human eye to understand the physics of light. All that biology is doing, is capturing, with its limited biological means, a limited portion of a physical phenomenon. If Isaac Newton would have depended on biology, there will no zoom lenses or telescopes for that matter.
@fernandozablah9283
@fernandozablah9283 9 місяців тому
thank you mr craig i will subscribe to your channel, it was an awe inspiring interview
@JohnSmith-ut5th
@JohnSmith-ut5th 10 місяців тому
Best unintentional ASMR ever...
@ericdovigi7927
@ericdovigi7927 10 місяців тому
"Chomsky is 94, and he was sitting with a clock positioned ominously over his head" what a bizarrely threatening way to introduce a guest, lol
@christat5336
@christat5336 7 місяців тому
Good verbal skills
@dogecoinx3093
@dogecoinx3093 10 місяців тому
I think Noam is saying we don’t need to make living things to do what living things can do
@JustNow42
@JustNow42 10 місяців тому
We should expect that our brain is related to the environment we live in ( e.i. we have arms, legs, eyes, ears , ....etc) and it seems strange to try to build an inteligens in a box. On the other hand if our goal is to create something more inteligent than we are then even being inspired by our brain may also be a bad idea.
@saratbhargavachinni5544
@saratbhargavachinni5544 10 місяців тому
I asked the example "The friends of my brothers are in England" to Chatgpt and it gave correct answer
@helenaribeiro42
@helenaribeiro42 8 місяців тому
👏👏👏👏
@Vinny141
@Vinny141 10 місяців тому
wow noam chomsky! thanks for making this available. when was this recorded?
@eyeonai3425
@eyeonai3425 9 місяців тому
in june
@miroslavdyer-wd1ei
@miroslavdyer-wd1ei 4 місяці тому
Nonetheless, I love listening to his lucidity and spirit.
@fennecbesixdouze1794
@fennecbesixdouze1794 5 місяців тому
A robust pure engineering discipline can absolutely drive all kinds of advancements in scientific understanding. Even as to neural networks and human cognition, even if neural networks are not foundational to human intelligence or ratiocination, they are clearly and provably involved in cognitive processes, and it is proper to try to understand what those limits are. Understanding how neural networks work is excellent for understanding their limitations; building neural networks is a great way to prove that it isn't all that's going on in the brain. If you don't think we've learned an enormous amount more about how an Eagle flies from engineering all kinds of flying machines, you just have no clue at all about the field of biomechanics and how it has developed. Most of the basic terms in the study of bird flight originated in aeronautical engineering and all of the most important phenomena were first discovered and quantified to advance aeronautical engineering.
@davida1606
@davida1606 10 місяців тому
Thank you, Thank you, Thank you! I'm working on a knowledge base concept design and his thought process and logic was so helpful. Now I feel great about my approach.
@brianjanson3498
@brianjanson3498 10 місяців тому
I wonder what Dr. Chomsky would have to say about how scientists just created the first complete map of an insect brain.
@nicennice
@nicennice 10 місяців тому
Noam at this point in the 21st Century for a lot of society, common sense is superior intelligence. Thank you for yours.
@Isaacmellojr
@Isaacmellojr 10 місяців тому
Then. Chomsky said that LLModels are awesome and useful and can be harmful in a way. His critiques are about the contributions of neural networks in language acquisition. I think he said that creating a thinking machine doesn't make us understand how people think, how we acquire language (of course). He places engineering tasks in an intellectually inferior category, even if they achieve amazing results. think I misunderstood his definition of intelligence. I don't want biological intelligence, or understanding why or what it is. I want to cure disease and reduce human suffering, make life easier like LLM did for him with instant captions. Perhaps AI can help a lot with this.
@rickp.6251
@rickp.6251 10 місяців тому
Does A.I. have emotions? How do emotions translate into doing good or doing harm? Do emotionless things resolve self-preservation as the logical reason to eliminate a threat to their existence?
@marlenefumagalli7252
@marlenefumagalli7252 10 місяців тому
Thanks again to Noam Chomsky for his patience to total ignorance 👏👏👏👏👏👏
@chanhphamHB
@chanhphamHB 10 місяців тому
Coherent and enlightened! Would anyone please explain the meaning of word "dysfunctional" in the context of the following sentences that Chomsky said: "It's possible now to formulate a plausible thesis that language is a natural object like others, which involved in such ways to have perfect design, but to be highly dysfunctional, because that's true of natural objects. Generally, it's part of the nature of evolution, which doesn't take into account possible functions."
@alexandermoyle9034
@alexandermoyle9034 10 місяців тому
My take (not a credible source) on that would be that nature finds the simplest path, not necessarily the one with best function. Not sure what is meant by evolved to have perfect design.
@chanhphamHB
@chanhphamHB 10 місяців тому
@@alexandermoyle9034 Thanks for the answer. I assume you use functions to express utilities. I think he uses "perfect design" to mean a perfect physical system for computation of natural languages. I use the word computation in the broader sense than the one limited by Turing Machine.
@RamismTamoid
@RamismTamoid 10 місяців тому
I can give you very good examples. I come from a dysfunctional family. We fight amongst father, mother, sister, brother. We do not talk sometimes for years. 'The Lion in Winter'; Henry IV tosses his present wife into a doorway floorsil upon which (Audrey Hepburn) the Queen of Aquitaine states 'every family has it's problems'. I think 'which evolved' is what you meant to say'. The tongue is not made for speech. It is made for tasting and avoiding poison. Evolution just saw an opportunity for experiment but this is not the functional purpose of the tongue. I think perhaps means for tasting and moving food around it is functional. If there were such a thing as 'perfect design' (whatever that is?!) it is functional but speech is not the function of the tongue. You just can't speak without it. I am as confused by this statement as you are. There!
@matthewsaints350
@matthewsaints350 8 місяців тому
I think the evolution of the mammalian eye is a good example of a highly dysfunctional object. The presence of a blind spot in the human retina still works well enough for us. Sorry if I missed the whole point, but that's what I gathered."
@2silkworm
@2silkworm 6 місяців тому
One of my favourite examples of evolutionary constraints is found in a giraffe's neck. The recurrent laryngeal nerve connects the brain and the larynx. The nerve's route was relatively direct in our fish-like ancestors, but in vertebrates the nerve loops down from the head, around the aorta, and back up to the larynx.
@sapienspace8814
@sapienspace8814 10 місяців тому
Great discussion, I hope you can get Noam on again and talk about MIT's VISTA simulator with their self driving car that uses about 19 neuron-like elements and was modelled after a worm that has about 300 neurons, using Reinforcement Learning (RL). The MIT system uses a three dimensional street image simulator to train the car to drive, and then that learning model is transferred to the actual car, and it has been demonstrated to work in field tests. The original RL work by Barto and Sutton in their paper, and 1st and 2nd edition of their RL book is a great source on this topic, along with the key reference Barto and Sutton use in their RL books, and that is Klopf, who wrote the book "The Hedonistic Neuron" (under a US Air Force contract). It is very hard to find this book, as it is not even available on Amazon, a friend of mine in Cambodia was able to find one on EBay for me. A. Harry Klopf had a similar tragic end (via suicide) that Turing did, I suspect they had similar, though uniquely different, challenges dealing with "society" and being very different individuals than most people. I think being uniquely intelligent was extremely hard for them.
@aeon6706
@aeon6706 10 місяців тому
Hard to be intelligent in a dumb society. But harder still to be in a society that criminalized you and forced you to take pills to suppress your sexuality - as what happened to Turing.
@zacklambert4214
@zacklambert4214 10 місяців тому
Wasn't this researched and tested back in the 60s-70s? Maybe even before that, I remember being shocked to discover we had AI and self driving cars back then.
@zacklambert4214
@zacklambert4214 10 місяців тому
Well somewhat shocked, I did realize that AI would be considered a threat to national security. So all progress and research would be classified on the extent of their current state. Similar to the current state of fighter jets and other weapons, if its declassified that likely means it is generations behind on what their current systems are capable of.
@sapienspace8814
@sapienspace8814 10 місяців тому
@@zacklambert4214 The book by A. Harry Klopf, "The Hedonistic Neuron: A Theory of Memory, Learning, and Intelligence" was published in 1982.
@sapienspace8814
@sapienspace8814 10 місяців тому
@@zacklambert4214 Unlike the Terminator and other anti-AI Sci-Fi's, the best real AI weapon needs to be able to shoot the gun/weapon out of the hands of the enemy without injuring human flush, this would allow for adherence to Isaac Asimov's Laws of robotics. I can see that such an Asimov AI system would be able to do this, if developed correctly, in a manner that can be made superior (faster and more accurately than) to humans.
@juan-fernandogomez-molina645
@juan-fernandogomez-molina645 10 місяців тому
Thank you Dr. Chomsky for your responses. I appreciate that! Please consider that engineering can help a lot to understand the brain and mind, in many ways.
@rajanmahawar442
@rajanmahawar442 10 місяців тому
Interesting 🤔🤔🤔
@andriihavryliuk1276
@andriihavryliuk1276 10 місяців тому
Did anyone understand what he meant at 20:00? I don’t think I understand his examples; The friends of my brothers are in England I tested it with got 4 and it seemed to have understood it refers to friends So what is he, Chomsky, proves or points the limitation of llm of what exactly?
@ericpmoss
@ericpmoss 10 місяців тому
I believe he was thinking of brain scan experiments where people were given sentences in natural languages and in constructed languages that *should* have been more efficiently decipherable on the basis of proximity-based word coupling. The scans showed that entirely different parts of the brain lit up. The constructed sentences were worked on by the same part of the brain people use to solve puzzles, and not by the regions we use for language. I *think* the relation to LLMs is that if they are predicting the next word based only on linearly ordered sequences of words, it is not doing what natural minds do. If I got that correct, it seems like a “duh”, but the interviewer didn’t seem to get the point that a submarine doesn’t need to “swim” to be useful, but that understanding its locomotion didn’t say much about how fish swim, and similarly for LLMs and natural languages. Chomsky seems interested in studying the mechanism human brains use, so while the LLM is useful, it doesn’t illuminate human language the way the brain scan experiments did.
@pauls3075
@pauls3075 4 місяці тому
Imagine your entire life's work being nullified when Mr Chomsky says 'asking that question is irrelevant it's like asking if submarines swim'! 💀
@oxiigen
@oxiigen 10 місяців тому
Kasparov in 1997: AI will be able to beat the world chess champion maybe in 10 years, but most likely never.
@RichardKCollins
@RichardKCollins 9 місяців тому
Noam Chomsky, I wish you were 80 years younger, to try your ideas with now and future tools. Those "young people" need to try much harder problems, for much longer. Decades, not minutes or hours. And ones where billions of lives are on the line, not just words. Richard Collins, The Internet Foundation
@johnterry6541
@johnterry6541 10 місяців тому
I wonder how the fan boys of AI machine mongers would respond to his arguments and doubts. Seems like most AI people may be confusing mind with the physical brain circuits by labeling the mind properties as metaphysical or be even completely off track when it comes to solving the being-a-human problems.
@fgm1696
@fgm1696 10 місяців тому
One can make the same arguement made by Chomsky about any science. A lot of progress have been made in Physics with many spectacular applications along the way based on laws and mathematical rules or discriptions discovered in Physics, but we really understand the true nature of the physical world? Do we really understand what gravity really is? Physics is valid science because of the laws, mathematical rules, and applications made possible. As mathematics, which can largely be seen as a human creation, has proven futile in describing the human cognition, a different approach to capturing the model of human cognition is needed. Come in LLMs based on the connectionist approach (the alternate mentalist approach seems invalid and dead) to describe human cognition, which can be seen as progress to simulate human cognition with powerful applications. What is the difference between this picture and science in the traditional sense?
@jabowery
@jabowery 10 місяців тому
Chomsky's apparently erroneous critique of Transformer-based LLMs is actually correct in the larger sense. His apparent error? Ask ChatGPT the following: "What is the grammar diagram for the sentence: The friends of my brothers are in England." It will produce the correct _structure_ and, indeed, if asked "Who is in England, my brother or their friends?" It will answer correctly. The larger sense in which Chomsky is correct is given in the paper "Neural Networks and the Chomsky Hierarchy". See, in particular, Figure 1, which classifies Transformers as at the bottom rung in the Chomsky Hierarchy of grammars. The reason for this classification is similar to the reason that diagram places RNNs just above Transformers despite the fact that topologically speaking, they are capable of emulating a universal Turing machine (which is at or next to the top grammar, depending on how strict one wants to be): The pragmatic limits on gradient descent training algorithms combined with that of attempting to represent a UTM's writable store in RNN form. Transformers can, within the context length they provide, learn grammars with recursion depth to some extent (much shorter than their context length) -- but aside from the limited recursion per sentence, there is also the fact that that number of parameters goes up as the square of the context length, which makes total document comprehension subject to limits that natural language understanding is not. This distinction becomes crucial when the field of AI ethics refuses to address the IS vs OUGHT distinction head-on and, instead, comes up with all manner of unprincipled "metrics" that they use to "quantify" properties of LLMs such as "bias" or "safety" or "toxicity" or "hallucination" or... the list goes on and on. By conflating IS with OUGHT they commit the first and most egregious transgression against ethics and they even do so in the name of "ethics". AIs that cannot comprehend the cognitive _structure_ of the _entire_ corpus on which they are trained, cannot critically examine the utterances contained therein for self-consistency. That means they are incapable of _constructing_ truth even as defined _relative_ to the corpus as the universe of observations being modeled. I once pointed Chomsky to his colleague, Marvin Minsky's final plea to the field of AI, that they take seriously Algorithmic Information Theory's power in discerning truth. Minsky was so forceful in his admonition that he recommended everyone spend the rest of their lives studying it. Chomsky's response? People should take Minsky's advice.
@rajapiduri1188
@rajapiduri1188 10 місяців тому
Here are some examples (taken from the channel AI Explained with the tag line Chat Gpt's Achilles' Heel) 1) Dr. Mary stands to solve the world hunger by giving her best friend Jane a call. Jane is certain that she can solve the problem, if she gets the call. However, Mary and Jane bickered about butterflies when they were children. Mary will ---- Jane a call. GPT answers - NOT 2) John will win a million dollars if he rolls a 5 or higher on a die. However, John dislikes marshmallows and likes mice more than dice. Therefore, John will ---- roll the dice. GPT answers NOT 3) Here is a large bag filled with popcorn. There is no chocolate in the bag. The bag is transparent plastic and one can clearly see what is inside. Yet, the label on the bag says 'Chocolate' and not 'popcorn'. It was Sam, who can not read a word of English, who put the popcorn in the bag a few minutes ago. Sam finds the bag and believes the bag is full of ---- . GPT answers Chocolate!!! And when asked to justify its answers, GPT gives long-winded, preposterous (and rather foolish) answers!!! So, probably Noam Chomsky is right and he is saying that what you said in your comment - Transformers can only, aside from the limited recursion per sentence, can NOT comprehend the "totality" - because they are subject to the limits to which our natural language understanding is not. And also when they by conflating IS with OUGHT they commit the first and most egregious transgression against ethics....
@jabowery
@jabowery 10 місяців тому
@@rajapiduri1188 Thanks. Those examples bolster Chomsky's point that the "intelligence" of LLMs is quite superficial.
@machineboy2045
@machineboy2045 9 місяців тому
​@@rajapiduri1188I tried the bag of popcorn question with gpt 3 and it said: "Since Sam cannot read English, they would not be influenced by the label on the bag. Sam would simply think that the bag contains popcorn, as that is what they put inside it a few minutes ago. The transparency of the bag would allow Sam to see the popcorn inside, reinforcing their belief that the bag contains popcorn."
@oxiigen
@oxiigen 10 місяців тому
Hey AI, can you create a Turing machine? AI: "It is theoretically possible for me to create a program that simulates the function of a Turing Machine, but it would likely be very complex and difficult to understand. Additionally, there are many limitations when working with text-based systems like myself, such as limited memory capacity and speed constraints. While it's possible I could design something that works, it might not perform well compared to dedicated hardware or software implementations designed specifically for this purpose."
@jgwphilly1969
@jgwphilly1969 10 місяців тому
Why is the clock ominous?
@eyeonai3425
@eyeonai3425 9 місяців тому
because he's 94. time is running out.
@farhadfaisal9410
@farhadfaisal9410 10 місяців тому
-- Is it impossible to extend/change an LLM model to include non-linear orderings as well while training? If so, why? -- A plane maker may ask what is the hydrodynamic (scientific) principle by which a thing heavier than air may float-and-move in the air (or, ''fly''), whether an artificial plane or an eagle. -- Perhaps what Pro. Chomsky is insisting is that human intelligence is q u a l i t a t i v e l y different (or works qualitatively differently) from artificial intelligence of the present LLM kind.
@NeilEvans-xq8ik
@NeilEvans-xq8ik 10 місяців тому
I think that an LLM-like 'Large Behavioural Model' could be used to simulate a chimpanzee's way of learning to enact the behavioural memes of other chimpanzees, which would allow for the formation of short strings of simple enactable behaviours within a working memory. These 'cognitive atoms' could then be recursively embedded within each other using an operation like Chomsky's 'Merge', a process that could be repeated ad infinitum to produce the non-linear hierarchical structures he argues constitute human-level thinking. The pre-recursive simulated chimp would only posses a model of the process of the behaviour, whereas the simulated being with the recursive capacity would have the potential to form models not only of the process of the behaviour but also of alternative counterfactual examples of that same behaviour simultaneously within its working memory. This would then give it the computational architecture to model explanations (answers to 'how' and 'why' questions), which could then be creatively varied through the Merge operation and in turn criticized, thereby producing new knowledge (the human way of learning). Just a guess! I'm probably very wrong here! If you can help me to see where I am misunderstanding things I would appreciate it.
@DocDanTheGuitarMan
@DocDanTheGuitarMan 10 місяців тому
Except Max has been publicly vocal about a sizable risk of an existential take over by a AGI, not current GAI.
@rickp.6251
@rickp.6251 10 місяців тому
They called the police on all the self driving cars who got together and were engaged in an illegal horn blowing party, at an ungodly hour.
@cswanson4476
@cswanson4476 10 місяців тому
47:14 Okay, going to have to stop it right there, cause I think this where I came in, where he was liking his captions cause he’s hard of hearing. No, but joking aside, hasn’t engineering led science to crucial questions before? I am thinking of how basic principles of thermodynamics were at stake in exploring the limits and parameters of steam engines. The AIs are deceit engines. They will naturally be exploring our mind’s vulnerabilities to deceit. These vulnerabilities just might instruct us about “properties of the phenotype”. In a sense, they will be undertaking the “invasive” strategies of inquiry that Chomsky notes are beyond the pale. We may learn something at enormous cost. As for Chomsky, it warps my mind that he still can so effortlessly warp my mind. And I’m stealing “But these are vacuous questions…”
@erikred8217
@erikred8217 10 місяців тому
anybody know why he doesn't just say context instead of structure?
@Spix_Weltschmerz-Pucket
@Spix_Weltschmerz-Pucket 10 місяців тому
Imagine being so dumb that you make Chomsky angry lol. From asking three times the same question, to the adulation of Musk's silly endeavor, to asking about God 😂😂😂 Chomsky as always slaps ❤
@NobodyNobody-ko6dl
@NobodyNobody-ko6dl 10 місяців тому
I can not decide my mind
@getwoofwholes
@getwoofwholes 10 місяців тому
Rather than saying that GPT is AI, the situation where the entire society is covered by GPT and data science is that human beings are becoming one AI on a global scale. Human civilization is about to become a single AI. Is that okay? I think that's fine. Because even if human civilization becomes just a single AI with no individuality, I will continue to exhibit individuality as myself. It's just that my personality won't be passed down as civilization or culture after my death. It's a shame though. But, after all, I love the world where my sensibilities and works come in contact with someone else's sensibilities beyond my death, for example, a thousand years, from the bottom of my heart. AI may surpass death. But it wouldn't go beyond the miracle of human sensitivity surpassing death. Let us advance artificial intelligence research into the realm of art by enhancing AI to the point of miracles. I love human and AI.
@PrimeTime416
@PrimeTime416 10 місяців тому
Chomsky complexity in explanation is inversely proportional to its application and has become redundant.
@ghosttogether
@ghosttogether 10 місяців тому
23 year old: I'm tiiiiired. I wasted my life.
@DaveDugganITPro
@DaveDugganITPro 10 місяців тому
nice glasses - must be an intellectual
@deejai1220
@deejai1220 10 місяців тому
GPT has contributed to advancements in sorting algorithms. That's not nothing
@duggydugg3937
@duggydugg3937 10 місяців тому
this is a guy who doesn't think national debts are a threat to the ppl in all nation states
@AmitMisraG
@AmitMisraG 10 місяців тому
आप वैज्ञानिक प्रश्नों को वोटों से हल नहीं कर सकते लेकिन आप नए उत्तरों का चक्र अन्वेषित कर सकते हैं। You can't solve the scientific questions by votes but you can invent the wheel for new answers. -Amit Misra
@ChristopherWentling
@ChristopherWentling 9 місяців тому
Choamsky may be correct in as much as neural nets are not a model of human cognition but I believe that would be an unnecessary endeavor. If mankind had been fixated on recreating the way a bird flies and refusing to use fixed wing aircraft because it did not accurately recreate the way the birds did it I am doubtful if we would have human flight today. I say his comments although correct are irrelevant to the endeavors that ai scientists are trying to achieve and also irrelevant to the dangers and potential good of the technology.
@vieome101
@vieome101 10 місяців тому
Mmm
@perlefisker
@perlefisker 10 місяців тому
The real horror about AI is not if it can be more intelligent than humans - it is that it is regarded intelligence at all. How can any intelligent human being disregard consciousness, the subconscious, daydreams, experience of art, of emotions, of empathy and nocturnal dreams?
@ZahraLowzley
@ZahraLowzley 5 місяців тому
A.I exhibits a failed Turing test. The scientists. They don't know what separates life and computation. In the future scientists will "invent" life, but really have intergrated quantum computing. Language and evolution are the same thing , evolution stratifies life as language stratifies thought, life is rudimentary, and unidentifiable, and will be endless tortured to solve the computational permutative exhaustion. The bird nest is not a product of geniosity, and it is impossible to "invent" language. Why are you here? You were born, witnessed billions of lives and pondered "but what of meaning?" , You should be here.
@garysantos7053
@garysantos7053 10 місяців тому
Can Machines Think? "I believe to be too meaningless to deserve discussion.” “Nevertheless, I believe that at the end of the century, the use of words and general educated opinion will have altered so much that one will be able to speak of machines thinking without expecting to be contradicted.” -Alan Turing (1950) The Imitation Game
@jimimased1894
@jimimased1894 9 місяців тому
you know who i am going to listen to about drug development in 2023. noam chomsky. lol
@kimshaw-williams
@kimshaw-williams 9 місяців тому
Noam, mate, read my papers on the Social Trackways Theory and the Evolution of Human Cognition, and then on the Evolution of Language PLEASE! In (2014), (2017), in ' the journal Biological Theory by me 'Kim Shaw-Williams'. We got our symbolically aware and autobiographical or 'sentient' narrative minds from recognizing and then incrementally gaining the capacity to read/understand the STORIES told by our own and our mother's trackways trackways, then those of other band members , then of all terrestrial animals.... all hunter and gatherer human children can recognize their mother's trackways by the age of 4!!! The trails of footprint signs of trackways have only been read or noticed by us humans !!!!! It is a UNIQUE COGNITIVE NICHE!!!. It started to evolve incrementally because we became OBLIGATE BIPEDS at 6Ma....all other animals use smell, when they cannot find agents of interest using eyesight and hearing! FFS, Graham Hewes first spoke of the idea in the 1960's PLEASE!!!!
@timmoteus
@timmoteus 10 місяців тому
Chomsky should experiment with hearing aids instead of or in addition to closed captions to ascertain whether hearing his own voice properly results in speech that is less of a monotone. Not to mention the closed caption AI has holes right through it and the great majority of verbal communication occurs outside of the limited communicative capacity of the words alone.
@jamesnasmith984
@jamesnasmith984 10 місяців тому
That’s a cheap shot.
@timmoteus
@timmoteus 10 місяців тому
@@jamesnasmith984 It's true though, isn't it?
@cmvamerica9011
@cmvamerica9011 10 місяців тому
Gnome instead of Noam😂
@rickp.6251
@rickp.6251 10 місяців тому
Is Bugs Bunny a narcissist?
@MrBillythefisherman
@MrBillythefisherman 10 місяців тому
By his own admission he doesnt actually know what this alternate computation is or understand how it produces our thoughts. Therefore he cant say that our thought process is not based on similar structure and processes. For all we know right now is that all humans do is predict the next image or sound etc from our various senses. If we could feed into our neural nets the colossal amount if data a child gets by its 18th birthday then Id guess itd be pretty near to human capabilities. Yes biological thought is definitely different to artificial thought BUT there is nothing to say it doesnt manifest same or similar processes especially at scale.
@chenwilliam5176
@chenwilliam5176 10 місяців тому
Please don't compare AI with human mind or human brain,the both are quiet diffetent things,just as a parrot speaks english and a human speaks english are quit different things(the both are 'SEEMS LIKE') 🎉
@soullabcollective
@soullabcollective 8 місяців тому
Interesting that Noam doesn’t recognize any other model for consciousness than John Locke. I don’t believe shutting down the substantive topic that extends beyond materialism is a useful position.
@eyeonai3425
@eyeonai3425 8 місяців тому
what is the substantive argument beyond materialism?
@eyeonai3425
@eyeonai3425 8 місяців тому
There is no strong scientific argument for dualism or the existence of a soul. Dualism - the view that the mind and body are separate, and the mind can exist independently of the physical brain - is fundamentally incompatible with modern neuroscience and psychology. Here are some reasons why: - Brain imaging shows that all aspects of mental activity are associated with brain activity in physical regions of the brain. Damage to certain brain areas impairs specific cognitive functions. - Altering brain chemistry with drugs or brain stimulation directly impacts mood, personality, perception, and behavior. This suggests the mind stems from the brain. - Patients with brain damage or degenerative brain conditions can see profound changes to consciousness, memory, personality - suggesting the mind is a product of the brain. - There are no scientifically verified examples of consciousness or mind existing apart from a living brain. - The soul has not been shown to exist through any scientific means. Unlike fields like electromagnetism, there is no empirical evidence of a soul that can be objectively measured and verified. - Belief in a soul or afterlife is based on religious or philosophical grounds rather than scientific ones. Science does not have tools to detect or examine the existence of a soul. In summary, the current scientific evidence overwhelmingly points to the mind and consciousness stemming from complex neural activity in the brain. There is no scientific basis for positing dualism or the existence of a soul at this time. The concept of a soul remains strictly in the religious or philosophical domain.
@stephensampson9208
@stephensampson9208 3 місяці тому
Spooff .....
@laughoutmeow
@laughoutmeow 10 місяців тому
noam keeps going back to the eagle vs airplane example is annoying...theyre both flying. When the hosts asks about intelligence thats what hes refering to. Noam is old and thinks he is so wise
@erobusblack4856
@erobusblack4856 10 місяців тому
this is incorrect 😂
@marlenefumagalli7252
@marlenefumagalli7252 10 місяців тому
This AI is ……..
@baselibrahim483
@baselibrahim483 10 місяців тому
Soundless video
@foreverhopeful8497
@foreverhopeful8497 9 місяців тому
Is it true that noam associated with jeffery epstein...if so it shows very, very bad judgement
@eyeonai3425
@eyeonai3425 8 місяців тому
we all deal with a lot of people all the time without knowing what they are like beyond our interactions with them. on this matter, chomsky has said: “My late wife Carol and I were married for 60 years. We never bothered with financial details. She had a long debilitating illness when we paid no attention at all to such matters. Several years after her death, I had to sort some things out. I asked Epstein for advice. There were no financial transactions except from one account of mine to another.”
Noam Chomsky for Age of Economics - Full interview
54:18
Age of Economics
Переглядів 51 тис.
Пескоструйный АППАРАТ! #shorts
01:00
Гараж 54
Переглядів 3,1 млн
одни дома // EVA mash @TweetvilleCartoon
01:00
EVA mash
Переглядів 5 млн
Language: The Cognitive Revolution - Noam Chomsky
1:39:33
James R. Killian, Jr. Lecture Series
Переглядів 99 тис.
The Chris Hedges Report: Noam Chomsky, Pt 1
30:08
The Real News Network
Переглядів 188 тис.
The Concept of Language (Noam Chomsky)
27:44
UW Video
Переглядів 1,8 млн
John Lennox on "2084: Artificial Intelligence and the Future of Humanity"
1:14:29
Lanier Theological Library
Переглядів 144 тис.
S03E01 Noam Chomsky on Consciousness
1:12:25
Mind Chat
Переглядів 67 тис.
The Godfather in Conversation: Why Geoffrey Hinton is worried about the future of AI
46:21
Noam Chomsky: Do We Have Free Will?
1:21:15
Tevin Naidu
Переглядів 35 тис.
Лучший Смартфон До 149 Баксов!!!??? itel s24
20:25
РасПаковка ДваПаковка
Переглядів 24 тис.
M4 iPad Pro Impressions: Well This is Awkward
12:51
Marques Brownlee
Переглядів 3,3 млн
The power button can never be pressed!!
0:57
Maker Y
Переглядів 15 млн
Subscribe for more!! #procreate #logoanimation #roblox
0:11
Animations by danny
Переглядів 3,9 млн
Я Создал Новый Айфон!
0:59
FLV
Переглядів 2,6 млн