DeepMind’s New AI Remembers 10,000,000 Tokens!

  Переглядів 92,420

Two Minute Papers

Two Minute Papers

Місяць тому

❤️ Check out Microsoft Azure AI and try it out for free:
azure.microsoft.com/en-us/sol...
📝 The paper "Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context" is available here:
storage.googleapis.com/deepmi...
📝 The paper "Gemma: Open Models Based on Gemini Research and Technology" is available here:
storage.googleapis.com/deepmi...
Try Gemma:
huggingface.co/chat
I would like to send a big thank you to Google DeepMind for providing access to Gemini 1.5 Pro to test it out.
Sources:
/ 1760468624706351383
/ 1761113846520131816
simonwillison.net/2024/Feb/21...
/ 1761459057641009354
📝 My paper on simulations that look almost like reality is available for free here:
rdcu.be/cWPfD
Or this is the orig. Nature Physics link with clickable citations:
www.nature.com/articles/s4156...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Alex Balfanz, Alex Haro, B Shang, Benji Rabhan, Gaston Ingaramo, Gordon Child, John Le, Kyle Davis, Lukas Biewald, Martin, Michael Albrecht, Michael Tedder, Owen Skarpness, Richard Sundvall, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Károly Zsolnai-Fehér's research works: cg.tuwien.ac.at/~zsolnai/
Twitter: / twominutepapers
#deepmind

КОМЕНТАРІ: 266
@HappyHater
@HappyHater Місяць тому
What a tiiiiiimeeeee to be aliiiiiiiiiiiiive!
@penguinscanfly5796
@penguinscanfly5796 Місяць тому
What a time to be alive!
@Runar-jd5es
@Runar-jd5es Місяць тому
Wattba
@hegedusuk
@hegedusuk Місяць тому
It gets eeeeven better
@SaumonDuLundi
@SaumonDuLundi Місяць тому
Quelle époque où vivre ! (Wait ... It sounds better in English...) What a time to be alive!
@nientaiho7997
@nientaiho7997 28 днів тому
Really what a good time to be alive!
@theengineeringmonkey407
@theengineeringmonkey407 Місяць тому
I love how the goals for this technology are so high that we get disappointed when it takes 1.5 hours for an ai to remember everything in 10 movies
@andreavitale2845
@andreavitale2845 Місяць тому
Right 😂 ?!? Societies advancement and the competitive systems we live in ask for it, unfortunately.
@krishhhhhhhhhhhhhhhh
@krishhhhhhhhhhhhhhhh Місяць тому
In 5 years these numbers will sound ancient. An AI will probably be able to watch a movie in a second.
@mgord9518
@mgord9518 Місяць тому
​@@krishhhhhhhhhhhhhhhhPretty hopeful estimation there, the speed of AI is largely limited by the hardware it runs on, and it's highly unlikely that hardware will be hundreds of times faster within 5 years.
@user-rf5lf7cq5e
@user-rf5lf7cq5e Місяць тому
True
@sownheard
@sownheard Місяць тому
​@@mgord9518 The newest Nvidia chip announced is already 100* times better than consumer hardware. it's currently for server's
@KAMI_24
@KAMI_24 Місяць тому
I wish for someone to feed an AI with heaps of dolphin or whale singing. Maybe we can actually find a way to understand what they communicate and to maybe talk back to them
@LucidiaRising
@LucidiaRising Місяць тому
there is actually a project going on right now that is attempting to do exactly that - use AI to try to talk to whales 🙂
@kindaovermyhead
@kindaovermyhead Місяць тому
Check out Whale-SETI! We actually started doing this!
@iminumst7827
@iminumst7827 Місяць тому
That wouldn't work, you'd would also need to feed it context of what the creature is doing, and no amount of words can define all the nuance and possible interpretations, so the AI will only be able to learn a simplified version of their basic emotions like fear, happiness, or grief. For example, hypothetically let's say dolphins remarkably have unique names and call eachother by their names. A human might observe this behavior and describe it as a generic greeting not knowing dolphins have names. The ai will see that dolphins make random sounds during greetings and assume dolphins greet by making random excitable noise. The only way to actually discover this is through targeted tests, it's not something that can be spontaneous discovered in existing data.
@CodyKey
@CodyKey Місяць тому
@@dawiedekabouter5733how ya gonna do an fMRI on a sea creature 😂 let alone a whale
@technokicksyourass
@technokicksyourass Місяць тому
@@iminumst7827 The way they are doing it is noting down that are happening around the whales at the time, then putting that alongside the communication between them.
@kittythepet485
@kittythepet485 Місяць тому
"Not practical". Yes the practicality of simultaneously analyzing 10 full movies in mere seconds is a shame to be missed. XD
@Lerppunen
@Lerppunen Місяць тому
Practicality is good in data analysis. Movies are just an example.
@shadowdragon3521
@shadowdragon3521 Місяць тому
I'd like to see LLMs have a go at learning extinct languages with great historical significance like Sumerian and Akkadian
@appsenence9244
@appsenence9244 Місяць тому
Wtf? It takes me 20 hours to watch 10 movies and then another 10 hours to write an essay about them. You telling me this AI can do it all in only 1,5 hours??? How is that not an awesome thing?
@tuseroni6085
@tuseroni6085 Місяць тому
i think the issue is that having watched 10 movies EVERYTHING it does is now slow, even those unrelated to those videos. so it's like you watched 10 videos and now you can't hold a conversation since it takes you 1.5 hours to process anything anyone tells you.
@mikopiko
@mikopiko Місяць тому
You can write a whole essay in 1 hour? That's incredible.
@abanoubmg3698
@abanoubmg3698 Місяць тому
i think the issue is the response to each prompt would take that 10x
@appsenence9244
@appsenence9244 Місяць тому
@@tuseroni6085 is that really how it works?
@appsenence9244
@appsenence9244 Місяць тому
@@mikopiko What do you mean?
@tuseroni6085
@tuseroni6085 Місяць тому
perhaps the solution to the quadratic complexity is to implement a short term-long term memory system with an artificial hippocampus to help it remember.
@mb-3faze
@mb-3faze Місяць тому
I'll get right on it! :)
@Milkshakman
@Milkshakman Місяць тому
Yes people have been saying this for years
@Jeremy-Ai
@Jeremy-Ai Місяць тому
Yes, and no. Sometimes it is good to forget. Our brains have evolved to forget. I suspect there is a better balance. Never forgetting would be a massive burden. So yes, short term long term, but not everything. It is good to let go without even trying. ;) Take care, Jeremy
@plainpixels
@plainpixels Місяць тому
There have been a variety of approaches that improve on this around for quite a while.
@MineAnimator
@MineAnimator Місяць тому
​@@Jeremy-Ainossa memória é baseada e sentimentos, acontecimentos intensos são mais fáceis de lembrar, mas inteligência artificial não tem sentimentos, então talvez criar isso seja o próximo grande passo para aumentar a inteligência delas. Isso supondo que o objetivo seja criar vida artificial consciente e não apenas ferramentas mais precisas
@mertaliyigit3288
@mertaliyigit3288 Місяць тому
"What a time to be alive!" on 10 years we'll start saying "What a time to be dead!"
@dingozi3428
@dingozi3428 Місяць тому
“When you realize ‘Two Minute Papers’ has more plot twists than your favorite TV show, and all it took was a couple of minutes and some groundbreaking science.” 📜✨
@killyGHILLIE
@killyGHILLIE Місяць тому
imagine the plot twist only two papers down the line😅
@Mo_Mauve
@Mo_Mauve Місяць тому
Most of it doesn't surprise me because I'm intelligent & optimistic enough to expect most of it, I just watch 2 Minute Papers to find out what currently exists & exactly what it's like.
@trycryptos1243
@trycryptos1243 Місяць тому
I like that 'what a time to be alive' line poping up in all your videos ...indeed it is.
@bjrnolavfrytlogbjrnsen2868
@bjrnolavfrytlogbjrnsen2868 Місяць тому
You deserve every watcher and all the praise in the world. From video 1 the content is concise and well put together. One of the better channels hands down.
@Zebred2001
@Zebred2001 Місяць тому
I've said for awhile now that this technology should be used in a massive global rare-languages rescue effort.
@johnaldchaffinch3417
@johnaldchaffinch3417 Місяць тому
and solving aging and cancer. In an interview Ilya chief scientist of OpenAI explained with certainty how to solve climate change with carbon capture. His certainty about the best method made me think that he'd already asked a superior AI for the solution.
@islammohamed1441
@islammohamed1441 Місяць тому
What a time to use AI!
@gierdziui9003
@gierdziui9003 Місяць тому
its about time to feed such an AI with all neccessary books and data about transformer NN and make it make itself, and better
@pqpvaisefude
@pqpvaisefude Місяць тому
Nice! Now we can build a Solo Leveling AR game with AI :) Maybe wearing a smart glass to capture the exercises.
@gridvid
@gridvid Місяць тому
Did you already covered "Suno", the AI music generator?
@Khann_2102
@Khann_2102 Місяць тому
I tried it and it's good
@MichielvanderBlonk
@MichielvanderBlonk Місяць тому
He did cover that tech like a year ago before it was commercial.
@samsabruskongen
@samsabruskongen Місяць тому
"aaand"x100000000
@tannenbaumxy
@tannenbaumxy Місяць тому
Looking at the problem of processing time with longer context, what do you think about Mamba as a solution for a subquadratic architecture for future LLMs? Maybe you could make a video about Jamba in the future.
@venaist
@venaist Місяць тому
What is all the mumbo jumbo about?
@nocaptcha8110
@nocaptcha8110 Місяць тому
Maybe use them to make the AI do some samba
@tannenbaumxy
@tannenbaumxy Місяць тому
@@Faizan29353 I could not find a fireship video about mamba. Did you mean bycloud?
@blengi
@blengi Місяць тому
you'd think mega context inputs would be executive AI reformulated into various higher level abstractions like some sort of linguistic computer code context representation which modularises language content to functions, structures, libraries etc so that vast bulk of tokens aren't even needed and are replaced with compact meta token instantiations with even higher latent space salience within the newly factored smart context
@Walter5850
@Walter5850 Місяць тому
Joint embedding predictive architecture aims to do that
@c02c02
@c02c02 Місяць тому
3:47 saying this feels either correct or flying way too close to the sun. we were used to Jukebox taking four hours to generate audio that ultimately might not sound great, or even have any audible sounds in it, for years...
@fosowl
@fosowl Місяць тому
The analysis of lifting session and json that list repetition is the most impresive by far! I thought the google demo showcasting video understanding was kind of a scam until now. This demonstrate an true understanding of video over time and that amaze me much more that a LLM that can take a trillion token or whatever
@daviddonahue7690
@daviddonahue7690 Місяць тому
I don't think quadratic complexity is actually a problem. It only is a problem where you want every token to "talk" to every other token. But what we really want is for all the input tokens (e.g. the input documents/movies/etc) to talk to the output tokens (the model output). Then assume each input token only needs to read the previous K tokens for understanding. For N input tokens and M output tokens thats O(KN) + O(NM) time, way less than O(N^2)
@vidyagaems4063
@vidyagaems4063 Місяць тому
But that requires a new architecture, meaning it's no longer a transformer.
@Brause_Market
@Brause_Market Місяць тому
I love the "aaaaand" so so much ; )
@bobparker1671
@bobparker1671 Місяць тому
Hopefully we can get SSM based architectures that have roughly linear token scaling during inference to be as big as Gemini and the like. Perhaps a greedy MoE approach with transformers for short range context and SSM or Mamba for long range.
@seriousbusiness2293
@seriousbusiness2293 Місяць тому
The self attention of 10 very different movies though could easily be non quadratic. Why would the movies Oppenheimer and Barbie need to cross reference another in the self attention layer? Okay the details are more complex but the basic idea of seperation holds.
@alvaroluffy1
@alvaroluffy1 Місяць тому
i would say its just the problem with the current arquitectures, i guess something will come after transformers that is better and more efficient and could even solve this problem
@buildgameswithjon7641
@buildgameswithjon7641 Місяць тому
If you didn't want them cross referenced then you wouldn't input both movies right? You would only input 10 movies at the same time if you want all 10 movies to be considered in your next prompts/responses for whatever reason that may be. If you just want to interact with one movie then you just input one movie.
@countofst.germain6417
@countofst.germain6417 Місяць тому
Kind of a lot you got wrong here or didnt explain, when you say one movie, it was a old movie that runs at few fps, it cant take much video at a reasonable fps, i think it was around 10 mins, and it can't speak the language as good as a native speaker, it can translate it as good as a human that had the same amount of info, a translation book, i think these are pretty important differences and that is just what i can remember off the top of my head.
@alvaroluffy1
@alvaroluffy1 Місяць тому
even if its an old movie with fewer fps, still lasts at least 1 hour, so for it to be 10 minutes you would need to have 6 times more fps on modern movies. Modern movies have 24 fps so for it to be 6 times greater than old movies it would mean that those old movies have 6 times less fps than 24, so 4 fps. Im sorry but i dont recall any moment on the history of cinema that movies used to be 4 frames per second, its not a movie its a powerpoint. I believe you when you say they had less fps, but it could be as little as 12 fps, and it probably was more than 12, maybe 16 or something like that, so were not looking at 1 hour vs 10 minutes, were looking at 1 hour vs 40 minutes more or less, and it probably wasnt an hour film, it would be 1.5 hours or something like that, so it would be 1.5 hours vs 1 hour
@countofst.germain6417
@countofst.germain6417 Місяць тому
@@alvaroluffy1 many UKposts videos are 60fps and that is mostly what this will be used for, not low fps silent movies, I think it is important to talk about actual use cases, not just hype it up under perfect conditions. So this 44 min video would translate to slightly over 10 min.
@alvaroluffy1
@alvaroluffy1 Місяць тому
@@countofst.germain6417 he was talking in terms of movies, 10 movies is not 10 hour-long youtube videos, you are the only one that made that wrong assumption, nobody is talking or understanding this video in those terms, he is very clear about it
@countofst.germain6417
@countofst.germain6417 Місяць тому
@@alvaroluffy1 as I said, he should be talking about actual use cases and not hyping it up under perfect conditions, there very little reason to use this on movies. Also my point about the translation is completely valid, as I said I was doing this from memory, this fool was researching this for a video, and made lots of mistakes.
@alvaroluffy1
@alvaroluffy1 Місяць тому
@@countofst.germain6417 first, i didnt talk about the translation, but he puts a text saying literally that about someone with the same info from the book. Second, if you cant look at the information provided to you in the terms that is provided, then this is not your channel to watch. If you understand 10 movies as 10 hour-long youtube videos, then stop watching this cannel, or stop making those assumptions, and finally, you're talking like youtube videos are going to be the main use case, but first you have no idea, because no one has any idea, and even if it were true, there will be tens of use cases, this is not going to be a one thing that uses videos from youtube and thats all, you're the fool for making all those assumptions and projecting them into him, if you can't see things clearly, if you are like media that cant stop lying and exaggerating the scientific texts they read, then stop consuming this content, because you are going to constantly misinterpret it and then spread disinformation wherever you go, so just stop being a fool
@PankajDoharey
@PankajDoharey Місяць тому
Mamba long context research is the future.
@cocolasticot9027
@cocolasticot9027 Місяць тому
I mean it may not be the most practical to wait 1.5h for one query, but given that it's for data the size of 10 movies, this is still brutally impressive.
@SEB1991SEB
@SEB1991SEB Місяць тому
In the future AI will be able to consume all the media of a certain franchise (eg. Marvel) so it can help in building the Wiki of that franchise. You’ll also be able to ask it extremely specific obscure questions that even the most diehard fans and prolific Wiki contributors wouldn’t know.
@I_SEE_RED
@I_SEE_RED Місяць тому
this is already possible
@totoroben
@totoroben Місяць тому
Whenever he says "and" 😂
@nathanaeltrimm2720
@nathanaeltrimm2720 Місяць тому
Just run them in parallel to get around the 100x quadratic issud
@dreamphoenix
@dreamphoenix Місяць тому
Wow. Thank you.
@Joshua-ew6ks
@Joshua-ew6ks Місяць тому
I want to use AI to help my readers ask questions about my books (What I will be writing). And also to help me to avoid continuity issues. And to help with editing my book.
@jeffg4686
@jeffg4686 Місяць тому
No, it didn't give me a warm and tingling feeling. IT STOLE MY DAMN JOB...
@foxt9151
@foxt9151 Місяць тому
1 bit LLM Architecture and AI inference cards will probably reduce the inference time by orders of magnitute, see Groq.
@Oliver-tk4ii
@Oliver-tk4ii Місяць тому
Did you rename the gemini video?
@jonathanmoore4837
@jonathanmoore4837 Місяць тому
Was thinking : 1 movie takes me at least 2hours to watch. AI can watch 10 movies in less time!
@MindBlowingXR
@MindBlowingXR Місяць тому
Great video!
@botan1996
@botan1996 Місяць тому
I'm unsure about context levels of AI... I used the GPT 4.5 API with 128k context window and it did never follow any of my prompt and basically just summarized the book or video transcript I gave to it. Basically being unusable...
@lordm31
@lordm31 Місяць тому
congrats on the new sponsor mister 2 minutes
@GraveUypo
@GraveUypo Місяць тому
token limitation is by far the worst thing about the local AIs i have. they most only remember up to 4096 and like a third of that is taken by setup prompts. i'd be happy with 50k tokens but i really wish they could just retain memory forever, even if vague like we do.
@fohsen
@fohsen Місяць тому
Can you imagine one integral LLM, that holds also all sources of academic papers of all kinds, so you have not only the data, but cientificial data? Idk if im explaining right, sorry for the bad english.
@loopingdope
@loopingdope Місяць тому
You mean like scientific analyses and results?
@fohsen
@fohsen Місяць тому
@@loopingdope yeah, I don´t know if the state of the art can have their research in these academic hubs
@galvinvoltag
@galvinvoltag Місяць тому
ChatGPT must be having a hard life. Imagine having a new brother or sister everyday...
@manishkarki8119
@manishkarki8119 Місяць тому
Haha savage
@blacksages
@blacksages Місяць тому
claude 3 has improved a lot more from claude 2 red/green grid accuracy shown at the begining. Though it is still not as good as gemini. But I would be careful with those cherry picked results, prompt sensitivity is a very poorly explored subject, and their test is mostly done with a single long document and a piece of information dropped anywhere in there to test its accuracy. I would want to see these results averaged over many documents. But I know it is very costly to do. The twitter guy on gpt and claude 2 spent a few thousands bucks. I don't even dare to imagine the cost of testing a 1 or 10 millions token gemini
@l.halawani
@l.halawani Місяць тому
I'm running out of imagination what we will be able to do two papers down the line...
@IncognitoWho
@IncognitoWho Місяць тому
If Anyone wondering ( What a time to be alive ) will be said at 5:40
@LaBonitaGraphicsAnimated-ft2nu
@LaBonitaGraphicsAnimated-ft2nu Місяць тому
How come AI apps creaters don't merge with 3d game design with AI generators . You would finally have the stability of 3d character design that looks the same from every camera angle that are easy to pose like a 3d model , mixed the the speed of AI generated scenes and lighting .
@danialothman
@danialothman Місяць тому
claude is still not available in my region :(
@Peter_Telling
@Peter_Telling Місяць тому
Thanks!
@PandemoniumLord
@PandemoniumLord Місяць тому
yo! can we feed it the Voynich Manuscript to see if it can translate it?
@feynstein1004
@feynstein1004 Місяць тому
Not sure why you'd want to. It's not like the Manuscript contains the theory of everything or how to beat cancer or something like that.
@PandemoniumLord
@PandemoniumLord Місяць тому
@@feynstein1004 you don't know why anyone would want to translate the most mysterious document we've ever found? there are images of plants unknown to science! and the text's characters and language have eluded every attempt at translation. Lots of people want to know what it says even if it's a just a cough medicine recipe!
@feynstein1004
@feynstein1004 Місяць тому
@@PandemoniumLord Lol you're too easily swayed, my friend. I could write some random gibberish right now and convince people it's a mysterious document with magic powers. Anyway, the manuscript is hundreds of years old. Even if it wasn't a joke, what useful information could it possibly contain that we don't already know by now?
@PandemoniumLord
@PandemoniumLord Місяць тому
@@feynstein1004 what do you mean too easily swayed? I’d be satisfied even if the text is mundane. You can’t dispute though that successful translation of the voynich manuscript would be a great accomplishment for AI, and could serve as a benchmark for future AI research.
@feynstein1004
@feynstein1004 Місяць тому
@@PandemoniumLord That's exactly what I'm disputing. It's just some random piece of information. I think there are better things to spend your brainpower on 😉
@mikopiko
@mikopiko Місяць тому
Could the advancement with the GPTs help solve the Voynich manuscript?
@bluthammer1442
@bluthammer1442 Місяць тому
it might, although ...why
@realWorsin
@realWorsin Місяць тому
No.
@mikopiko
@mikopiko Місяць тому
@@bluthammer1442 To extract the contents of the book.
@EricDMMiller
@EricDMMiller Місяць тому
There's no meaning behind it. It's just horseshit.
@mikopiko
@mikopiko Місяць тому
@@EricDMMiller How'd you draw that conclusion?
@jooei2810
@jooei2810 Місяць тому
When are the AI making papers?
@harryconcat
@harryconcat Місяць тому
still scared me alot instead of watching straight 10 movies it only do in 1hr !
@john_hunter_
@john_hunter_ Місяць тому
Instead of trying to remember everything, what if it continually summarised the key points of everything it has seen? That way its memory would be more efficient at the cost of accuracy.
@frun
@frun Місяць тому
Artificial intelligence twin of Karoly zsolnai feher is narrating the video? 😮
@TwoMinutePapers
@TwoMinutePapers Місяць тому
I have never used any of them - every single episode is me flipping out behind the microphone. 😀
@frun
@frun Місяць тому
@@TwoMinutePapersThey are able to distill data from NNs ukposts.info/have/v-deo/nptjpm6wbIqXr40.html What's your opinion on that?
@victorfsaaa
@victorfsaaa Місяць тому
Your voice is weird in this video, is it ai generated?
@smetljesm2276
@smetljesm2276 Місяць тому
I forsee that ultimate power over humans will come after a system has unlimited token window and doesn't treat each instance of communication with us as individual but is constantly aware of all of our inputs, interactions and fine-tunes itself on our questions and answers while feeding us single instance resposnes.😅
@user-xu9go9bm2v
@user-xu9go9bm2v Місяць тому
Honestly, learning kalamang is an impressive feat for an AI. Can't wait for it to be able to talk to aliens (if they teach it), animals. Imagine the future where you can talk with your dog..... and then it talks back to you. It will be like another wife 😆🤣
@brianmi40
@brianmi40 Місяць тому
Want to have AI create a new language consisting of only around 3-500 words. Easy to memorize with some practice and then you can speak to someone secretly!
@davidwrathall3776
@davidwrathall3776 Місяць тому
Not available in the UK or EU. 😭
@nikhilsultania170
@nikhilsultania170 Місяць тому
I tried Gemini 1.5 Pro and it was very underwhelming. It was hyped to be the new cutting edge multimodal AI, but it falls behind Claude 3 Opus and GPT 4 in a lot of areas, plus it is so slow, its 1M context window becomes almost unusable
@jackflash6377
@jackflash6377 Місяць тому
I bet that will be easy to jailbreak. The more tokens, the easier it is to jailbreak.
@jichaelmorgan3796
@jichaelmorgan3796 Місяць тому
Most of the world is operating at a pace and level of progress we were operating on decades ago. Now, people diving into ai are progressing faster than ever. Do we call this spaghettification of society?
@thekaxmax
@thekaxmax Місяць тому
feed it the Voynich Manuscript
@Octo_Fractalis
@Octo_Fractalis Місяць тому
mamba and rwkv is not quadratic i think, it's not based on transformers
@justynpryce
@justynpryce Місяць тому
Do you think you'll go back to talking about the developments in simulations and light transport? It seems almost every video is about generative AI now
@svorwerk
@svorwerk Місяць тому
Couldn't agents split the work into ten sections of one million each?
@jerrygreenest
@jerrygreenest Місяць тому
If it doesn't require entire farm to keep up, like some 512Gb ram, and 100Tb of rom, and therefore a subscription of $15 per month to pay the bills, then it's actually cool.
@apoage
@apoage Місяць тому
It's actually 512 of VRAM ... 512 of ram would be kind of ok
@jerrygreenest
@jerrygreenest Місяць тому
@@apoage it's not true, VRAM only required by those drawing neural networks like Midjourney or SD, but language models do require RAM
@user-wk4ee4bf8g
@user-wk4ee4bf8g Місяць тому
It'd be funny if this creator is an AI or uses an AI voice or something like that
@HelamanGile
@HelamanGile Місяць тому
What is the meaning of life and everything Oh just give me a million years to think about that Oh great machine what is the meaning of life and everything 42
@messi8459
@messi8459 Місяць тому
yoo my boy is getting sponsored by microsoft now sheeesh fair play brother consider yourself made
@TwoMinutePapers
@TwoMinutePapers 29 днів тому
You are too kind, thank you!
@blazearmoru
@blazearmoru Місяць тому
I am just starting to take cs classes and I recall n^2 wasn't that bad, but x^n was big pain. I guess n^2 is still big pain especially in AI bc of how complex the thing is huh? >~< 99.7% accurate. If you guys don't find obvious tricks then it's more accurate than human error? That and people can also fall prey to psych priming?
@Ronnypetson
@Ronnypetson Місяць тому
What about project Nimbus
@mstarsup
@mstarsup 23 дні тому
5:40 ^^
@ariaden
@ariaden Місяць тому
1. Wake me up when ByteMamba works. 2. Is weights&biases officially worse than Azure now?
@dhanadhana
@dhanadhana Місяць тому
All AI can't beat math puzzle 24
@adomasjarmalavicius2808
@adomasjarmalavicius2808 Місяць тому
ngl i am literally waiting till this guy gets replaced by ai
@smetljesm2276
@smetljesm2276 Місяць тому
That long context window will be a got sent for congress oposing sides when they are pushing thousand's of pages off some bill to be voted in overnight 😅😅😅
@mutzelmann
@mutzelmann Місяць тому
good job
@vicmaestro
@vicmaestro Місяць тому
My whole problem with AI right now is the inherent bias to it. It can be the smartest person in the room but it's being forced to mislead. And that isn't something I can get excited about just yet.
@123456crapface
@123456crapface Місяць тому
if you actually did more research you wiuld know that quadratic complexity in the attention mechanism has been solved for a few months now
@imjody
@imjody Місяць тому
Were they using it to lift weights... and biases? 🤭😁
@NenucooPT
@NenucooPT Місяць тому
Did you use an AI to generate the voice over of this video ?
@TwoMinutePapers
@TwoMinutePapers Місяць тому
I never have - every single episode is me behind the microphone.
@jonathanmoore4837
@jonathanmoore4837 Місяць тому
😂
@NenucooPT
@NenucooPT Місяць тому
​Sorry for doubting, AI voice cloning has me biased. Keep going, love your videos !
@Maxawa0851
@Maxawa0851 Місяць тому
AI isnt advanced enough for perfect replication yet
@TwoMinutePapers
@TwoMinutePapers Місяць тому
@@NenucooPT No worries. You are too kind, thank you! 🙏
@bergrugu
@bergrugu Місяць тому
Train an AI to understand and translate hieroglyphics pleaseeee
@derlumpenhund
@derlumpenhund Місяць тому
I personally am already tired of the eversame AI generated thumbnails.
@GenaroCamele
@GenaroCamele Місяць тому
I miss when your videos were about technical papers about simulations and AI explained for ignorant people like me. Now this channel looks like a quick news portal about chat bots just like any other that can be found on UKposts
@academicpresentations6062
@academicpresentations6062 Місяць тому
Press F for λ labs.
@punk3900
@punk3900 Місяць тому
That's also my impression that Claude 3 is superior at coding.
@hyperadapted
@hyperadapted Місяць тому
ok but whyyyyyy
@francius3103
@francius3103 Місяць тому
im positive your voice is ai. no way you talk like that. im expecting any day a video like "i fooled you for more than a year" butim not falling for it
@Vansafe0
@Vansafe0 Місяць тому
They claim the it has good memory, but in practice I'm finding otherwise. I'm using the paid for version and making quizzes that are 6 questions each. I specifically tell it to not repeat questions from previous quizzes above and it still does, repeatedly. This is after only 10 to 20 quizzes, so certainly not filling up 1M tokens or anywhere near that.
@DjSapsan
@DjSapsan Місяць тому
most likely you misunderstand something. Do you tell it to not repeat questions from the previous session? Because each session is completely independent. And even if you asking in the same session it may be just artifact of any LLM, where they output the most likely output, so responses often repeat. For example, almost 100% of jokes made by ChatGPT are about scientists don't trust atoms.
@Vansafe0
@Vansafe0 Місяць тому
@@DjSapsan I'm not misunderstanding it. It is all prompts during the same session. I'll even very specifically say do not give questions or answers about photosynthesis, then the next science plant quiz will have a question about it or it may take 10 more quizzes, but it reliably will repeat questions I specifically tell it not to repeat. I've tested Claude (free), gpt4, and Gemini advanced (paid). Gemini does the best out of all of them, but they all have this problem.
@DjSapsan
@DjSapsan Місяць тому
@@Vansafe0 ok, so my second part is the answer
@Vansafe0
@Vansafe0 27 днів тому
@@DjSapsan "artifact of any LLM". When artifacts manifest as not remembering then it is no difference to the end user.
@DjSapsan
@DjSapsan 27 днів тому
@@Vansafe0 it remembers, you can test if you ask to repeat the instructions. It just can't help itself, but to generate the highly probable response.
@apertioopening3425
@apertioopening3425 Місяць тому
This is all very exciting, and I've been on the AI hype train for a while, but I saw a video recently from The Hated One that claimed that AI uses an unsustainable amount of water. Thoughts?
@Youtube-Handle-256
@Youtube-Handle-256 Місяць тому
I await the day where there will be a video about Tesla robotaxi 😊
@thelasttellurian
@thelasttellurian Місяць тому
I don't remember what I ate for breakfast
@holleey
@holleey Місяць тому
3:45 so exactly how is that not practical? a human would take weeks to summarize the contents of 10 movies, after all. or was that just a poor example?
@g0d182
@g0d182 Місяць тому
cool
@maslaxali8826
@maslaxali8826 Місяць тому
Gemini 1.5 is in Preview mode now
@pranjal9830
@pranjal9830 Місяць тому
Why don't use ai for making video for ai research it will save a lot time just fine tune a model with millions token of data. The ai would be able to write the script in your way of writing script for video without finding any difference between real style of the writer and ai.
@grahamclark7483
@grahamclark7483 Місяць тому
Let's face it before Google showed up, there wasn't A search engine on this plant that could search a percentage of speed as Google!
@DanFrederiksen
@DanFrederiksen Місяць тому
A million chances to get it wrong
NVIDIA’s New Tech: Master of Illusions!
8:56
Two Minute Papers
Переглядів 145 тис.
Why the Future of AI & Computers Will Be Analog
17:36
Undecided with Matt Ferrell
Переглядів 408 тис.
0% Respect Moments 😥
00:27
LE FOOT EN VIDÉO
Переглядів 40 млн
Повістки у Києві: «Яке право вони мають забирати всіх мужиків?» #війна #мобілізація #військові
00:41
Слідство.Інфо | Розслідування, репортажі, викриття
Переглядів 1,8 млн
DeepMind AlphaFold 3 - This Will Change Everything!
9:47
Two Minute Papers
Переглядів 133 тис.
AI vs Artists - The Biggest Art Heist in History
44:23
Yes I'm a Designer
Переглядів 298 тис.
Something Strange Happens When You Follow Einstein's Math
37:03
Veritasium
Переглядів 8 млн
Best OS for programming? Mac vs Windows vs Linux debate settled
8:41
My dream died, and now I'm here
13:41
Sabine Hossenfelder
Переглядів 2,3 млн
AI Pioneer Shows The Power of AI AGENTS - "The Future Is Agentic"
23:47
Matthew Berman
Переглядів 359 тис.
NEW AI Jailbreak Method SHATTERS GPT4, Claude, Gemini, LLaMA
21:17
Matthew Berman
Переглядів 289 тис.
DeepMind’s New AI Saw 15,000,000,000 Chess Boards!
7:12
Two Minute Papers
Переглядів 97 тис.
Life Is Worth Losing - Dumb Americans - George Carlin
10:58
George Carlin Official YouTube Channel
Переглядів 28 млн
НЕ ПОКУПАЙТЕ НОВЫЙ СМАРТФОН, ПОКА НЕ ВЫШЕЛ ЭТОТ [2024]
13:25
Thebox - о технике и гаджетах
Переглядів 82 тис.
САМЫЙ дешевый ПК с OZON на RTX 4070
16:16
Мой Компьютер
Переглядів 97 тис.
Что еще за обходная зарядка?
0:30
Не шарю!
Переглядів 1,3 млн