DeepMind New AI Plays No Man's Sky!
Переглядів 71,976
Місяць тому❤️ Check out Lambda here and sign up for their GPU Cloud: lambdalabs.com/papers
📝 The paper "A generalist AI agent for 3D virtual environments" is available here:
deepmind.google/discover/blog...
📝 My paper on simulations that look almost like reality is available for free here:
rdcu.be/cWPfD
Or this is the orig. Nature Physics link with clickable citations:
www.nature.com/articles/s4156...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Alex Balfanz, Alex Haro, B Shang, Benji Rabhan, Bret Brizzee, Gaston Ingaramo, Gordon Child, Jace O'Brien, John Le, Kyle Davis, Lukas Biewald, Martin, Michael Albrecht, Michael Tedder, Owen Skarpness, Richard Putra Iskandar, Richard Sundvall, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Károly Zsolnai-Fehér's research works: cg.tuwien.ac.at/~zsolnai/
Twitter: / twominutepapers
#deepmind #sima
@PsuedoNymrod Місяць тому
Congratulations on 850 episodes! Thank you for all the information and inspiration. Happy to be a patron!
@TwoMinutePapers Місяць тому
You are too kind, thank you so much! 🙏
@ChuckNorris-lf6vo Місяць тому
Bro we need AI - x86_64 compiler, which makes everything faster. Right? @@TwoMinutePapers
@ccriztoff Місяць тому
The number 850 doesn’t hold any mathematical or numeral significant and it isn’t a large number so why would you congratulate him?
@christopherwu Місяць тому
What a time to be alive!
@dillonfreed Місяць тому
Congrats, I think I was here under like 10K, watched nearly every one
@uwoowoayaya Місяць тому
Even gamers get replaced by AI. Literally no one is safe.
@Redflowers9 Місяць тому
I know you're joking but you made me think about esports and realise that it probably won't be replaced as we like to watch humans competing which is something that by definition an AI will never replace, and that goes for all sports or anything than involves entertainment requiring human competition.
@kpoiii7795 Місяць тому
@@Redflowers9 chess has bots that can crash even top level pro humans for decades now. It was popular to watch human vs bot when they were about equal strengh. They didn't kill pro scene, but created a new one. Now you can also watch chess bot tournaments, where they play at levels unachievable for humans.
@fritt_wastaken Місяць тому
@@Redflowers9 sadly advancements in AI will make it virtually impossible to tell if someone's cheating, and humans LOVE cheating in esports. I doubt there will be much popularity for lan-only games, and online will be infested with cheaters
@Redflowers9 Місяць тому
@@fritt_wastaken good point but at least we'll still have regular physical sports lol
@Baleur Місяць тому
I dont play games to be a gamer. I play to get enjoyment.
@_John_P Місяць тому
Version 2: Doesn't do anything else anymore, refuses to leave mom's AI basement.
@mr.griffe9202 Місяць тому
This ai will be used to fill dead online games like the new suicide squad game with "players"
@MrYerak5 Місяць тому
Then the AI will start giving bad reviews, were dooomed
@freds6187 Місяць тому
Red dead redemption would be great game, I wonder what weird stuff that happen with a bunch of AI for npcs
@spilaney Місяць тому
More bots in Warzone lol.
@SozioTheRogue Місяць тому
@@freds6187 oh yeah
@soma78 Місяць тому
@@spilaney *smarter
@alanverduzco6513 Місяць тому
I wouldn't mind an AI gaming buddy tailored to my gamestyle
@scenenuf Місяць тому
imagine it having been trained on og cod mw2 360 lobbies for its communication programming
@Yobs2K 23 дні тому
Just imagine this system combined with some type of GPT-like AI. You could speak to it, it will understand what you want, tell you its plan and then go and do that exact thing while talking to you, keeping you informed of its progress and just casually talking with you. Now imagine the virtual world filled with NPCs based on this system. You don't even have to write any story, it will "generate" automatically and the possibilities would be endless. This really could be the future of gaming if we somehow make all of this systems optimized enough.
@Leshpngo Місяць тому
I'm SO excited for you to be able to visit the Deepmind labs, very good for you :)
@krellin Місяць тому
this can be used by gamedevs to test if the game is intuitive to get started with...
@YOEL_44 Місяць тому
Is the game going to be played by machines? If that is not the case then why should we trust in them to imitate our intuition? What I see this useful for, is for bug reproduction for example, you tell the AI to try and break a specific gameplay mechanic or level, and just wait for a farm of computers to find all the possible errors.
@B-I-G-N-A-S-T-Y Місяць тому
Great thought! That would allow the testers to fix the harder to find bugs. It would be nice to play a finished game . Reminds me of the first release of Skyrim after playing a fully functional game like Oblivion. Skyrim is an awesome game , but it was so new to me to be dealing with all those bugs and patches, little did I know how bad it could be.
@krellin Місяць тому
@@YOEL_44 the idea is you intentionally train a model that has different skill in gaming... complete noob model should be able to figure out basics of your game and say reach level N as a test... You could then automate this such that with new code this bot plays the game every week, withotu improving the bot just make it play and see if it started failing getting somewhere then you've introduced unintuitive mechanic or a bug.... Or you can make a very clever model play your game to find advanced unbalanced tactics that players will inevitably find... like OP weapons or strats etc..
@YOEL_44 Місяць тому
@@krellin It would not work and we would end up with even more yellow paint patches everywhere
@eltiolavara9 Місяць тому
it'd be nice as a side thing, because i think it'll play games in weird ways ...if the gaming industry survives that long its getting fucked sideways rn
@asdfasdfasdf1218 Місяць тому
Imagine if it gets good at complex building games like Satisfactory, Factorio, and so on. Then it won't be long before it can start competently playing "games" like AutoCAD and pspice designing new productions and inventions.
@andrewferguson6901 Місяць тому
another fun game to play with keyboard mouse is infosec CTF. let's see this bad boy ssh through jumpboxes to capture the flag
@YoutubeArtProject Місяць тому
I'm really convince we are living inside a game simulator.
@benjaminchen4367 Місяць тому
Ai can already do cad
@asdfasdfasdf1218 Місяць тому
@@benjaminchen4367 It can make already known things, not invent new things never known before such as create musk's neuralink. Also, the most important part is the verification and testing.
@bloodaid Місяць тому
This is a task that I've been delegated to solve. I told boss "you want AGI", he said "no" I said "yes".
@fjodorstjulkins5179 Місяць тому
Now it's literally No Man's Sky...
@lolszakjak7420 Місяць тому
It'll be like matrix soon fo sho
@Savag.e Місяць тому
Dude imagine AI in No Man Sky.
@dread46 Місяць тому
Also fitting storywise since the story reveals that all other npcs areactually simulations since the whole universe is a simulation ^^
@looksintolasers Місяць тому
When the machine's eyes open for the first time, I hope its first words are, "What a time to be alive!"
@jakubedzior Місяць тому
One Ring to rule them all, One Ring to find them, One Ring to bring them all, and in the darkness bind them.
@Si-Al-Ti Місяць тому
*Bing
@hydrohasspoken6227 Місяць тому
In the DeepMind Dungeons, where the Algorithms lie
@pierrecurie Місяць тому
*paper
@Jason_vinion Місяць тому
What?
@begobolehsjwjangan2359 Місяць тому
i want AI to be applied to NPC where they act like real person who have daily activity from wake up, daily activity (whatever their job/tasks are) and return home to sleep.
@mariaaryasophie9024 Місяць тому
Good idea
@begobolehsjwjangan2359 Місяць тому
@@mariaaryasophie9024 you know, like Free Guy movie. today AI can do that, it just need a powerful hardware. like cloud gaming. maybe a PC couldn't do that yet but a cloud gaming can definitely do that.
@jakezepeda1267 Місяць тому
Like oblivion without the socially inept dialogue.
@TayoEXE Місяць тому
I just want to say how I appreciate your consistent tone and clearness in your communication in videos.
@minetomek Місяць тому
Now we have to ask: "Can it play doom?"
@lumialight8305 Місяць тому
While i don't watch all your videos, i still truly appreciate your enthusiasm on the ones i do watch. On towards a 1000!
@tomatocat Місяць тому
I have no idea how can it abstract away so many different 3d worlds, with different lighting, camera angles etc. cant wait for AI game streamers tho /s
@apophenic_ Місяць тому
It's like how our brains integrate this information. Complete content abstraction is awesome. State of the art tech wise--built right into our hardware.
@carlpanzram7081 Місяць тому
Well, we have AI that can GENERATE various relatively accurate 3d environments, so it makes sense we would have the ability to make AI that can understand various 3d environments and interact with it. The big breakthrough will come when we will be able to combine all the different AIs abilities. If one AI can play Minecraft and other video games, one AI can controll a Boston dynamics robot, and a different one can generate good human language and another one can play go or chess better than any human.... Im not an expert at all, but it's obvious that the next 10 years will be wild af 😂 It's not long until you can tell a robot to go to the kitchen and make you a sandwich, and it will. Absolutely insane.
@apophenic_ Місяць тому
@carlpanzram7081 that's called multi modality. It's already in production with many models. And yes, it's fucking insane.
@robosergTV Місяць тому
same as your brain does it. ML is truly "magic".
@unreactive Місяць тому
Now that's baby AGI
@MikeTwohey Місяць тому
One day soon, we won't have to play our games anymore. What a time to be alive?
@research417 Місяць тому
Farming and cheating in multiplayer games is gonna go crazyyy. On the other hand, realistic npcs would be pretty cool?
@sssfsfdfsdsdffsfsdf4 Місяць тому
Its not a massive abstraction for this AI to now control a robot and get the AI to treat “work” as a videogame
@Redflowers9 Місяць тому
@sssfsfdfsdsdffsfsdf4 That's what I was thinking, but there's still a gap between game physics and real life physics, although this will probably shrink with Nvidias recent chips.
@HenriFaust Місяць тому
The new game will be making AIs to play games for you.
@adrianmaule7128 Місяць тому
AI gets to play games, meanwhile I have to go to work. It's not fair!
@jackburton5085 Місяць тому
I've loved your videos since we were only 1000 subscribers, congratulations on reaching 850 ep. With every video i always wait for *"what a time to be alive"* and I repeat it out loud hahaha.
@HappyHater Місяць тому
Excellent, I hate having to play all my games myself. About time that an AI takes over that task.
@Dvpainter Місяць тому
It's a little baby gaming AGI
@yagelbar Місяць тому
Finally, 2nd person games.
@SanneBerkhuizen Місяць тому
Oh. So i will have someone who wants to play with me soon..
@mihirvd01 Місяць тому
What a time to be alive!!! All hail the junior AI Overlords!
@rogueyun9613 Місяць тому
Thank you for sharing these beautiful papers! Enjoy your trip to Deep Mind's lab!
@LucenProject Місяць тому
Testing more general understanding in our created video games before the real world? I just want better AI agents for NCPs before we get full-dive VR. With some chat-GPT conversation skills based on in game lore and agent expertise/experience, some AI voice over. It could be great. Imagine the shop keep that can tell you about the town you're in or how specific goods are acquired, but can't tell you anything about the specifics of the adventurer guild or new models of space craft.
@LucenProject Місяць тому
@@Faizan29353 I did figure it would need a lot, but I didn't realize it would still require full online. Is the workload that much more than what can be done on a system or does the size of it not fit on a system? (Or could it be a battery/power consideration of where the process happens?) It's nice that it's already in consideration!
@asdfasdfasdf1218 Місяць тому
virtual environments don't require expensive equipment that could potentially break, unlike robots. It makes sense to use virtual testing grounds first.
@LucenProject Місяць тому
@@asdfasdfasdf1218 Plus you don't need many laborers to build it, you can change it very quickly between tests, once you've built it you can save it and bring it up again in an instant, you can send it long distances or copy it so others can use it for testing, etc.
@abderrahimbenmoussa4359 Місяць тому
Plug a multimodal llm to this to give the input text and you can likely make a high energy consumption low level player but crazy amazing !!
@ethanfreeman1106 Місяць тому
have a fun trip to the deepmind lab, doctor! truly an exciting time we live in, chaotic as it may be.
@sourish2515 Місяць тому
can't wait for baritone 2.0
@Jeremy-Ai Місяць тому
We love you for all of your papers my friend. Congratulations on hitting an essential milestone! Take good care, Jeremy
@Kie-7077 Місяць тому
Next iteration will be called 'skynet'
@Nulley0 Місяць тому
Can't wait for AI to pop in to real world and say. "Real world sucks"
@Gerlaffy Місяць тому
"AAAND" + "AHHND" = "ANHD"
@YOEL_44 Місяць тому
= 4A2H2N2D
@paulm6737 Місяць тому
omg i cant unhear it now
@gustitriandiwinata6397 Місяць тому
Hi Karoly. How did you get the simulation running? I'm only getting the blog and paper without runnable code
@krellin Місяць тому
thats very impressive
@imam5623 Місяць тому
Happy 850 episodes Mr. Karoly thanks for always bringing us the latest updates in Technology especially in Artificial Intelligence, and it's makes us very happy about it, what a time to be alive 🥳🎉📝
@MrJaggy123 Місяць тому
Can you imagine if both Genie and Sima get good enough that Sima can train in a Genie game? 🤓
@alichamas63 Місяць тому
Feels like a good way to do QA, reduce that bottleneck and find/fix bugs faster. Im sure anyone whos experienced day zero patches due to unreasonable delivery time lines would appreciate that.
@AmritZoad 22 дні тому
Finally I got all the time in the world to focus on my office work, cleaning dishes and laundry. AI can do art and gaming for all I care. Bliss.
@pinkguav Місяць тому
This is terrifying lol~
@MonkeySimius Місяць тому
Nice. I've always thought that any actual AGI would be able to learn to play games it isn't familiar with. I feel like this is a step in that direction. Obviously it is extremely far away from what I am envisioning for the minimum baseline for a single thing an AGI should be able to do. But still. This is neat.
@gonzaloenrique8741 Місяць тому
Ah yes a new upload from my favorite channel, 7 minute papers
@sikliztailbunch Місяць тому
As a child, we learn reality through games. This AI is most likely the prototype ot a tactical all purpose AGI. It starts peaceful and harmless. But for the AI itself, there is no difference between one of its games and reaity. There are rules and systems that can be learned and adapted to.
@tylersnard Місяць тому
Back in the 80s video games were text-based. "Move to the next room. Open the chest". Now they are text-based again!
@YoutubeArtProject Місяць тому
I'm now really convinced we are living inside a simulator.
@ChristopherMcIntosh1 Місяць тому
850! WOW! Keep up the great content! Thank you!
@marinomusico5768 Місяць тому
Amazing ❤
@TheMetatron333 Місяць тому
Been eagerly waiting for this type of AI
@logon-oe6un Місяць тому
While going the AutoGPT route of having an LLM provide the strategic planning seems obvious, I am kind of curious if there is a way to mimic what goes on with people with no inner monologue. I think not having a language representation could be faster, but harder to interpret, so maybe a bad, but still interesting idea.
@happybuggy1582 15 днів тому
Happy to see AI is playing video games for us now
@kyst4672 Місяць тому
yooo, did you know about 4D Gaussian Splatting? can you make a video about it? or did i miss it?
@kylemaolinson9417 Місяць тому
now you know why google is in decline: They are still working on gimmicks. Deepmind should merge with Boston dynamics. Perfect match.
@teac117 Місяць тому
This sounds great for UI testing
@CBEnoddyy 18 днів тому
Cheating in competitive games is one of the biggest problems gaming is dealing with right now especially FPS games, with many gamers now opting to play co op games instead. What is needed is a good AI to play against instead.
@erickmarin6147 Місяць тому
I need it to play Dwarf Fortress creatively
@the-secrettutorials Місяць тому
Wait, stop, hold on for a second… There is a Goat Simulator 3 🤯
@jocosesonata 26 днів тому
I just want this for NPCs. You can even talk to them!
@Me-ld8bt Місяць тому
Congrats for going to DeepMind’s research centre!
@DamianReloaded Місяць тому
It seems to me from the diagrams that the screen is converted to text and probably a language model then maps that text to actions. Unless the pixels are mapped to some form of coordinates based representation of the world it's going to be hard for the algorithm to properly navigate it.
@CoderCoding334-sy9dd Місяць тому
firsts it was ai will take comp sci jobs, now ai will take over gaming servers
@desu38 Місяць тому
Before we know it, we'll have a sassy hologram in every hospital!
@ELA_ONE Місяць тому
*❤What a time to be a game developer! But the real question is, can it handle my NSFW games?*
@Roberto-nb5cb Місяць тому
the AI will overheat lol
@MimicSilhouette Місяць тому
AI be like, 'Hold my code, I got this'
@Katiethekitten Місяць тому
It wouldn't be distracted lol
@Raphy_Afk Місяць тому
Don't do this, if it is than integrated in a robot it could create the first molesting robot
@OlympusAerial Місяць тому
get outta here with your CP simulation
@dzxtricks Місяць тому
There will be a conversation between gamer AI and non-gamer AI
@BaneLoki Місяць тому
Intelligence is a measure of how efficient you are at a task
@littlegravitas9898 Місяць тому
Generative AI playing a generative game. As if I didn't already suspect we all lived in a simulation
@NightTimeDay Місяць тому
Booooring
@Baleur Місяць тому
This is how AGI happens
@UmVtCg Місяць тому
Can't wait for an AI to grind out forced boring (ubisoft) gameplay loops
@htomerif Місяць тому
Being able to to exactly one task for a maximum of 10 seconds is an extraordinary limitation. I really, REALLY wouldn't call "pressing the fire button once" with the ship already lined up with an asteroid while being given the task "shoot the asteroid" "playing No Man's Sky". I'm pretty sure the "AI" from a 1990s Stinger missile could do equally well.
@matthewvonhofen Місяць тому
Man, sad that Code Bullet didn't get a shout-out. That guy's been doing this as a hobby for years.
@panzerofthelake4460 Місяць тому
good luck inside the Deepmind labs, Doctor!!
@hyperpony4865 Місяць тому
AI played rainbow six siege matches, like engine tournaments in chess will be amazing
@suikun245 Місяць тому
Finally I will be able to play party games with "friends" (AI)🤣🤖
@meatskunk Місяць тому
Would be curious to know what data this was (pre)trained on? Or what it deems “success” as a reward function? Agent 57 was deceptively successful in that it basically had a massive lookup table that it could cross reference, trial-and-error style en route to high scores. While gamers technically “train” by trial and error to some extent as well, they obviously don’t have instant recall across milliona of hours of gameplay en route to “success”. It’s interesting that SIMA plays No Man’s Sky. Considering the hype cycle that game has been through over the years, a *truly* intelligent AI would be able to speak to that - without just regurgitating other people’s thoughts scraped fron online resources.
@d.r.656 Місяць тому
Tesla FSD: hold my beer
@GotGooped Місяць тому
the scholar guys in the thumbnail are starting to feel like those wise mystical tree pictures if you're over the age of 45, you NEED to read this paper! click here to download!
@kobi2187 Місяць тому
next step is treat reality as a 3d game, and viola, it's here as a physical assistant, for better or worse
@erickmarin6147 Місяць тому
I've been dreaming about playing dwarf fortress versus an AI
@ahegpbtrftcotu Місяць тому
Its camera movement is... DISTURBINGLY human. There aren't sharp starts and stops, it doesn't move linearly in speed or direction, it overshoots and corrects. But it moves coherently. It goes where it's going. It doesn't jitter back and forth. It doesn't move unnecessarily. It looks like someone giving mouse input not with vectors but by moving a physical object with a crude muscle. That is TERRIFYING. I am VERY impressed.
@laz001 Місяць тому
The breakthrough here is something a little different in my view. It's image recognition and task execution in a VIRTUAL enviroment. Using that type of AI in a real environment is limited by...the REAL WORLD. There's only a few humans doing trials like this at one time. But with a virtual environment - you can spawn a million simultaneous instances and do true parallel learning.
@tristanfarmer9031 28 днів тому
Why do people in the comments care? This literally is just a fun project. It can't replace anyone. What are they gonna do, replace the consumers?
@faizanjaved1443 Місяць тому
Real-time comparison of Microsoft Copilot, Claude Opus Gemini Ultra Mistral Ai, Grok-1, ChatGPT 4 plus, Poe, and Bing Copilot.
@samuelthecamel Місяць тому
This legitimately looks like the precursor to AGI. Imagine if it all started with video games 😂
@begobolehsjwjangan2359 Місяць тому
i want AI to learn my habit and when i log off they'll continue grinding/mining. it will save me a lot of time. or an AI who can take over my avatar/character (with all my habit and stats) as i log off and become another player's pawn (dragon's dogma pawn system). so we as players can more focus on developing/upgrading the character than grinding. it takes away the boring part of gaming. this is a great feature for monetization for the gaming company. example: without monetization, a player can only get 4 hours of grinding while with monetization they can get up to any hours of grinding. or the grinding hours can be bought with ingame currency.
@mako9673 Місяць тому
That is very cool. Can't wait to have AI characters that can be more like human cooperative players
@Lightning---K. Місяць тому
Reminds me of the Robot Movie Number 5 lives ! It needs more input to get more intelligent .. looking for input all the time !
@asterlofts1565 Місяць тому
The A.I. It should apply to all modern games, I think, such as: Counter-Strike 2, GTA VI, The Talos Principle 2, future Half-Life games (or any original Valve games, such as Portal or Team Fortress, for that matter). of CS), to fighting or survival games, to games like Minecraft, VR games on PC (except Sony's, because it's not very good)... and a long etcetera. It's great for video games to have better, more dynamic, less predictable, more organic and much broader intelligence.
@eternalmeditation Місяць тому
should have it play BG3 a bunch of times, see what it does differently each time
@kinngrimm Місяць тому
eventually an AGI will perfect my Space Engineers blueprints ...
@GraveUypo Місяць тому
say what you want, but this is one of the most exciting AI researches for me. i can't wait to replace my "game friends" with AI friends that will be available at all times on a whim. and i'm fkn serious. i'm tired of trying to organize a match on a game for literally months, even a whole year, without success. i already have some AIs to chat with locally when i'm bored but i really wish we could play games together (trust me, i tried, they can't even keep track of a game of battleship, even gpt4 can't), and that they could retain memories better. welp, things only bound to improve.
@Soul-Burn Місяць тому
Oooh an AI that can clear my backlog!
@lawrencefrost9063 Місяць тому
We watch you watch the ai boom go boom.
@JoelPalu Місяць тому
Waitng for AI game walk-throughs
@minefacex Місяць тому
I think this is fundamentally the same problem as the one Figure is trying to solve IRL with robots. I am really interested to see how multimodal AIs can advance humanity.
@aureliena8471 Місяць тому
Can't wait for an full AI streamer that play games, beat pro players, has a human like voice that can respond to chats, even have a face
@3d-illusions Місяць тому
But can it complete Sekiro? If it's anything like me, then not until it can search for and understand youtube videos! :)
@SozioTheRogue Місяць тому
lmao then you just start seeing hella people with weird usernames commenting with hella long paragraphs in the comments sections. Omg, novels worth or arguments in comments sections would be insane. At least it would mean an unlimited amount of views for everyone eventually, ya know, because there could be billions of AIs all over the internet in a matter of years if they could just be set free and let into the wild. But then again, what if we cause a cyberpunk level event, flooding the open internet with AI might make us have to start creating closed local nets. idk lmao
@thomas.thomas Місяць тому
This will be used to control the new Terminator shooting civilians in real battlefields (of minecraft)
@hanskraut2018 Місяць тому
😍
@dannyarcher6370 Місяць тому
I mean, this looks more like the path to AGI than LLMs.
@Sugondees Місяць тому
Finally a practical AI.
Костильов Онлайн
Переглядів 215 тис.
Дмитрий Гордон
Переглядів 810 тис.
Kanaju
Переглядів 617 тис.
LED Screen Factory-EagerLED
Переглядів 7 млн
ICOOLA: Фабрика відновлених телефонів
Переглядів 95 тис.