AI Learns To Swing Like Spiderman

  Переглядів 5,185,231

b2studios

b2studios

День тому

J Jonah Jellynose suspects Spiderman is an AI. Captain Blubber is arrested twice. A phone screen is smashed. What is happening
0:00 Intro
0:30 Basics
1:30 States, Actions and Rewards
2:45 Discount Factor
4:09 Neural Networks
5:59 PPO
7:03 Policy Gradient
9:54 Clamping the Policy
10:34 What the AI Learned
13:05 Just Swinging
White paper on how to create an AI like this from scratch:
docs.google.com/document/d/1F...
Download this AI: github.com/b2developer/Spider...
Discord: / discord
Reddit: / b2studios
Twitch: / b2studios
Useful Links:
huggingface.co/blog/deep-rl-p...
fse.studenttheses.ub.rug.nl/2...
iclr-blog-track.github.io/202...

КОМЕНТАРІ: 2 600
@pittabread9861
@pittabread9861 Рік тому
Spiderman: homeschooled
@youtubeuniversity3638
@youtubeuniversity3638 Рік тому
Iron Spider: Retaught.
@dandabossthesecond3599
@dandabossthesecond3599 Рік тому
Spiderman: Learning from zero
@aahilmemon
@aahilmemon Рік тому
@@dandabossthesecond3599 no he said homeschooled because of the theme of “home” coming in Spider-Man titles
@dandabossthesecond3599
@dandabossthesecond3599 Рік тому
@@aahilmemon ik
@8jof544
@8jof544 Рік тому
The A-lazy-ing SpAIderman (the next new one in the spiderverse?)
@skycloud4802
@skycloud4802 Рік тому
I love how chill and lazy the AI Spiderman seems. It's like Spiderman putting the least effort into moving about with his webs, whilst allowing his body to just ragdoll with it all.
@par6749
@par6749 11 місяців тому
damn 69 likes i feel bad for u
@miikavihersaari3104
@miikavihersaari3104 11 місяців тому
He's napping while swingin'
@Dionyzos
@Dionyzos 11 місяців тому
Why look cool when it gets the job done?
@miikavihersaari3104
@miikavihersaari3104 11 місяців тому
@@Dionyzos Asleep is the new cool.
@Pupalah
@Pupalah 11 місяців тому
this is what happens when peter is knocked out and the spidersense is keeping him safe
@yudoball
@yudoball Рік тому
13:06 - he almost fell done - saved himself in the last second - celebration backflip
@b2stud
@b2stud Рік тому
I don't think it could've been more perfectly timed with the commentary ending
@J0rdan_S
@J0rdan_S Рік тому
He also kicked the guy in the face 😂
@Mordecai02
@Mordecai02 11 місяців тому
And showed us a couple of the cute fishie pedestrians :)
@thebeanqueen
@thebeanqueen 9 місяців тому
that part is so smooth
@ireallycantthinkofaname4726
@ireallycantthinkofaname4726 8 місяців тому
Yes
@Music-nn9mi
@Music-nn9mi 11 місяців тому
I think the reason the ai moved to using only one hand was to minimize the randomness that happens to its decisions. Since half the time they don't affect the outcome if you don't use one of them.
@BusinessWolf1
@BusinessWolf1 11 місяців тому
could have been solved if the webs toggled hands
@Music-nn9mi
@Music-nn9mi 11 місяців тому
@@BusinessWolf1 you about to toggle these hand lmao
@robonator2945
@robonator2945 10 місяців тому
oh yeah, this is big brain "You can't screw with my movements if I just don't move!"
@arremm4978
@arremm4978 8 місяців тому
I wondered if dropping 1 of the inputs (the left hand) allowed it to use more of the hidden layers to improve it's performance with the right hand. I'm not a doctor but that might be analogous to right/ left-handedness in humans.
@smike_mike
@smike_mike 10 місяців тому
because of the spiderverse this is a canon spiderman
@Schnort
@Schnort 12 днів тому
I love this. This was the same with Sonic for a while, too.
@sarafroats2935
@sarafroats2935 10 днів тому
Makes sense
@thatflatdude4451
@thatflatdude4451 Рік тому
"With great distance, comes great rewards" - Piderman
@youngmister3042
@youngmister3042 11 місяців тому
sπderman
@Complete_Stranger7050
@Complete_Stranger7050 11 місяців тому
Siperman
@ruddy2009
@ruddy2009 11 місяців тому
Der-Man
@WelshTommyTrolls2
@WelshTommyTrolls2 11 місяців тому
spooder man
@davidbratland9754
@davidbratland9754 10 місяців тому
Sperman
@mitrikgaduk347
@mitrikgaduk347 11 місяців тому
It's ironic because in most spider-man games, quick "thwips" are usually faster than using full swings, as you keep momentum better. Long swings have a curve to them and usually take a bit longer than just jumping off at the apex, which essentially looks like you are only swinging half way before thwipping again. It seems the AI has learned this.
@p-name1858
@p-name1858 10 місяців тому
Hope to god insomniac adds thwips to spiderman 2💀
@bscutajar
@bscutajar 8 місяців тому
Mathemattically, the fastest way to move would be to have a constant force in a constant direction balancing out drag and gravity. The way to approximate constant force and direction is ro constantly reshoot in the same direction.
@DracoHandsome
@DracoHandsome 8 місяців тому
@@bscutajar Well, almost the same direction. There would need to be constant angular adjustments to maintain the optimum elevation
@yesno1085
@yesno1085 7 місяців тому
The Grappendix
@jonaut5705
@jonaut5705 Місяць тому
@@yesno1085 cruelty squad reference?
@ironicanimations
@ironicanimations Рік тому
Let’s just sit and applaud the fact this man can code this stuff, animate fun stuff, and WRITE what happens in a coherent way for new people Holy crap 👏👏👏👏👏👏👏
@Wizzkidwas
@Wizzkidwas 10 місяців тому
Even more He composes the music that he uses for his videos
@ironicanimations
@ironicanimations 10 місяців тому
@@Wizzkidwas no way what?? Even better!
@crylune
@crylune 8 місяців тому
yeop i sure love seeing how everyone and their dog is smarter and more successful than me
@AlliSinned
@AlliSinned Рік тому
I like how the AI just resorts to using one hand form web shooting once it gets going. It’s like “why do I need two hands to shoot seems like a waste”
@maxiliarydendrite8926
@maxiliarydendrite8926 Рік тому
The real Spider-Man should take notes, obviously the way he’s been doing it is less efficient
@shytendeakatamanoir9740
@shytendeakatamanoir9740 11 місяців тому
​@@maxiliarydendrite8926 Sacrificing Efficiency for Style is something Spiderman would do, though
@Gore_Whvre
@Gore_Whvre 11 місяців тому
Yes
@lolshark33
@lolshark33 11 місяців тому
It's also better for a living being to use both arms bc it would even out the amount of strain. Plus the arm that's used all the time would probably be more muscular than the unused arm and I think we all know what that typically implies lol
@michaelpacinus242
@michaelpacinus242 11 місяців тому
@@shytendeakatamanoir9740 Spider-Man. Quite the beautiful word.
@Teslijah
@Teslijah Рік тому
5:54 Does this mean you could teach a jellyfish to be SpiderMan 10 times faster than this computer?
@ogluqqychess4452
@ogluqqychess4452 Рік тому
If the neurons were stripped blank without being damaged Id say why not
@talison718
@talison718 Рік тому
​@@ogluqqychess4452this reminds me of a project by some science youtuber to use human neurons to pilot a drone
@moritzkramer355
@moritzkramer355 Рік тому
​@@talison718isnt nearly every drone piloted by human neurons?
@talison718
@talison718 Рік тому
@@moritzkramer355 yup, but i am talking about put neurons in a plate an connect then to wires and then use a simulator to train them to fly a drone
@moritzkramer355
@moritzkramer355 Рік тому
@@talison718 quite unnecessary if you already have a brain but cool i guess
@Amyrose13lee
@Amyrose13lee 10 місяців тому
12:48 “It’s so good in fact, that it doesn’t need to look where it’s going” It developed Spidey sense without any programming lmao 😂
@GGCannon
@GGCannon Рік тому
You should make it consider hitting walls a bad thing (to train it to stick closer to the middle) and consider one of the rewards to keep the body facing forward, while facing back would be a discount. That way, it will probably give favor to alternating which arm it uses, to keep facing forward and to stay at the center of the road.
@roscoe5427
@roscoe5427 Рік тому
ten years ago i would not imagine myself sitting here eating my food while watching an AI grow up to be spiderman
@ifly-fsx
@ifly-fsx Рік тому
It's all fun and games until it becomes self-aware and launches the nuclear missiles.
@puplos125
@puplos125 Рік тому
​@@ifly-fsx so true i hate when it happens ong
@BritishBoy
@BritishBoy 11 місяців тому
​@@puplos125ruins a perfectly good Tuesday like nothing else
@pleasejustletmebeanonymous6510
@pleasejustletmebeanonymous6510 11 місяців тому
Videos like this have been around for a lot of years though. I'm not sure if it would have been 10 years ago, but I remember watching an AI play Super Mario quite a long time ago. (Looks like it was only 7 years ago: ukposts.info/have/v-deo/qaZniYyGiGZ3lWg.html )
@lord_gyver
@lord_gyver 11 місяців тому
Everyone can wear the mask
@TheActualAnthonino
@TheActualAnthonino Рік тому
I love how the web-slinging sound is just you going _"chu" "shue" & "shu"_
@the_germanempire
@the_germanempire 9 днів тому
Don't forget "shuye"
@drphalanges1520
@drphalanges1520 6 місяців тому
I like how it uses little micro-adjustments like you would do with thrusters in space. It's cool to see it so casually correct its course.
@TheFrozenFlame05
@TheFrozenFlame05 6 місяців тому
I love how occasionally it does a spider-man like trick or flip, but for the most part it just like flails around and lets gravity have its way.
@shufflecat3334
@shufflecat3334 Рік тому
A thousand times, thank you for the segment at the end following the trained model! It is SO frustrating when a channel explains something for ten minutes, and then instead of giving you the gratification of a finished product (something I'm sure the creator enjoyed plenty of) they just end off with "whelp thanks for watching! byeeeee!"
@pinkie723
@pinkie723 Рік тому
Yessssss!!!!! For real!!!!!
@whannabi
@whannabi Рік тому
@@pinkie723 foshooooo
@R0TEK
@R0TEK Рік тому
@@pinkie723 Based pfp
@pinkie723
@pinkie723 Рік тому
@@R0TEK Thanks lol
@FatalShotGG
@FatalShotGG Рік тому
That's why I just skip to the end. I have a brain. Be like me.
@Kodiakhunter
@Kodiakhunter Рік тому
14:50 looks like a trick that spider-man would actually do while swinging😂
@Izo_Risu
@Izo_Risu 9 місяців тому
Yeah, especially miles morales Spiderman, he's just going for style above all else
@grimsladeleviathan3958
@grimsladeleviathan3958 Місяць тому
I thought the AI was just trained to swing like Spider-man, not actually become Spider-man
@tonuahmed4227
@tonuahmed4227 3 дні тому
This is not show-off it necessity to swing properly...
@MegaChickenfish
@MegaChickenfish 10 місяців тому
I love that this both contains some of the most down-to-earth explanations of how AI works which were really informative, and also this: 10:34
@DarkTakanuva
@DarkTakanuva Рік тому
This is very good appreciate the swinging bit at the end, but also for providing a full explanation a bunch of youtubers I've watched will start out explaining something then blur all the words together to make it seem uber complex, and then skip right to the final product without actually explaining the steps they took to get there
@Longcat_1
@Longcat_1 10 місяців тому
*cough cough* Dani
@0PercentImagination
@0PercentImagination Рік тому
I'd love to see a part 2 to this that attempts to make variants by adding silly additional rewards (aka reinforcement learning) to the current spiderman, like a version that tries to do as many backflips as possible whilst also going fast in a forwards direction.
@MudakTheMultiplier
@MudakTheMultiplier Рік тому
I think specifying that the left arm must fire webs at the left wall and the right arm must fire webs at the right wall would be a good option for this.
@markellii3093
@markellii3093 Рік тому
Keeping the face forward would be fun, but could cancel out backflips. Avoiding hitting buildings would probably be for the best.
@SnrubSource
@SnrubSource Рік тому
@@markellii3093 Well, they could attach Unity's equivalent of a scene component to the ragdoll's pelvis, and only check its yaw to make sure it remains looking forward while still allowing it to do flips
@Bruva_Ayamhyt
@Bruva_Ayamhyt Рік тому
Sounds cool but first I want to see it learn not to hit the walls or ground, and to only use the web up to 1x/second. I think it would feel more natural. Maybe also keeping the head upright and the face forward too.
@MudakTheMultiplier
@MudakTheMultiplier Рік тому
@@Bruva_Ayamhyt typically you don't want to be to restrictive because typically with an AI like this it will either cheat your restrictions or will be locked out of potentially required steps of learning. Not to mention the interesting or groundbreaking solutions it could come up with outside of your parameters. That's why is said left for left, and so on. After thinking on it a while longer I think breaking it down even further into "reducing the amount of points earned for every successive use of the same arm in a row". Mostly because as long as the AI hasn't totally given up on ever using its other arm then the point adjustment should be able to just be made and then the ai should be able to successfully continue training without regressing too far.
@Kaylakaze
@Kaylakaze Рік тому
I'd like to see this with more constraints added (such as web cooldown, web transit time, Spider-man needing to see where he's going instead of flopping around, how body position effects momentum, etc).
@PuppyHugs
@PuppyHugs Рік тому
and how long the pizza can stay hot mhmhm
@megatroneata9911
@megatroneata9911 Рік тому
doable but if this took 11 hours that might take a few days
@Crazyates11
@Crazyates11 Рік тому
Yeah I like this idea as well. Maybe each arm can only do one web every 1-2 seconds, or the right arm can only hit the right wall and the left arm can only hit the left wall.
@yammyyuri9331
@yammyyuri9331 Рік тому
@@megatroneata9911 yes but if he adds more artificial neurons then that can shorten the time needed
@victoryerz2030
@victoryerz2030 Рік тому
@@megatroneata9911 As long as no new inputs are added, the constraints will actually increase the training speed by reducing the search space. However, things like adding vision for the actor or adding additional factors to the environment like more physics can make things exponentially more difficult.
@moralniy
@moralniy Рік тому
"Roman Sakutin" passed off your work as his own, and also inserted an advertisement in the video. You can try throwing a strike on his video.
@Dice-Z
@Dice-Z 11 місяців тому
Very well explained, i salute you man. Also, i love how rewards system in AI/Machine learning are basically dopamine hits for the AI in the form of code. Not that they are advanced enough to "feel it" mind you. They also kind of have similar capabilities to "job experience", neuroplasticity and muscle memory, though more so simulated, which is just an amusing thought to think about.
@BenSuzuki
@BenSuzuki Рік тому
I learned more in 15 mins here than I did in a semester of Reinforcement Learning. Maybe not, but this one is a lot simpler and visually statisfying
@luckyluc9972
@luckyluc9972 Рік тому
They need to teach ai to value literal style points as well as their primary goal.
@therealhussein
@therealhussein Рік тому
YES PLEASE
@symbiote1982pk
@symbiote1982pk Рік тому
Literal style points as opposed to figurative style points?
@luckyluc9972
@luckyluc9972 Рік тому
@@symbiote1982pk yes. Style points in normal conversation is typically just a way to tell somebody they did something cool. Style points in the example I posted would be another goal the AI could track and would be an actual score system to improve learning. Hope this helps
@Evan-ru6ro
@Evan-ru6ro Рік тому
The exaggerated swagger
@Fermion.
@Fermion. Рік тому
Hmm, how would you quantify style in the reward system? Backflips, using two hands, and facing forward are worth more points or something?
@souza9369
@souza9369 10 місяців тому
6:44 that twist was fire tho
@sebastian.h3003
@sebastian.h3003 4 місяці тому
Why did i found the ''Just Swinging'' part so relaxing 😭
@Blizzard4242
@Blizzard4242 Рік тому
You explained all of the concepts really well for someone who doesn't know anything about AI, but as someone who does know one part I was curious about which you didn't go into would be how you defined the reward. For example, did you want it to simply never fall to the ground, or were there other things you punished / rewarded apart from the general things you mentioned? I would be more interested in the process as well, which changes you made along the way etc. Maybe a separate video that is tailored to an audience that knows a bit about AI and go more into depth would be interesting!
@b2stud
@b2stud Рік тому
I am going to write a small paper explaining the details that I didn't cover in the video as well as uploading code
@Blizzard4242
@Blizzard4242 Рік тому
@@b2stud cool, thanks!
@Carhill
@Carhill Рік тому
@@b2stud You're an amazing web developer.
@davidp2537
@davidp2537 Рік тому
@@b2stud very excited for that!
@michaeldemartino1204
@michaeldemartino1204 Рік тому
:)
@Bendilin
@Bendilin Рік тому
@1:30 Liked just for the gargling
@Gloves-T-Catzero
@Gloves-T-Catzero 8 місяців тому
I got an as there LOL
@romanbundy921
@romanbundy921 2 місяці тому
😂😂😂
@RapidFireToaster
@RapidFireToaster 10 місяців тому
What's his canon event
@comissiongfamily799
@comissiongfamily799 25 днів тому
Tax evasion
@DaBrotfel
@DaBrotfel 14 днів тому
Falling flat on the ground for the first time
@JWillyP
@JWillyP 10 днів тому
Uncle yen died in a car crash rite after Aiter Airker was dropped off at school by him
@Sazz909
@Sazz909 5 днів тому
His canon event is the code breaking
@meaton3805
@meaton3805 8 місяців тому
I'd love to see what adding a limit to the number of webs would do. If it's only got a certain amount per arm, would it alternate arms? Would it swing further before using the next web? I wonder if it would look more like the Spider-Man we're familiar with or if it would come up with some crazy nonsense 😅
@Nightstick24
@Nightstick24 Рік тому
It's always fascinating to watch how quickly an AI can go from absolute failure to quite competent at a task. Thanks for breaking it all down, it's a very complex topic that makes my head spin - but you explained it very well, in simple enough terms and with fantastic visual aids, that I was able to follow along very easily and feel like I understand the general process much, much better than I did before!
@symynn2734
@symynn2734 Рік тому
the sound at 0:18 jumpscared me
@Puppetjerry18429
@Puppetjerry18429 6 місяців тому
Lol it was funny tho
@powerofanime1
@powerofanime1 11 місяців тому
Your sense of humor is stellar man. You definitely deserve more subs.
@b2stud
@b2stud 11 місяців тому
tyty
@michael80126
@michael80126 Рік тому
This is by far the easiest to understand explanation how AI works I've ever heard, thank you!
@josechomali
@josechomali Рік тому
Strangly pleasant to watch him just swing for 2 minutes straight
@davidblackshear4349
@davidblackshear4349 Рік тому
12:29 "overall, it just seems more confident with its actions." *slams into a wall*
@HotFootBunny
@HotFootBunny 8 місяців тому
Wdym bro is wall running like you do in the PS4 games, actually he's better at wall running that every single spider man to exist
@onemannation8116
@onemannation8116 Рік тому
12:02 Exaggerated Swagger
@dumflame
@dumflame 10 місяців тому
Of a White Guy
@TayoEXE
@TayoEXE 3 місяці тому
You taught me more about Deep Reinforcement Learning and Neural Networks in 10 minutes that the two semesters I wasted in a "capstone" class in college.
@XNaos
@XNaos Рік тому
I wasn't here for learning AI, but this is probably the most motivating video I've ever seen. You explained like everything necessary, so it gives the feeling that it is so easy
@dtracers
@dtracers Рік тому
That is because he skipped the 4 hardest parts. Choosing the right algorithm to train with (in this case PPO) Choosing the right state to learn from Choosing the right reward to learn with Choosing the right actions for the model to take Those 4 parts are the parts where it goes from "science" to "art/intuition" But you should try it!!! And by hard I mean it is the equivalent of choosing what color to paint a painting. Picking a paint is not a difficult process. Picking a paint that will mesh well with all the other paints and end up with a really good painting is much more difficult.
@blablasalsa3020
@blablasalsa3020 Рік тому
@@dtracers do you work on this field ?
@aguyontheinternet8436
@aguyontheinternet8436 Рік тому
This was awesome, you explained it in greater detail than any other programming youtuber I've watched. I noticed that the Ai is still very jumpy, shooting unnecessary webs out. I wonder if including the number of webs shot in the reward system would incentivize the long and wide swings we see spiderman usually do, as opposed to the short spastic swings the AI is currently doing.
@b2stud
@b2stud Рік тому
I did play around with penalizing the AI for casting too many webs, but I think it's very hard to get right. If you penalize it too much (which honestly wasn't even that much) then the AI becomes hesitant to shoot webs and it stops learning.
@arpita1shrivas
@arpita1shrivas Рік тому
@@b2stud what if you rewarded it for longer webs instead of penalizing casting too many webs, set a small incode timer to measure web time? or set a ingame timer which makes the AI only able to cast webs after a certain time period after the last one. if you're rewarding speed it's kind of incentive for the AI to spew more webs in order to get less pendulum type motion and more linear like motion, i suggest only a combination of that reward
@arpita1shrivas
@arpita1shrivas Рік тому
@@b2stud actually i just realised you can reward the AI for longer web distances, and more altitude of the web, do that in combination with speed and distance rewards
@paulinxm8201
@paulinxm8201 Рік тому
@@arpita1shrivas All of those are good ideas, but the last one is very smart. Definitely easy to mess up, but if implemented right would make beautiful swings.
@RalorPenwat
@RalorPenwat Рік тому
I think the most effective way to do might be to have him track his multiple directional velocities and diminish rewards for losing too much velocity at once, though you might need to also track directional acceleration to keep track of the changes in velocity so it could be a pain. Distance and speed are also good, but to maximize returns I feel multiple velocity and acceleration recognitions would better modify behavior because they'll allow for shorter web swings if they're warranted, IE, if you'd lose velocity by hitting something or accidentally exchange too much directionally from long webs, without creating many incentives for short high speed sling-shot webs, as those will almost always lose you a lot of velocity in some axis. Maybe overthinking though.
@lenivik
@lenivik 8 місяців тому
This is the most easy to understand description of RL that I've come across! They should play this video for first year students. Funny and informative, keep it up!
@Nunya111
@Nunya111 5 місяців тому
This has gotta be the first video that actually explains it beyond putting it in the simplest possible terms pretty cool
@joaozin003
@joaozin003 Рік тому
0:39 that house makes me go brrrrrrr 🎈
@MightyFartBomber1
@MightyFartBomber1 Рік тому
I'm clueless about AI, programming, and code but dude you explained the concept and theory so well that I was able to understand why it does what it does and also, because of this newfound knowledge on AI learning, I cant help but think of the AI as a cute little toddler trying to learn stuff lmao
@kyanbogard2993
@kyanbogard2993 Місяць тому
Please make 10 hour loops of ai swinging, this helped me sleep so well
@bimasatria7915
@bimasatria7915 Рік тому
Wow, didnt expect it's gonna be a whole deep learning 101. Nice summary and introduction Man!!
@J0nnyTheJ3w
@J0nnyTheJ3w Рік тому
Watching it catch itself at 14:20 was really cool
@dtracers
@dtracers Рік тому
I normally do not write comments but as someone who knows a lot about AI this was the best video I have ever seen explain the concepts. A "part 2" explaining the couple of concepts glossed over would be super interesting in a "fine tuning the spiderman" I wish we had AI interfaces that were as easy as you made them seem and if they get to that point then your video is the perfect "here is what you need to know to make your own AI" starter video.
@iXSIKOBOIXi
@iXSIKOBOIXi 10 місяців тому
It's very interesting that it uses one hand to swing. I would presume it thinks that due to the elements of Randomness such as the ragdolling, it can better adapt to things by reducing the variables. It's probably easier to adjust 1 arm when your body is being flung every which way than to use both
@shawbaby234
@shawbaby234 8 місяців тому
This is a real representation of how it feels to swing in that spider-man 2 movie tie-in game for me
@sethcushman5454
@sethcushman5454 Рік тому
Really interesting how it ended up just using one arm. I wonder if that was just easier for it to randomly learn, where the AI only had to learn to control 1 arm rather than 2, or if it is actually somehow more efficient than 2 armed.
@tylerherr4288
@tylerherr4288 Рік тому
id guess its because it wasnt incentivized to learn to use both if one works why try learning that the other works too? could fix that by giving each arm a strength value the value drops when webbed onto something but increases when not used
@DrMonty-ng5fo
@DrMonty-ng5fo Рік тому
Makes sense to me, using two arms requires coordination between the two, whereas using one arm only means that the AI can just shoot a web upward on one side, then the same for the other side, with no chance of one arm fucking up the other.
@Ett.Gammalt.Bergtroll
@Ett.Gammalt.Bergtroll Рік тому
It isn’t concerned with style points after all. 😅
@reqqz9595
@reqqz9595 Рік тому
Amazing video, just as your content always is! I'd like to see the AI being more rewarded for speed, so it goes flying trough the city. Thanks for always making these topics (which require a lot of effort to comprehend) into something simple.
@ObviouslyASMR
@ObviouslyASMR 6 місяців тому
Damn I think this is the best explanation of PPO (and perhaps even RL as a whole) that I've ever seen, including my Master's course in RL lol (obviously a bit less detailed but really intuitive)
@aswd1979
@aswd1979 Рік тому
this is a great vid I dont know much about ai and stuff like this but I thinks it is all very interesting
@hdcafssd
@hdcafssd Рік тому
love the little mid-air pose at 13:11
@misspotato813
@misspotato813 Рік тому
I think you did a very good job explaining a lot of this, as someone who knows little about machine learning. However, there was one part I was really lost. I was hoping you could clarify: how do the "hidden nodes" work / what do they do? I assume they're the actual math that lets the AI decide what to do, but I don't really get how.
@b2stud
@b2stud Рік тому
Each time information flows through the neural network all the connections between the nodes alter it. Having hidden nodes drastically increases the amount of connections, which gives the AI more control over how it filters / transforms that information. There isn't any difference between input / hidden / output nodes besides their location in the network. Essentially the more hidden nodes you have, the more the AI can alter the information it receives = the more intelligence it can have
@AnaseSkyrider
@AnaseSkyrider 11 місяців тому
Another way of looking at it is that more nodes means for more ways for information to "weigh" against each other. Each node essentially has a value and a weight for how much that node influences its connection. It's all basically percents. You want lots and lots of connections because it leads to a more in depth and nuanced way for information to relate. The relative angles of the arms and each joint should relate to how the web is fired, and if caring about efficient motion through air resistance, then it will also want to factor in the other body parts too. The more connections, the more complex and nuanced relationships you can factor into the system.
@user-ws8bb8ii4n
@user-ws8bb8ii4n 9 місяців тому
You have just explained ppo in 10 minutes better than what I've learned in two weeks trying to code it
@markus_seitz
@markus_seitz 11 місяців тому
Mate that thumbnail is actually mindboggling good. Never tapped on a video that frekin quick!😂
@kevintyrrell7409
@kevintyrrell7409 Рік тому
I think it would have been a good idea to reward the AI for using both of its hands, possibly alternating or swinging with both.
@aguyontheinternet8436
@aguyontheinternet8436 Рік тому
@Erinç Argımak fair, but we want style darnit
@SgtSupaman
@SgtSupaman Рік тому
The problem lies in allowing it to be able to optimize with just one. A sufficient cooldown should be part of each web shooter to better imitate how Spider-Man can't make webs just instantly appear like laser beams. Once it loses efficiency with one arm, it should start trying to go faster with both.
@jasonruff1270
@jasonruff1270 Рік тому
yeah style points
@beast-chan
@beast-chan Рік тому
This guy is really producing the high quality content out there. Love the videos so keep it up💯
@eaoke3383
@eaoke3383 5 місяців тому
Amazing video! Thank you for such an elaborate explanation of everything!
@EirTheGhost
@EirTheGhost Рік тому
As someone who is majoring in CS and enjoys the idea of AI and it solving problems your videos are amazing and hilarious.
@Canard3D
@Canard3D Рік тому
It's not everyday you find someone who backflips and someone who explains AI... It's even rarer to find a channel that does both. Backflip you magnificent AI
@whannabi
@whannabi Рік тому
The chances are millions to one
@rehaan8
@rehaan8 Рік тому
The ai backflips he explains neither does both
@joshuapianoman55
@joshuapianoman55 Рік тому
This was such a well detailed video! I love learning the more technical side of these AI endeavors. Great video!
@grumpyowlstudios7023
@grumpyowlstudios7023 10 місяців тому
This is like a fever dream. Love the format.
@MehmetcanOksuz
@MehmetcanOksuz Рік тому
This video has better production than many new Hollywood films.
@DMMDestroyer
@DMMDestroyer Рік тому
Appreciate the breakdown in the entire video, but 14:04 onward is a vibe that needs to be made into a short. "AI Spooderman webslinging at Sunset" You'll get 1 million views easy 🤣
@CoraCD
@CoraCD Рік тому
That sound when it hit the ground😂 0:19
@rhyrhy69
@rhyrhy69 Рік тому
the animations were so good aswell as the entire video
@keianrobinson4712
@keianrobinson4712 11 місяців тому
I'm really digging the dedicated bus lanes and wide sidewalks!
@kingd413
@kingd413 Рік тому
10:49 - "Yo Spiderman, you good bro?" But in all seriousness, this was a really good video - explained all the concerts in a concise and easy to follow way (even if some of them went past my head lol). Looking forward to more content bro!
@fondir3626
@fondir3626 Рік тому
I rarely write comments and only got here through the youtube-algorythm. But MAN i really enjoyed this video. Not too technical and not too basic. I rarely watch a recommended video more than 2-3 minutes but i HAD to watch this all the way through. You explained it very entertaining and i understand AI MUCH better than before. Thank you!
@b2stud
@b2stud Рік тому
Np. I'm very happy to hear that!
@zined128
@zined128 Рік тому
you just taught me about neurons and i am so insanly interested in the topic now
@TheAliceQuo
@TheAliceQuo Рік тому
"that's too complicated for this video" Bold of you to assume I understood anything up to that point.
@janewan1196
@janewan1196 Рік тому
At first I thought this video would just be another neural-network-plays-a-game video and that I wouldn't learn anything new from it, but I am so glad that I was wrong! You presented these complicated topics so well, along with some comedy along the way! I wonder how advanced the AI could get given more inputs and outputs to control the other parts of the body, more time, and a more advanced reward function to encourage spiderman to stay up straight, move fluidly, avoid walls, and perhaps add in some acrobatic flair
@itsonlyagame4033
@itsonlyagame4033 Рік тому
I want this as my wallpaper engine background, just endless swinging
@RobertChambers1522
@RobertChambers1522 9 місяців тому
This is exactly how I imagined a Spooder-Man movie would look, and it's a masterpiece.
@psychoticsy6350
@psychoticsy6350 7 місяців тому
It’s learning. It’s evolving. It finally understands that we want to watch the ai do the thing it was made to do.
@alansmithee419
@alansmithee419 Рік тому
7:30 For some reason saying "it will become slightly less wrong" instead of "slightly more correct/slightly better" gave me a chuckle.
@gnomge
@gnomge Рік тому
Been there since piderman was just a skydiver occasionally smacking it's face against a wall But seriously you explained the algorithm really well and I'm just surprised how it went from a broken atari session to... this.
@calamaloo6592
@calamaloo6592 6 місяців тому
As a suggestion on this one - You could perhaps train an AI on moving like Hulk - As in using muscles to jump / propel itself through the air, and learning to accurately land roughly where it wants to in order to then jump again, aiming for a specific destination (and maybe also avoiding landing on buildings / cars or something?)
@mysticalduck7287
@mysticalduck7287 10 місяців тому
My gosh this is a useful and extremely well done video!
@garethfuller2700
@garethfuller2700 Рік тому
3:05 *Oh no, it's Chairman Drek- HE'S BACK, and this time he's HIGH RISEN!*
@Hpmanenz
@Hpmanenz Рік тому
I've been interested in AI/ML for a while now, more specifically Reinforcement Learning which is the one described in the video. I already knew the general idea of what it is and how it works but I must say, your description was the most clear one I've heard so far.
@michaelren9771
@michaelren9771 8 місяців тому
Actually there's a course on coursera by Stanford Professor Andrew Ng, who's one of the founder of deep learning methods that's pretty easy and good for an introduction, I know a lot of people and friends of mine recommended it, and I'd definitely recommend it.
@ML_Lab
@ML_Lab Рік тому
Amazing! I've been experimenting with flying like Iron Man and never thought I'd find something like this!👍👍👍
@Gloves-T-Catzero
@Gloves-T-Catzero 8 місяців тому
2:26 Just realized this is a B2Studio version of J Jonah Jameson. Very cute! :D
@N0ahFence
@N0ahFence Рік тому
I learnt so much from this video... You are fantastic and so clear with your explanations. Subbed for sure!
@fredtrunce5931
@fredtrunce5931 Рік тому
That was great! I love it when you upload! (Could you maybe slap some royalty free music over the AI doing its thing at the end next time tho? It doesn’t have to be super loud or nothin, just something nice)
@Galaticknight
@Galaticknight 9 днів тому
Good stuff my guy you did amazing with the ai
@sullivandeffinger4970
@sullivandeffinger4970 10 місяців тому
Insane production value here
@mustachemiss1983
@mustachemiss1983 Рік тому
This video is really really cool! I've always wondered how genetic models actually work, and this cleared most of it up, so thanks! One question that I do have though, is what do the hidden neurons do? Are they just empty variables that the data passes through? I'm just not quite sure how or why they help it learn.
@Wizzkidwas
@Wizzkidwas Рік тому
Brilliantly explained video, I absolutely love your visual style as well as the little ball mascots, they got a name?
@b2stud
@b2stud Рік тому
Thank you! They do have a name, I just call them fish
@Wizzkidwas
@Wizzkidwas Рік тому
@@b2stud FIIIISH
@Diego91940
@Diego91940 7 місяців тому
This is SO GOOD content, keep up with it
@proper_amount
@proper_amount 11 місяців тому
Interesting to see how the AI’s preference for the right wall stayed with it up until its final generation, using it for all the momentum gain and large swings, while only using the left wall for posturing.
@MrJoshAhern
@MrJoshAhern Рік тому
The most detailed explanation of AI learning I've ever seen. Thank you!
@polpus5214
@polpus5214 Рік тому
I'm going to start my master degree in September in AI, and now I'm more excited to start thanks to this video. Thank you!
@valovanonym
@valovanonym Рік тому
Good luck! It's a very fun field :)
@da_boi
@da_boi 10 місяців тому
imagine an online spider man game like pogo stuck and you need to control your hands with the mouse and shoot webs to get through levels, and then when you finish it it gives you like an open world map with stuff to do
@crescentninja
@crescentninja 8 місяців тому
Finally the Spooderman game I've been waiting for.
1 minute LEGO HACKS...
8:21
TD BRICKS
Переглядів 14 млн
How to get arachknight in invisions webverse
12:46
ElGato_ikhouvantrein
Переглядів 116
ФОКУС С ЧИПСАМИ (секрет)
00:44
Masomka
Переглядів 3,1 млн
Кровосток - разговор с легендами / вДудь
2:12:57
AI Tries Snowboarding (and falls a lot)
16:14
b2studios
Переглядів 158 тис.
AI Learns Table Tennis
11:20
b2studios
Переглядів 929 тис.
AI vs. Stairs (deep reinforcement learning)
12:00
AI Warehouse
Переглядів 847 тис.
I Built a Transparent Katana (it's unbreakable)
22:02
Mike Shake
Переглядів 8 млн
I Made Wii Sports But It's VR
8:02
Sharp Vortex Games
Переглядів 8 тис.
Cannons that Never Miss
8:24
b2studios
Переглядів 498 тис.
AI Invents New Bowling Techniques
11:33
b2studios
Переглядів 3,2 млн
I Tried Web Swinging like Spiderman in Real Life!
10:24
Drew Dirksen
Переглядів 4,2 млн
Using Video Games to Simulate Evolution
20:26
Curious Archive
Переглядів 1,8 млн