An introduction to Reinforcement Learning

  Переглядів 637,758

Arxiv Insights

Arxiv Insights

День тому

This episode gives a general introduction into the field of Reinforcement Learning:
- High level description of the field
- Policy gradients
- Biggest challenges (sparse rewards, reward shaping, ...)
This video forms the basis for a series on RL where I will dive much deeper into technical details of state-of-the-art methods for RL.
Links:
- "Pong from Pixels - Karpathy": karpathy.github.io/2016/05/31/rl/
- Concept networks for grasp & stack (Paper with heavy reward shaping): arxiv.org/abs/1709.06977
If you enjoy my videos, all support is super welcome!
/ arxivinsights
If you have questions you would like to discuss with me personally, you can book a 1-on-1 video call through Pensight: pensight.com/x/xander-steenbr...
::Chapters::
00:00 Intro
01:03 So what is Reinforcement Learning?
03:39 Learning without explicit examples
07:25 Main challenges when doing RL
15:04 Are the robots taking over now?

КОМЕНТАРІ: 403
@SukhwinderSingh-fb9qw
@SukhwinderSingh-fb9qw 5 років тому
This was one of the best videos on RL that I have seen. Extremely informative. The way you explain things is awesome. Keep up the great work! Cheers man!
@floriandebrauwer9140
@floriandebrauwer9140 4 роки тому
Thanks for your work ! I like the way you present such a complex field in a clear manner for poeple without any background. Thanks to you I know where to start in my learning journey !
@rednassie1101
@rednassie1101 4 роки тому
People: ANN ARE TAKING OVER THE WORLD AND STUFF WILL NEVER BE THE SAME my horribly trained network on a cat: "dog"
@I_Lemaire
@I_Lemaire 4 роки тому
Could they help with the necessary government takeovers associated with COVID-19? Temporary command economies could be more efficient.
@revimfadli4666
@revimfadli4666 3 роки тому
UKposts's bots: "Robot fighting is animal cruelty"
@denebvegaaltair1146
@denebvegaaltair1146 2 роки тому
Your videos have just the right amount of technical terms such that student engineers can learn something, and also the right amount of summary and rewording such that beginners can get a vague idea of concepts. Thank you so much
@cemgocer8185
@cemgocer8185 3 роки тому
Quality of the video is off the charts. Topics u have chosen to explain the field, the way u explain them and especially pointing the common misconceptions that make it harder for us to get into what AI really is... I'm sad that there is no superlike button. Rare to see videos of this quality and honesty
@MuditBachhawatIn
@MuditBachhawatIn 4 роки тому
I have been meaning to read about RL for a long time. This video couldn't be more simple and clear introduction to it. Thanks man!
@josefpolasek6666
@josefpolasek6666 4 роки тому
Your videos are absolutely amazing! Thank you very much for explaining concept of RL in 16 minutes.
@shashankshivakumar4732
@shashankshivakumar4732 5 років тому
I love this video. I love his criticial and grounded thinking. Great work !
@gusbakker
@gusbakker 5 років тому
Great balance between a very well explained content and the interesting facts about current progress in AI at the end. Good work
@nemx4u
@nemx4u 6 років тому
You explain hard topics beautifully! great job. Would love to see more RL videos!
@angelakong653
@angelakong653 4 роки тому
This was really helpful. Thank you to people like you for creating this content. Appreciate you, Xander!
@orfeasliossatos
@orfeasliossatos 5 років тому
I've been literally looking all over for a video like this, thank you so much
@TY-un4no
@TY-un4no 3 роки тому
Complex stuff made simple and easy, this is a very good intro video to RL. Starting to learn RL for work and your video gave me a great starting point, thank you!
@jackwhite9332
@jackwhite9332 6 років тому
Impressive explanation, found this very useful. Thank you!
@7810
@7810 6 років тому
Good stuff to learn the RL in terms of basic knowledge as well as the challenge it will face. Thanks for your time and sharing!
@Hyuts
@Hyuts 4 роки тому
Explains in an elegant manner more than I have learned in half a semester of my AI college course.
@yuanyuansun3521
@yuanyuansun3521 3 роки тому
“If u only give it a positive reward when it successfully stacked a block, it’ll never get to see any of those reward” Only if my tutors realise this.
@davidfield5295
@davidfield5295 5 років тому
The misuse of 'literally' notwithstanding, this was an excellent video. Very clear and concise explanation.
@Lilowillow42
@Lilowillow42 2 роки тому
Just wanted you to know that in my university course for introduction to AI our professor recommended your videos for machine learning. Your explanation is highly enjoyable and informative. Thank you!
@mohammadhatoum
@mohammadhatoum 5 років тому
Great job.. Explained the subject in a simple way. Keep it up and looking forward for new videos
@DanielHernandez-rn6rp
@DanielHernandez-rn6rp 6 років тому
Love this guy. As an RL PhD student, your videos are golden.
@nikhillondhe5815
@nikhillondhe5815 5 років тому
RL PhD sounds so interesting!
@andres18m
@andres18m 5 років тому
Institute name?
@Ayanwesha
@Ayanwesha 5 років тому
hello..sir i am a grad stud can anyone tell me plzz if back propagation is necessary in supervised and unsupervised learning?or it is only used in reinforcement learning thanks
@hcgaron
@hcgaron 5 років тому
Ayanwesha 12345 yes, back propagation is used as a basis for gradient based methods of optimization
@ernie2111
@ernie2111 5 років тому
"RL PhD" didn't know such things exist lol
@josephedappully1482
@josephedappully1482 6 років тому
This is a great video; thanks for making it! Looking forward to your next one.
@Alex-gc2vo
@Alex-gc2vo 5 років тому
your videos are some of the best explanations I've found for a lot of these very advanced subjects. I suspect your viewer count is going to jump very quickly. keep it up.
@nateshrager512
@nateshrager512 6 років тому
Great job introducing the topic. Very nice job dispelling misconceptions surrounding the topic as well. I put on that notification for your next videos, looking forward to em : )
@Krimson5pride
@Krimson5pride 4 роки тому
It was both professional and entertaining at the same time. Great and precise explanation.
@snippletrap
@snippletrap 5 років тому
The perils of reward shaping are well understood in a public policy context, where incentives can lead to "unintended consequences".
@PriyanshuGupta-hf2hm
@PriyanshuGupta-hf2hm 3 роки тому
You explained so well that I understood each and everything in your video. I am overjoyed!
@saaniausaf9621
@saaniausaf9621 5 років тому
I loved the way you explained everything. Thanks!
@matfuckk4736
@matfuckk4736 5 років тому
Great quality and well-appreciated content. Please, continue, became your patron.
@Jshizzle2
@Jshizzle2 5 років тому
Perfect video, so much more intuitive than my lectures. Thanks a bunch!
@codyheiner3636
@codyheiner3636 5 років тому
Love the philosophical discussion at the end!
@ArnauViaMartinezSeara
@ArnauViaMartinezSeara 6 років тому
Really useful. I am preparing a Reinforcement Learning class aplied to finance and it is really helpful. Can't wait to see next episode. Thanks
@jonathaskerber5472
@jonathaskerber5472 5 років тому
Such a great introduction. Keep up the good work!
@amitredkar140
@amitredkar140 5 років тому
Great video!!!! Explained exceptionally, liked other videos as well from your channel. Would love to see more stuff related to AI/DL or RL. Thanks in advance. Keep up the good work....
@lincolnaisagbonhi8953
@lincolnaisagbonhi8953 4 роки тому
This is a great presentation on RL, short and clear content.
@dean8147
@dean8147 2 роки тому
You’re a legend mate. Honestly, thanks for all of your hard work
@luiseduardocorralesmendoza9396
@luiseduardocorralesmendoza9396 4 роки тому
Great examples and great explanation, thank you i was struggling with this topic
@bjbodner3097
@bjbodner3097 5 років тому
Great video, great channel! Thanks so much for making this! Can't wait to watch more:)
@sharadrawatindia
@sharadrawatindia 6 років тому
Hey Xander! Great videos. Looking forwards for your next video.
@OliverZeigermann
@OliverZeigermann 5 років тому
Very lively and understandable. Great work!
@majeedhussain3276
@majeedhussain3276 5 років тому
You deserve million subscribers hopefully one day you will. So much clarity in every video. Keep going...
@tonakkie635
@tonakkie635 5 років тому
Great overview, well explained👍.Thanks
@soumyakantadash5986
@soumyakantadash5986 4 роки тому
These videos are gem!!!..... incredible, precise and knowledgeable!!!!
@mehdisauvage1234
@mehdisauvage1234 6 років тому
Your videos are so useful and interesting ! This is pure gold to me :)
@atcer51
@atcer51 6 місяців тому
fiiiinnnaaaallly after tons of googling, I finally fund a USEFUL video that accually EXPLAINS how to reward the agent, and not just saying: 'oh u just reward it'
@tnmygrwl
@tnmygrwl 6 років тому
You do an awesome of structuring the content. Loved the video.
@payam-bagheri
@payam-bagheri 7 місяців тому
Brilliant video!
@Z4NT0
@Z4NT0 3 роки тому
I learned so much in just 16 minutes. Awesome Video!
@jorgegarcia-torresfdez2471
@jorgegarcia-torresfdez2471 6 років тому
You did again a really nice work ! Congratulations :D
@maisamwasti
@maisamwasti 6 років тому
Your videos = super informative! Thanks a lot for the good work
@empiricistsacademy7181
@empiricistsacademy7181 6 років тому
Thanks youuu for this video. Looking forward to your future videos!
@TheBeansChopper
@TheBeansChopper 3 роки тому
I think the comment section speaks for itself. This is a fantastic grasp of the basic concepts and issues with this technologies in such short time, without diving unnecessarily into formalism. Thanks :)
@poojanpatel2437
@poojanpatel2437 6 років тому
Best Channel on yt for ml/dl/rl/ai... Keep up the good work... Would love to see your new video weekly...
@ArxivInsights
@ArxivInsights 6 років тому
I'd love to make more videos too! But since I'm currently doing this 100% in my spare time and 1 vid takes about 30hrs of work, there's really no way I can do one per week for now :(
@poojanpatel2437
@poojanpatel2437 6 років тому
Arxiv Insights Still amazing work till now... Love to see your more videos in future.. ❤
@adammenges6300
@adammenges6300 5 років тому
your videos are so good, keep up the great work 💪🏻
@RoxanaNoe
@RoxanaNoe 5 років тому
Your channel is a great resource for getting into Deep Learning and AI.
@mantische
@mantische 4 роки тому
One of the best explanations I've seen
@andreasnatsis3027
@andreasnatsis3027 5 років тому
Amazing video. Keep up the good work and soon your channel will explode!
@ArturoMoraSoto
@ArturoMoraSoto 3 роки тому
Nice explanation, thanks for taking the time to create this great video.
@allamasadi7970
@allamasadi7970 6 років тому
Your channel deserves more views 👍
@akramsystems
@akramsystems 5 років тому
agree %100
@lohithArcot
@lohithArcot 3 роки тому
Not many reach these topics.
@aanex2005
@aanex2005 4 роки тому
I have no idea about RL but your video has given me a good jump start. Thanks man
@alirezaparsay8518
@alirezaparsay8518 10 місяців тому
The explanation was so clear. Thank you.
@sidharthaparhi7930
@sidharthaparhi7930 5 років тому
Also your intro is very high quality, like an intro to a good TV show
@khajasaen
@khajasaen 6 років тому
Best channel in the crowd ... keep it up Xander
@senri-
@senri- 6 років тому
Cant wait for the next videos keep up the great work!
@ingeniouswild
@ingeniouswild 5 років тому
Very nice episode! One thing that struck me about your suggestion that without Reward Shaping, the auto-learning of the 2600 games would be intractable: even for a human, this would be extremely difficult - we succeed with new, undocumented games because they often have similar sub-components and sub-goals that we already know from other games (or life). But I'm sure you could easily construct a game which would be impossible for a human to learn without any hints, while still having the same overall complexity.
@alenasazanova8331
@alenasazanova8331 4 роки тому
That's very interesting and understantable video. Thank you very much!
@gudusangtani
@gudusangtani 4 роки тому
So well explained ....I also liked the comments on Boston robotics considering the hype and buzz about AI and ML.. You are doing a very good job !
@011azr
@011azr 6 років тому
Your explanations are great, thanks :)
@rishidixit7939
@rishidixit7939 7 місяців тому
The sudden surprise of hearing Bruno Mars makes you pause video for other open tabs
@skviknesh
@skviknesh 5 років тому
Awesome!!!!!! Bro!!! Great explanation! !!!! Keep continuing!!!
@elvispiss
@elvispiss 2 роки тому
Even after doing my second course of RL, this video is still so informative in its simplicity. Great videos
@thaermashkoor6225
@thaermashkoor6225 2 роки тому
Thanks for this clear introduction.
@karFLY1
@karFLY1 6 років тому
Great as usual. Thank you :)
@christopherwolff8443
@christopherwolff8443 6 років тому
These videos are great. Keep it up!
@DotCSV
@DotCSV 6 років тому
Hi Xander, just found your UKposts channel and I'm very amazed about your content! I also run a UKposts channel with the same topic but for the Spanish speaking audience, and I'm happy to see that more new channels are growing to educate in the field of machine learning. I hope in the future we can crossover our contents :)
@ArxivInsights
@ArxivInsights 6 років тому
Checked out your channel, great stuff man!! It's indeed nice to see that many people are starting to contribute to the online ML community in such a huge variety of ways :p
@TheHirou
@TheHirou 3 роки тому
eeee yo creo que te acabo de ver en tiktok
@thanasispappas62
@thanasispappas62 10 місяців тому
By far the best video of RL ive ever seen.
@haizhoushi8287
@haizhoushi8287 6 років тому
Thank you the content is really insightful!
@erosennin950
@erosennin950 6 років тому
looking forward to the next one, awsomee
@abedinization
@abedinization 5 років тому
Thank you, very informative video!
@wzyjoseph7317
@wzyjoseph7317 2 роки тому
Very clear explaination! Thanks for the work!!!!XD
@mgilson
@mgilson 6 років тому
I can't wait for your next video !! 😍😍😍
@azmathmoosa4324
@azmathmoosa4324 6 років тому
I like how u don't hype up anything. Great mate! I subscribe!
@rajendrarao3057
@rajendrarao3057 5 років тому
awesome video sir. please keep up the good work in this field....
@shahulhameed-xc1to
@shahulhameed-xc1to 4 роки тому
Great learning experience. Thank you
@ms_1918
@ms_1918 4 роки тому
well came here for a 1 min intro to reinforcement learning for first class of course, stopped after 16 minutes what a superb experience.
@ipuhbamrash6708
@ipuhbamrash6708 4 роки тому
Fabulous!! No other word for you!!
@biiigates7381
@biiigates7381 3 роки тому
I've been learning AI for almost a year now and on all the channels I've spent with this is the best one. Very underrated! (btw its the first time i discovered this channel and I instantly subscribed)
@mundeepcool
@mundeepcool 3 роки тому
Same here, loved this video and I instantly subscribed... and also oh yeah yeah
@neerajkulkarni
@neerajkulkarni 5 років тому
Wow, great stuff! Subscribed.
@mujahid1324
@mujahid1324 3 роки тому
I would say "Wow'. You nailed it in10 mnts what's "reinforcement learning" is. Please keep sending more and more Ai . keep it up, Xander :)
@owencarey3216
@owencarey3216 6 років тому
Amazing video! Thank you so much.
@sridhasridharan3600
@sridhasridharan3600 3 роки тому
Great Videos! I am recommending these to my students.
@shirishbajpai9486
@shirishbajpai9486 8 місяців тому
watched in 2023 after all the LLMs stuff going on... still such relevant and pure gold!
@Vladeeer
@Vladeeer 6 років тому
Awesome video, keep up the good work!
@laeeqahmed1980
@laeeqahmed1980 5 років тому
Great talk. Humans are not good at multiple sound recognition and you added music to your video.
@merrilalmeida5982
@merrilalmeida5982 5 років тому
thanks so much Arxiv.
@stefano3808
@stefano3808 3 роки тому
really high quality videos, thanks for that
@freesoul2677
@freesoul2677 5 років тому
I really enjoyed your video, Thank youu!!
@digvijaybhandari9747
@digvijaybhandari9747 Рік тому
Really enjoyed the content here!
@amydeng1883
@amydeng1883 5 років тому
Thank you so much for your videos!
@keshavlakhotia1432
@keshavlakhotia1432 6 років тому
I will also love to see u Again in next episode
Reinforcement Learning with sparse rewards
16:01
Arxiv Insights
Переглядів 114 тис.
Зомби Апокалипсис  часть 1 🤯#shorts
00:29
ЧТО ДЕЛАТЬ, ЕСЛИ НЕ ХВАТАЕТ ДЕНЕГ НА ВОССТАНОВЛЕНИЕ ТАЧКИ?
47:52
Reinforcement Learning Series: Overview of Methods
21:37
Steve Brunton
Переглядів 84 тис.
Why Computer Vision Is a Hard Problem for AI
8:39
Quanta Magazine
Переглядів 115 тис.
Neural Network Architectures & Deep Learning
9:09
Steve Brunton
Переглядів 764 тис.
Training AI to Play Pokemon with Reinforcement Learning
33:53
Peter Whidden
Переглядів 6 млн
An introduction to Policy Gradient methods - Deep Reinforcement Learning
19:50
AI vs. AI in 100m Dash (deep reinforcement learning)
11:13
AI Warehouse
Переглядів 2,1 млн
AI Learns to Walk (deep reinforcement learning)
8:40
AI Warehouse
Переглядів 8 млн
Machine Learning vs Deep Learning
7:50
IBM Technology
Переглядів 587 тис.
Creepy Samsung Alarm cannot be turned off 😱🤣 #shorts
0:14
Adani Family
Переглядів 625 тис.
Creepy Samsung Alarm cannot be turned off 😱🤣 #shorts
0:14
Adani Family
Переглядів 625 тис.