Mastering Chaos - A Netflix Guide to Microservices

  Переглядів 2,276,025

InfoQ

InfoQ

День тому

Want to attend #Qcon or #DevSummit for free? Here's your chance!
Write an article for #InfoQ and you could win a ticket! Show off your expertise and contribute to the tech community.
Join the contest now: www.infoq.com/articles/infoq-...
💪 Knowledge is power!
#ArticleContest #TechArticles #WinATicket
----------------------------------------------------------------------------------------------------------------
Josh Evans talks about the chaotic and vibrant world of microservices at Netflix. He starts with the basics- the anatomy of a microservice, the challenges around distributed systems, and the benefits. Then he builds on that foundation exploring the cultural, architectural, and operational methods that lead to microservice mastery.
Download the slides & audio at InfoQ: bit.ly/2m1dqeA

КОМЕНТАРІ: 533
@StingSting844
@StingSting844 7 років тому
Can't express how high quality this talk is. Wonder if he was a teacher before!
@jordantaylor8549
@jordantaylor8549 6 років тому
Yah I was wondering the same thing . Very top tier presentation and speaker
@JamesJansson
@JamesJansson 6 років тому
When you are the lead developer for a large org, it is your job to be an educator at a high level.
@ThunderAppeal
@ThunderAppeal 5 років тому
Youre full of shit. You have no idea of any of this.
@yahorsinkevich4451
@yahorsinkevich4451 5 років тому
I would say this is a perfect talk that describes how to writer microlyth and how NOT to design microservices based arch
@StingSting844
@StingSting844 4 роки тому
@@ThunderAppeal Yeah thats why I have come here to learn!
@PeterMoueza
@PeterMoueza 3 роки тому
A timeline : 12:30 EVcache client 16:05 Hystrix Tests 17:55 combinatorial 23:07 consistency 24:53 multi regions failure 26:20 stateless 27:45 stateful 28:40 cache Squid 30:00 EVCache 39:20 API Gateway 45:00 Actions 45:40 AWSreinvent 48:00 RCP 49:20 Conway's law 52:49 cache caching
@ardonjr
@ardonjr 3 роки тому
Tip: Replace the 'mn' between the numbers for a colon like so: 12:30 because that will create real timestamps ;)
@PeterMoueza
@PeterMoueza 3 роки тому
@@ardonjr Good advice, thank you !
@tanveerhasan2382
@tanveerhasan2382 2 роки тому
Bless your heart
@PeterMoueza
@PeterMoueza 2 роки тому
@@tanveerhasan2382 Thank you so much
@erikbaldwin3049
@erikbaldwin3049 9 місяців тому
Zo
@sandy.aggarwal
@sandy.aggarwal 3 роки тому
Watched again 3 years later and it's still so relevant.
@Inquisidor9408
@Inquisidor9408 2 роки тому
it doesn't get old
@sundeepreddythirumuru5266
@sundeepreddythirumuru5266 6 років тому
One of the best talks I have seen on building systems of high scale, high availability, failure resilient and agility in undergoing change.
@arthurkeech
@arthurkeech 4 роки тому
One of the best technical talks I've ever seen.
@ErnstFluttert
@ErnstFluttert 3 роки тому
Great talk, which is still relevant in 2020! Especially the practical examples, and the solutions they applied. Loved the analogy with the human body. Thnx Josh!
@Mike.e
@Mike.e 5 років тому
Excellent talk. Envious of your delivery! Thank you!
@OliFubar
@OliFubar 3 роки тому
I am sad I found this 3 years late, I've been developing microservices for the past 3+ years but I still learnt a lot from this. A huge belated thanks to you Josh!
@sairampareek
@sairampareek 6 місяців тому
And I found this 3 years later you commented
@martinmogusu
@martinmogusu 3 роки тому
This is a really informative talk on microservices, with real challenges and real solutions. The human body analogies make a lot of sense, there's a lot we can learn from nature...
@tidal4774
@tidal4774 6 років тому
One of, if not the most comprehensive and analogous talks on the subject with relevant, real world stories from someone who has lived it. Thank you.
@clarkpeng8106
@clarkpeng8106 5 років тому
what I've learnt important from this video is keeping perfecting your tools & architecture.
@ashimov1970
@ashimov1970 3 роки тому
1:51 "how amazing the human body is and how something as simple as an act of breathing or interacting with the world is actually a pretty miraculous thing. And it’s actually an act of bravery to a certain extent. There are so many forces in the world, so many allergens and bacterial infections and various things that can cause problems for us." - watching this on Feb 12, 2021 makes me admire this guy and the company he dedicated part of his miraculous life.
@souvikghosh8068
@souvikghosh8068 Рік тому
I come back to this video once in a while to remind myself how cool the software engineering can be.
@igrai
@igrai 6 років тому
very good and a very open talk, no generalities - really an insider's look into these challenges - awesome!
@sirnawaz
@sirnawaz 5 років тому
Brilliant talk! ... and the references to the various biological systems of the human body, throughout the talk, makes it even more interesting. It is amazing to see how various aspects of microservice architecture find similarities with other things created by the nature itself. On a microscopic level, we can draw analogies to the multiple-core, memory fences and cache-coherence as well.
@gashinamu
@gashinamu 5 років тому
One of the best tech talks I've ever watched.
@infoq
@infoq 5 років тому
Happy you like it. You can find more on www.infoq.com/
@wartem
@wartem 7 років тому
good stuff
@OrdinaryFemmale
@OrdinaryFemmale 2 роки тому
this beast is *ONLY* working for netflix for the last +20 years, that's pretty amazing! thank you for this video, great presentation!
@jegtugado3743
@jegtugado3743 3 роки тому
This talk is amazing. I'm far from being a system architect but this gives me a bigger perspective on how amazing systems like Netflix is built.
@joechen2800
@joechen2800 3 роки тому
Using organization as examples are really self-explanatory. Brilliant talk!
@bdpyne
@bdpyne 2 роки тому
Really fantastic talk. He used analogies well, making abstract concepts more concrete. My most important takeaway was the evolving nature of architectures. Architectures are challenged both by external factors (customers) and internal factors (operations, customer support, etc.).
@cardboard3161
@cardboard3161 3 роки тому
Speaker: "Breathing is a miraculous act of bravery." 2020: "Challenge accepted."
@Yusuf-ok5rk
@Yusuf-ok5rk 2 роки тому
he is breathing in micro doses so that he can serve a continuous presentation
@prakhargupta629
@prakhargupta629 5 років тому
Few years into corporate job and I had forgotten how many things are there in Computer Science. This talk brought me back to college.
@midnightsyntax3333
@midnightsyntax3333 6 років тому
Excellent presentation! The slides are super clear and specific. 5/5 kernels
@ChidambaramVelayudham
@ChidambaramVelayudham 3 роки тому
Absolutely Awesome. Love the way how Josh presented. Appreciate you for sharing the knowledge.
@CoolHandMikeYT
@CoolHandMikeYT 6 років тому
This is a really great talk to understand problems and solutions with microservice oriented archtecture at a large scale.
@apurvsawant5703
@apurvsawant5703 4 роки тому
This is one of the best videos to get insights into micro services architecture.
@Patrickdaawsome
@Patrickdaawsome 6 років тому
Note to self: Write down summary starting from the 51:25. P.S. I watched the whole thing and absolutely loved it.
@andrewferguson6901
@andrewferguson6901 4 роки тому
in case you didn't write it down where you could find it
@jonopens
@jonopens 6 років тому
Such a fantastic metaphor to communicate the intent of microservices. As a younger programmer, that really resonated with me.
@infoq
@infoq 6 років тому
If you are interested in microservices content you can check our collection on InfoQ. www.infoq.com/microservices
@UberOcelot
@UberOcelot 3 роки тому
As someone who doesn't deal with this side of architecture, this is a fantastic talk. Micro-services are just a division scheme, not really an architecture. To get things really running smoothly this provides some great insight to where the real work starts.
@Innovate22
@Innovate22 4 роки тому
The Alton Brown of software engineering nailed this presentation 👏👏👏
@janicknorman9396
@janicknorman9396 7 років тому
Amazing explanation.
@markmd9
@markmd9 Рік тому
I just realized that on the globe we have more than 2 millions people that have interest in microservice architecture
@CodewithRSV
@CodewithRSV 2 роки тому
This should be mandatory viewing for anyone working in a microservice architecture.
@usun_current5786
@usun_current5786 4 роки тому
This is the most useful presentation I've ever seen regarding large scale platforms. Shared in my org, hopefully we'll lift a lot from here for future extensions.
@antonvedel3028
@antonvedel3028 7 років тому
His analogies to the human body make great sense. Awesome video. Thank you.
@Newtube_Channel
@Newtube_Channel 3 роки тому
They dont.
@somescams
@somescams 3 роки тому
@@Newtube_Channel Exactly.
@madd5
@madd5 3 роки тому
They do. But a regular monolithic application can also be analogous to a living organism.
@SartajHundal
@SartajHundal 6 років тому
Turning Occam's Razor into a lecture. Well done.
@andreelyusef3235
@andreelyusef3235 3 роки тому
We need more of these kind of lectures. Spot on sir please do contribute more.
@cthackers
@cthackers 3 роки тому
"The structure of any system designed by an organization is isomorphic to the structure of the organization." Melving E.Conway
@jidnyasadhavale6664
@jidnyasadhavale6664 4 роки тому
So Informative. Tech talks are the best way to get insight into how huge applications are built, complexities involved, challenges and solutions.
@a0flj0
@a0flj0 3 роки тому
Actually, no. What you get, mostly, from tech talks, is various tech people advertising their pet technology, in a way that appeals to other tech people. If you really want to really get into big systems, find work on one, and do thorough research - tech talks are a good start, but often leave important things out, and only show you the pictures of the car's body, without teaching you to work on the engine. To learn about cars, you go to grease monkey school, not to car shows. The reason for our industry being insanely hype driven is probably at least partially that people expect to actually learn something from tech talks, instead of considering them simple pointers to start research from.
@aceintheblackhole
@aceintheblackhole 9 місяців тому
one of the best talks i've seen at any conference on any subject. i'm actually using it as a real-world resource for my system design interview preparation because it's very informative in many ways (especially for a beginner in distributed systems like me :) ). thank you for making this available!
@ahmadbaiazid976
@ahmadbaiazid976 5 років тому
probably one of the best guides on youtube for microservice arch
@deepsue
@deepsue 2 роки тому
Thanks, this analogy, and learning is still happening and needs to be implemented in multiple applications/organization
@LesterFD
@LesterFD 4 роки тому
copying and learning from nature is always something beautiful. natural sciences like physics, chemistry do it since centuries. It's a good time for computer science to learn from methods, that are applied for many thousands of years.
@JiaxinLiu
@JiaxinLiu 7 років тому
Hystrix is very cool! Thanks for sharing!
@AsimMittal
@AsimMittal 5 років тому
One of the best tech talks period
@the.abhisheksinha
@the.abhisheksinha 3 роки тому
nicely explained .. I wish Netflix gets all such videos on Netflix and show us how do they architect and design their mammoth system
@kibiz0r
@kibiz0r 2 роки тому
AKA: Obfuscating Chaos - A Netflix Guide to Creating Dysfunctional Organizations Basically, a dev noticed: Hey, these two components could benefit from having isolated processes. And a manager said: Wait, could this also be used to stop Team A from complaining about consuming Team B's code? Thoughtful dev replied: Well, it depends on the specific components... Some components are fundamentally coupled, so they can't survive a partition anyway, and introducing one for the sake of team boundaries will just create more technical problems without solving the underlying social problems. Manager blinked twice, and after he rebooted he said: But they'll shut up about each others' code? Dev: I mean, technically. They'll just complain about API contracts instead -- Manager: Perfect. Dev: -- which is arguably worse, because as soon as you have a multistep process or something involving callbacks or dependency injection, you have a huge mess, and that's even if you can sidestep the CAP theorem for all of your use cases, which is a really big assump-- Manager: Yeah, yeah, whatever. So how soon can we do this?
@rogeliomoisescastaneda7396
@rogeliomoisescastaneda7396 7 років тому
Amazing! thanks for sharing
@AnotherDevelopersWorld
@AnotherDevelopersWorld 6 років тому
Amazing talk, would definitely recommend this to anyone
@thaituandat31
@thaituandat31 2 роки тому
I understand that Netflix is not only "NETFLIX" now. Thanks for your team, too. Amazing topic.
@timriley1501
@timriley1501 5 років тому
How can anyone even give a thumbs down to this? Very interesting and informative video.
@ankitsorathiya2304
@ankitsorathiya2304 3 роки тому
Thanks Josh, It was an insightful talk, Thanks for sharing how netflix evolved over period of time.
@ybenihime8757
@ybenihime8757 3 роки тому
Awesome stuff, after watching this in 2020, i got myself thinking what changed in the architecture to this actual year.
@sathvikvutukuri9179
@sathvikvutukuri9179 3 роки тому
The way you explained microservices referring human body is mind blowing. Yes nature is the biggest Wikipedia or GitHub of everything. How much we learn or analyse or extract knowledge decides human evolution.
@himanipku22
@himanipku22 3 роки тому
Thanks for reminding me I don't have to think about breathing.
@lexdemonica
@lexdemonica 2 роки тому
Such valuable insight from an articulate and knowledgeable insider. TYVM
@0011usagi
@0011usagi 7 років тому
Very great talk!
@DeepakSharma_Tao
@DeepakSharma_Tao 6 років тому
Thanks Josh...very nice presentation!
@fredveasley
@fredveasley 6 років тому
Excellent talk! Very informative.
@sexysurd007
@sexysurd007 3 роки тому
Amazing concept, content, communication and presentation...
@justdavebz
@justdavebz 6 років тому
This is gold!
@madixit75
@madixit75 5 років тому
One of the best tech talk👍
@jaikantchandrakumaran3423
@jaikantchandrakumaran3423 3 роки тому
Amazing talk! Great work Josh keep it up.
@island_rhythms
@island_rhythms 7 років тому
Awesome talk! Love it
@DannyLIVEWIRE
@DannyLIVEWIRE 3 роки тому
This was awesome! Thank you Josh!
@OneMinuteNotes
@OneMinuteNotes 3 роки тому
Its one of the best story regarding microservices implementation. Cool
@vivekach1
@vivekach1 5 років тому
Thanks for sharing.. Awesome :)
@stupidaccountlinking
@stupidaccountlinking 2 роки тому
I'm loving the Zuul proxy layer. That's hilarious. A while back I wrote a program that required keys, and I named the keygen tool Zuul. (Also made it play some chiptunes for historical reasons)
@ronfisher4751
@ronfisher4751 3 роки тому
Very good stuff Josh you are a smart man and a great presenter of complex information
@eugeneleroux6140
@eugeneleroux6140 6 років тому
Superb video - thanks!
@andreeadianaratiu5091
@andreeadianaratiu5091 5 років тому
Great presentation and nice analogies.
@Vietnamkid1993
@Vietnamkid1993 4 роки тому
Amazing talk!
@udensijoshua9024
@udensijoshua9024 5 років тому
Awesome delivery. This content is divine
@p3k1n0
@p3k1n0 Рік тому
I could watch an entire season of this stuff. Way better than the standard Netflix products.
@dorcohen3522
@dorcohen3522 2 роки тому
A disclaimer: if you don't have to scale different parts of your application independently, don't bother to go microservice. It won't solve any of your issues. Splitting an inherently coupled monolithic application will turn it into a distributed one, which is worse by any metric. Domains should be loosely coupled with or without microservice architecture. If your monolithic application is modular enough, there should be no problem to deploy it separately whenever needed.
@emmanuelgelatimesa2712
@emmanuelgelatimesa2712 5 років тому
The best presentation ever :)
@pumbo_nv
@pumbo_nv 6 років тому
Wow. That was impressive. He has really interesting job.
@raghavendrakrishnamurthy4041
@raghavendrakrishnamurthy4041 3 роки тому
Awesome presentation!! Top class!
@sribalajirao
@sribalajirao 6 років тому
Awesome post.. really worth viewing..
@jasonamaroreinert4499
@jasonamaroreinert4499 3 роки тому
Great work. I know most of all of this content (whoopdie do I know), have been building microservices (via a standard reverse proxy/load balanced REST API-first architecture) since 2007, and yet this is still an amazing watch and important to keep instilling. That's because knowledge isn't a one-time thing, or a time-oriented thing at all but rather a means to solidifying a way. I love that this content is out there and presented this well because these stories are still happening out there even 15-20 years later!
@prashanth0458
@prashanth0458 3 роки тому
I read the news of netflix introducing own bugs into their own system to make it more efficient long back, today I am watching how it is done. Good video with latest technological stuff like redundancy is good, bugs infection, support for multiple languages, region server failure routing etc..
@OwaisAhmedMuhammad
@OwaisAhmedMuhammad Рік тому
Simple and valueable. A very nice and practical talk on Microservices
@andrewmadge
@andrewmadge Рік тому
Great video! thank you for putting this on youtube
@Larry21924
@Larry21924 2 місяці тому
This is absolute perfection. I recently read a similar book, and it was absolute perfection. "Mastering AWS: A Software Engineers Guide" by Nathan Vale
@pradeeprao822
@pradeeprao822 3 роки тому
Amazing stuff..Thanks for the video :)
@kim-uk1wv
@kim-uk1wv 7 років тому
For shared client libraries. What about requiring each service to make their own wrapper classes/library that only exposes the parts they need. Then, to make it safer against changes, they also create their own unit-tests for their wrapper classes? Or if they use almost the entire client library they could just create their own set of unit-tests for the original library and skip the wrapper. When a shared client library is changed its test runner runs all the different wrapper library unit-tests. Then if anything brakes they can just contact the team responsible for the service owning the broken tests and work out a solution together.
@a0flj0
@a0flj0 3 роки тому
How do you solve API versioning and transitive dependency conflicts in the same library? He explained pretty well what the problems with shared libraries is.
@mingjunduan5916
@mingjunduan5916 7 років тому
Amazing
@deathbombs
@deathbombs 5 років тому
19:40 dodged getting Yahoo'd
@ronaldogeldres1969
@ronaldogeldres1969 5 років тому
Love this video
@conduit242
@conduit242 3 роки тому
"It started out innocently enough with Python..." So many things do...🤣
@igatmatthew2283
@igatmatthew2283 3 роки тому
Innocuously*
@lour.222
@lour.222 3 роки тому
scrapy comes to mind.....
@parthyadav01
@parthyadav01 2 роки тому
@@lour.222 hahaha...
@gbrivate
@gbrivate 7 років тому
Well done.
@chrisalister2297
@chrisalister2297 2 роки тому
Built my system on MS ASP back in 2002. I was already using something more or less like micro-services and using ASPCache(like EVCache). Competitors would have issues/shut downs while mine systems kept trucking along with very little down time. Think of worker ants in colonies. All working towards a common goal.
@luisdmoralesh
@luisdmoralesh 10 днів тому
really good talk still in 2024 if you're new to microservices
@joelsosa5894
@joelsosa5894 7 років тому
Awesome :)
@tobiasfuchs7016
@tobiasfuchs7016 6 років тому
2:33 This visualization so beautiful and mesmerizing, and you immediately get the human body analogy. The whole presentation sure was hard work, and well worth it.
@guseynismayylov1945
@guseynismayylov1945 9 днів тому
it's not accurate though, it shows that microsevices are one directional, which is not true.
@mattcargile
@mattcargile 3 роки тому
Man! I really feel sad watching this like I missed the technology boat to be a part of something incredible! Like my life will never mean as much as this talk.
@letscifucan
@letscifucan 3 роки тому
This Lecture was awesome.
@CornerPocket1
@CornerPocket1 3 роки тому
awesome discussion !
@chungyuwaiki
@chungyuwaiki Рік тому
Great talk and hope i will understand much more years later.
Design Microservice Architectures the Right Way
48:30
InfoQ
Переглядів 704 тис.
Google system design interview: Design Spotify (with ex-Google EM)
42:13
IGotAnOffer: Engineering
Переглядів 927 тис.
The World's Fastest Cleaners
00:35
MrBeast
Переглядів 34 млн
Monolithic vs Microservice Architecture: Which To Use and When?
10:43
Why I Quit Netflix
7:11
ThePrimeagen
Переглядів 471 тис.
How Slack Works
49:54
InfoQ
Переглядів 150 тис.
Managing Data in Microservices
52:07
InfoQ
Переглядів 141 тис.
Microservices explained - the What, Why and How?
18:30
TechWorld with Nana
Переглядів 771 тис.
Martin Fowler  -  Microservices
24:56
Thoughtworks
Переглядів 211 тис.
The Thing No One Tells You About Microservices
13:40
Continuous Delivery
Переглядів 54 тис.
Распаковка айфона под водой!💦(🎥: @saken_kagarov on IG)
0:20
Взрывная История
Переглядів 9 млн
Changing Replace And Edit Backgrounds New Tech || Photo Eedit NEW3X
0:50
Я Создал Новый Айфон!
0:59
FLV
Переглядів 323 тис.
Vortex Cannon vs Drone
20:44
Mark Rober
Переглядів 11 млн
Result of the portable iPhone electrical machine #hacks
1:01
KevKevKiwi
Переглядів 3,5 млн
Що покаже Apple, гнучкі айфони та Windows переходить на ARM
17:49
Ноталка Шелягіна
Переглядів 35 тис.