Why most TCP servers are multi threaded and how to build one from scratch

  Переглядів 26,788

Arpit Bhayani

Arpit Bhayani

День тому

System Design for Beginners: arpitbhayani.me/sys-design
System Design for Experienced Engineers: arpitbhayani.me/masterclass
Redis Internals: arpitbhayani.me/redis
Build Your Own Redis / DNS / BitTorrent / SQLite - with CodeCrafters.
Sign up and get 40% off - app.codecrafters.io/join?via=...
In this video, I explained the process of building a TCP server from scratch using raw sockets. I demonstrated how to set up a server to listen to a specific port, accept client connections, read requests, process them, write responses, and close connections. However, the server could only handle one request at a time due to its single-threaded nature. I highlighted the importance of understanding system calls, socket programming, and handling multiple requests concurrently. The video emphasized the need for efficient coding to manage simultaneous client requests effectively.
Recommended videos and playlists
If you liked this video, you will find the following videos and playlists helpful
System Design: • PostgreSQL connection ...
Designing Microservices: • Advantages of adopting...
Database Engineering: • How nested loop, hash,...
Concurrency In-depth: • How to write efficient...
Research paper dissections: • The Google File System...
Outage Dissections: • Dissecting GitHub Outa...
Hash Table Internals: • Internal Structure of ...
Bittorrent Internals: • Introduction to BitTor...
Things you will find amusing
Knowledge Base: arpitbhayani.me/knowledge-base
Bookshelf: arpitbhayani.me/bookshelf
Papershelf: arpitbhayani.me/papershelf
Other socials
I keep writing and sharing my practical experience and learnings every day, so if you resonate then follow along. I keep it no fluff.
LinkedIn: / arpitbhayani
Twitter: / arpit_bhayani
Weekly Newsletter: arpit.substack.com
Thank you for watching and supporting! it means a ton.

КОМЕНТАРІ: 83
@mitulvaghela906
@mitulvaghela906 Рік тому
One of the best 28 minutes invested. Thanks Arpit!
@SamarthKansalsammy
@SamarthKansalsammy Рік тому
Damn, how can someone demystify the concept of "writing your own", which sounds quite scary, so beautifully. While watching this video i was glued to my computer screen. Thanks Arpit
@uditsankhadasariya5718
@uditsankhadasariya5718 Рік тому
Hey Arpit, I've been following your channel for a while now and I've seen all your videos on system design and related concepts - I'm a huge fan! This video on building a TCP server is just amazing, and I love how it shows the practical side of things. It's so helpful to see real-world examples like this. I'd be thrilled if you could continue creating more content in this style. Keep up the fantastic work, and thanks for sharing your expertise with all of us! 🙌👩‍💻🚀
@jayjay7333
@jayjay7333 Рік тому
Love your content. May you never stop these quality videos.
@krsingh.shubham
@krsingh.shubham Місяць тому
I always had this curiosity in the head that how multiple connections are handled in prod but kept procrastinating untill today i watched this and went into dissecting them.
@lakshayasood2197
@lakshayasood2197 Рік тому
this channel is a goldmine, how come i did not find it earlier. new saw anyone explaining TCP like this. Buonissimo!
@arbazadam3407
@arbazadam3407 7 місяців тому
This one is gold. You have done a wonderful job to explain this. 💯
@ujjawal_
@ujjawal_ Рік тому
amazing video, please make these types of videos with practical implementation 🎉
@devashishrai1964
@devashishrai1964 Рік тому
Thanks arpit this video is amazing. I kind of had an idea that spring or any framework does this but this video increased my clarity.
@nawazishkhan46
@nawazishkhan46 Рік тому
Beautiful video, keep them coming
@santoshkpatro11
@santoshkpatro11 Рік тому
This is gold 🎉.. Pure engineering
@MegaSurya1992
@MegaSurya1992 Рік тому
I have never really thought, infinite for loop or loop is a valid usecase without knowing that every single day I am using it in interacting with each and every web server. Wonderful video... felt like my weekend was productive by watching this video, Thanks.
@deepakkothari2850
@deepakkothari2850 Рік тому
This was quite informative and very well explained.
@yashashav_dk3766
@yashashav_dk3766 Рік тому
We need more folks like you!
@8kumarssk
@8kumarssk Рік тому
Arpit, Its a great and informative video. Really appreciate your efforts. It would have been good if you have included what is socket in tcp connection.
@dishantvashistha2038
@dishantvashistha2038 3 місяці тому
Hey, Arpit . Amazing Explanation and description 🔥.
@imamansoni
@imamansoni 3 місяці тому
Loved the explanation ❤. So simple amazing, Thanks
@jayaramans7398
@jayaramans7398 Рік тому
Thanks for detailed explanation. It will be helpful to share some sample web server on how they handle this
@AleksandarT10
@AleksandarT10 Рік тому
Great video, everyone should watch and should be aware of how multi threaded TCP web servers work
@viktoreidrien7110
@viktoreidrien7110 Рік тому
hey man, great teacher i must say! superb video. thanks!!
@varunpalsingh3822
@varunpalsingh3822 Місяць тому
Great explanation Arpit 🎉
@YashKhareDev
@YashKhareDev 5 днів тому
Best 28 Minutes spent on UKposts learning something! Thank you for such valuable content 🎉
@AsliEngineering
@AsliEngineering 3 дні тому
Thank you Yash!
@vikramragunathan6392
@vikramragunathan6392 Рік тому
Very well explained. 👌
@ayushtripathi4514
@ayushtripathi4514 9 місяців тому
omg!! it was just mindblowing
@debashisdeb472
@debashisdeb472 Рік тому
This thing had intrigued me around 6 years back and I went ahead and implemented both single and multi threaded TCP sockets in Java :D
@daegu_1
@daegu_1 3 місяці тому
TIME TO REWRITE IT IN RUST !!!!
@debashisdeb472
@debashisdeb472 3 місяці тому
@@daegu_1 concepts are the same, so I don't think it will benefit me :)
@daegu_1
@daegu_1 3 місяці тому
@@debashisdeb472 hahah yea
@nihshrey
@nihshrey Місяць тому
What an amazing teacher you're, never enjoyed learning more. Extraordinarily simplified.
@AsliEngineering
@AsliEngineering Місяць тому
Thank you @nihshrey!
@sudhakarkamanboina
@sudhakarkamanboina 10 місяців тому
Very well explained
@vivekbhore5722
@vivekbhore5722 Рік тому
pure quality content
@keshavb2896
@keshavb2896 Рік тому
Amazing video as always!! , Can you please create a video on share nothing architecture like seastar framework...thanks a ton
@hemsagarpatel8992
@hemsagarpatel8992 8 місяців тому
awsome video, got to know the internals of a webservers Thanks
@aqilaghamirzayev8189
@aqilaghamirzayev8189 3 місяці тому
Thank you. Can you please make the same video for the reactive web server?
@shishirchaurasiya7374
@shishirchaurasiya7374 8 місяців тому
Arpit sir just a small doubt I have here is that as if you are saying that the code is single threaded server, because of which multiple requests are not able to process at the same time they are waiting for 1 process to complete, my question is these process which has been started, as they are waiting you mentioned but there is no such queue in which they can store, so how currently these values which are not yet executed are getting stored basically their internal workings I am concerned about, if there is no data structure used then why the process is not leading to crash of the applications or Is GO Language is handling these internal working ?
@TheNayanava
@TheNayanava Рік тому
awesome video!! I was expecting you to talk about I/O multiplexing as well when you were talking about multi-threaded servers, and indeed you did in the 24th minute!!
@AsliEngineering
@AsliEngineering Рік тому
yeah. IO Multiplexing is great; it just minimises synchronization and threading overheads. Unfortunately could not go in depth of implementation, given I cover it in my Redis course. Had to draw the line. Glad you still found the video interesting :)
@TheNayanava
@TheNayanava Рік тому
@@AsliEngineering loved it!!! 👏👏 actually I was aware of I/O multiplexing when we used RedisStackExchange library in one of the projects.. but after watching your video, I really did a deeper dive to understand how things work under the hood!
@AsliEngineering
@AsliEngineering Рік тому
@@TheNayanava engineering curiosity for the win 🙌
@TheNayanava
@TheNayanava Рік тому
@@AsliEngineering your videos are the second best thing on youtube after Hussein Nasser's videos. Not comparing, just putting in chronological order. 😁😁
@AsliEngineering
@AsliEngineering Рік тому
@@TheNayanava Hussein is next level. I really wish I could go as deep as him. He actually pointed into Postgres source code. That's commendable, given how complex the codebase is.
@devpratap
@devpratap 11 місяців тому
Great video! Also how are you using handwritten notes in obsidian if I’m right?
@kchaitanya39
@kchaitanya39 6 місяців тому
Maza aa gaya bhai
@vikrantverma7493
@vikrantverma7493 5 місяців тому
There are very less useful videos on GoLang. I have started following you one month back and I can see how engineer should have thinking process. Also I am DevOps engineer and started learing golang just for my interest. Thank you for this video. Keep it up.
@J0Y22
@J0Y22 3 місяці тому
great video
@somnathroy102
@somnathroy102 5 місяців тому
This is so freaking cool
@gurupreetsingh8347
@gurupreetsingh8347 Рік тому
Hey really good explanation, bro yeh servers ke internal source code milte kahan se hai ? Which site or content you prefer?
@tejasarlimatti8420
@tejasarlimatti8420 Рік тому
bhai legend hai tu
@ujjwalgupta3445
@ujjwalgupta3445 8 місяців тому
Wow!!
@anshkumargarhewal8582
@anshkumargarhewal8582 Рік тому
Hello Bhaiya love this content, btw can you please make one video on OSI model, Please 🥺
@jainamshah3691
@jainamshah3691 8 місяців тому
Hii Arpitbhai, Understood how multi threaded web server works. Still I have one doubt how listen and accept works. Like lets say we invoked the listen on some particular port how the process is listening like how it actually listens internally that as soon as client connects it accepts the request and how read write actually works. I know the concept of pipe but as far as I know its for local processes only. I hope you got my doubt.. Thanks for the nice explanation.
@abhishekvrshny
@abhishekvrshny Рік тому
Nginx is not multithreaded. It is multi-process (1 process per core) and uses asynchronous I/O (with epoll) where a single process can accept and process multiple connections and requests.
@AsliEngineering
@AsliEngineering Рік тому
Ohhh. Thanks for correcting. I knew Redis did it, but Nginx was new. Thanks a ton. Really appreciate it.
@kritibindra4232
@kritibindra4232 10 місяців тому
Hey Arpit, awesome video that explains the working of a server. Just curios to know 1 thing. In your example from the client side you made 2 requests almost simultaneously and while 1 connection got accepted, what actually happens to the other client request till the server is busy? Since it kept on waiting for the server to get freed up…do we have some queue that keeps track of all requests that has been made to the port? Or internally do we keep on trying from the client side till some TTL window where if it gets crossed the client will close the conn from its side saying server took too long to respond or something like that?
@bishwashpokhrel8779
@bishwashpokhrel8779 8 місяців тому
Thats what backlog queues are for, on starting a socket connection you can determine how many connections can wait in the backlog. I think when the queue is full the connections are simply discarded.
@AmberKbz
@AmberKbz Рік тому
Hey Aprit, amazing videos, i have started watching your videos recently. Just a suggestion as a viewer, could you declutter notes that you use for teaching, only diagrams and one words are enough, you are already explaning everything on top of it. It feels redundant information on the notes and blocks the important information if you would have written.
@raviprakashbajpai196
@raviprakashbajpai196 7 місяців тому
How many connections a server can handle concurrently? I guess conn object return by listener.accept will be different for each curl request ? or that conn object is a shared resource between threads.
@rohitagarwal4731
@rohitagarwal4731 2 місяці тому
bhaiya if i want to include a multithreaded web server project in my resume , and want a live link like other projects , how can i deploy it ?
@siddharthsingh7281
@siddharthsingh7281 Рік тому
More like this I did this first time but one question since node is single threaded how does it handle such connections?
@siddhantchavan1370
@siddhantchavan1370 9 місяців тому
node isnt single threaded, it has internal worker threads. Read libuv library for more info!!
@codecuptips
@codecuptips 3 місяці тому
Can I achieve this with nodes
@ashiktm5631
@ashiktm5631 8 місяців тому
In nodejs express also same thing happens right?
@AsliEngineering
@AsliEngineering 7 місяців тому
No. that's async io.
@foobar69
@foobar69 Рік тому
masiha h re tum bro... ek request h bro, kyoki maine kabhi kaam nhi Kiya h distributed systems me to kind of imposter wala feeling aata hai apply karne me. thoda kuch bta do bro k ek project agar scratch se banate ho to kya expected hota h ek 5-6 yr experienced bande se. please 🙏🙏 8
@sarveshwarsinghal5916
@sarveshwarsinghal5916 10 місяців тому
Hi, how consistency is maintained across multiple threads? assume we've written a class that has a static counter which gets increased after every call. In a single threaded scenario the value of counter would remain consistent after n calls are made. But how can we make sure this is followed in multi-threaded servers? Assume the code you've written has a global counter variable and this variable gets increased in the 'do' function. Now in multi-threaded environment how we can make sure that the state of counter is correct after n parallel calls are made.
@AsliEngineering
@AsliEngineering 10 місяців тому
Optimistic locking, pessimistic locking, and atomic updates.
@sarveshwarsinghal5916
@sarveshwarsinghal5916 10 місяців тому
@@AsliEngineering okay. How is this implemented in production? Let's say I've spring boot local server, and there's a static variable in a different class that I want to a update. I've a REST controller exposed via get/post. Now in my local I'm not creating multiple threads, spring boot automatically serve multiple requests. So how to apply lock in this scenario, and where to put locking code. Thanks
@AsliEngineering
@AsliEngineering 10 місяців тому
@@sarveshwarsinghal5916 this Friday I will put out a video on it. Already recorded.
@sarveshwarsinghal5916
@sarveshwarsinghal5916 10 місяців тому
@@AsliEngineering thanks. Also could you recommend any good engineering blog or article related to this.
@yogeshsherawat
@yogeshsherawat Рік тому
If number of concurrent requests are more than the number of threads present in thread pool, then the extra requests will have increased response time or the request would get dropped?
@AsliEngineering
@AsliEngineering Рік тому
queued and then dopped
@alphacoder3822
@alphacoder3822 9 місяців тому
Engineering is buetyful
@abhijitkrao283
@abhijitkrao283 Рік тому
What's your development environment and laptop type?
@AsliEngineering
@AsliEngineering Рік тому
Laptop: Lenovo Ideapad 8 GB RAM AMD Processor. IDE is plain and simple VS Code. Nothing fancy.
@myslates2854
@myslates2854 Рік тому
@@AsliEngineering Which VI plugin's you use, as the one by default in VScode is very sluggish. Do you have any cheatsheet for the VI which you use frequently.
@Lokeshsanapalli1729
@Lokeshsanapalli1729 6 місяців тому
I opened the video to see the implementation of multi-threaded tcp server and the challenges of it. But, what implemented here is just a TCP server 😢
@AsliEngineering
@AsliEngineering 6 місяців тому
What I implemented is a multi-threaded TCP server. So long as challenges are concerned, they are exactly what you'd face when you have multiple threads - synchronization.
@salman0ansari
@salman0ansari 8 місяців тому
4:05 😂
@AsliEngineering
@AsliEngineering 8 місяців тому
Unfiltered me 🙈
@codecuptips
@codecuptips 3 місяці тому
You made it asynchronous..
How to write efficient and fair multi-threaded programs?
19:26
Arpit Bhayani
Переглядів 23 тис.
🌐 Network Programming in Rust - Building a TCP Server
21:55
Bek Brace
Переглядів 10 тис.
Get a knife! | Standoff 2
01:06
Standoff 2 Live
Переглядів 1,5 млн
Этого От Него Никто Не Ожидал 😂
00:19
Глеб Рандалайнен
Переглядів 10 млн
What happens when you type a URL into your browser?
11:08
Arpit Bhayani
Переглядів 17 тис.
How to decide which technology to learn and invest time in?
19:04
Arpit Bhayani
Переглядів 22 тис.
What is a Protocol? (Deepdive)
18:14
LiveOverflow
Переглядів 152 тис.
Razorpay's Journey to Microservices w/ Arjun | Ep 1
49:48
Arpit Bhayani
Переглядів 50 тис.
If I were to learn a new programming language
9:26
Arpit Bhayani
Переглядів 20 тис.
Peeking into assembly code to understand why count++ is not atomic
14:12
PROOF JavaScript is a Multi-Threaded language
8:21
Beyond Fireship
Переглядів 257 тис.
Google system design interview: Design Spotify (with ex-Google EM)
42:13
IGotAnOffer: Engineering
Переглядів 947 тис.
🤯Самая КРУТАЯ Функция #shorts
0:58
YOLODROID
Переглядів 3,2 млн
How much charging is in your phone right now? 📱➡️ 🔋VS 🪫
0:11
Airpods’un Gizli Özelliği mi var?
0:14
Safak Novruz
Переглядів 2,1 млн