System Design for Beginners: arpitbhayani.me/sys-design
System Design for Experienced Engineers: arpitbhayani.me/masterclass
Become a member for exclusive in-depth videos: / arpitbhayani
Redis Internals: arpitbhayani.me/redis
Sharding and partitioning come in very handy when we want to scale our systems. These concepts operate on the database and help us improve the overall throughput and availability of the system.
In this video, we take a detailed look into how a database is scaled and evolved through different stages, what sharding and partitioning are, understand the difference between them, see at which stage should we introduce this complexity, and a few advantages and disadvantages of adopting them.
Outline:
00:00 Introduction and Agenda
03:05 How a database is progressively scaled?
08:10 Scaling beyond the limit of vertical scaling
11:57 Sharding vs Partitioning
12:43 Example of Data Partitioning
17:15 Sharding and Partitioning together
20:20 Advantages and Disadvantages of Sharding and Partitioning
Arpit's System Design Masterclass
I teach a course on System Design where you'll learn how to intuitively design scalable systems. The course will help you
- become a better engineer
- ace your technical discussions
- get you acquainted with a massive spectrum of topics ranging from Storage Engines, High-throughput systems, to super-clever algorithms behind them.
I have compressed my ~10 years of work experience into this course, and aim to accelerate your engineering growth 100x. To date, the course is trusted by 500+ engineers from 9 different countries and here you can find what they say about the course.
Together, we will build some of the most amazing systems and dissect them to understand the intricate details. You can find the week-by-week curriculum and topics, benefits, testimonials, and other information here
arpitbhayani.me/masterclass.
Other links
CS Engineering and Software Development books that I have read
arpitbhayani.me/bookshelf
Research papers that I have read
arpitbhayani.me/papershelf
Newsletter: arpit.substack.com
LinkedIn: / arpitbhayani
Twitter: / arpit_bhayani
Things I use to make these videos
Apple iPad Pro 12.9 Inch: amzn.to/3jb4keI
Apple Pencil 2nd Generation: amzn.to/3DJ1Gq8
Boat Airdopes 621: amzn.to/3DIqGO6
GoodNotes Notetaking App: www.goodnotes.com/
Until next time, stay awesome :)
Yours truly,
Arpit
arpitbhayani.me
#AsliEngineering