Chasing Silicon: The Race for GPUs

  Переглядів 6,873

a16z

a16z

День тому

With the world constantly generating more data, unlocking the full potential of AI means a constant need for faster and more resilient hardware.
In this episode - the second in our three-part series - we explore the challenges for founders trying to build AI companies. We dive into the delta between supply and demand, whether to own or rent, where moats can be found, and even where open source comes into play.
Look out for the rest of our series, where we dive into terminology and technology that is the backbone of the AI, how much the cost of compute truly costs!
Topics Covered:
00:00 - Supply and demand
03:03 - Competition for AI hardware
04:46 - Who gets access to the supply available
06:28 - How to select which hardware to use
08:59 - Cloud versus bringing infrastructure in house
13:26- What role does open source play?
16:48 - Cheaper and decentralized compute
20:16- Rebuilding the stack
21:31- Upcoming episodes on cost of compute
Resources:
Find Guido on LinkedIn: / appenz
Find Guido on Twitter: / appenz
Find a16z on Twitter: / a16z
Find a16z on LinkedIn: / a16z
Subscribe on your favorite podcast app: a16z.simplecast.com/
Follow our host: / stephsmithio
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

КОМЕНТАРІ: 24
@a16z
@a16z 8 місяців тому
Topics Covered: 00:00 - Supply and demand 03:03 - Competition for AI hardware 04:46 - Who gets access to the supply available 06:28 - How to select which hardware to use 08:59 - Cloud versus bringing infrastructure in house 13:26- What role does open source play? 16:48 - Cheaper and decentralized compute 20:16- Rebuilding the stack 21:31- Upcoming episodes on cost of compute
@tyc00n
@tyc00n 8 місяців тому
music in the background is silly because people watch these at 2x speed and it sounds terrible and distracting 😄
@Hypotemused
@Hypotemused 8 місяців тому
Agreed. We come to listen to the speakers. Why this crappy psytrance behind?
@fintech1378
@fintech1378 8 місяців тому
its actually AI generated
@tschorsch
@tschorsch 10 днів тому
​@@fintech1378 It's still annoying.
@zuggrr
@zuggrr 8 місяців тому
20:40 it's crazy that it's kinda what Alan Turing said in "computer machinery and intelligence". What a boss
@3ool0ne
@3ool0ne 8 місяців тому
Good job so far on this series. Really looking for the next episode that explores the actual cost. Will likely help many founders’ with their ‘ask’ slides. Might not help since complex inferencing will be needed for next gen AI platforms.
@ashwinkandath1439
@ashwinkandath1439 7 місяців тому
amazing content! it is a fun race to watch and see how the supply chain evolves
@chrislatorres
@chrislatorres 8 місяців тому
Thanks Steph, this is really next level content!
@lnebres
@lnebres 7 місяців тому
This is amazingly informative. Thanks for giving Guido this platform to share his experience!
@gileneusz
@gileneusz 7 місяців тому
17:12 well, this is the measure how quickly things are evolving, now we have Falcon 180B
@user-km5pm2fb2d
@user-km5pm2fb2d 8 місяців тому
Great job explains the situation with GPUs
@fintech1378
@fintech1378 8 місяців тому
fantastic podcast
@a16z
@a16z 8 місяців тому
Catch Part 1 of the mini-series here: ukposts.info/have/v-deo/ZaOQiZ9soWZ41qs.html
@jdevoz
@jdevoz 2 місяці тому
There is a finite amount of fab house capacity, gets eaten up by big companies like Apple, etc. Can’t bring new fabs online quickly, etc. Haven’t seen any projections on how this might slow AI rollouts and work its way back to throttling the growth (and share prices) of companies like Nvidia. Next, this opens the door to competitors, gives them more time to catch up, etc.
@Ficjonis
@Ficjonis 7 місяців тому
Semis really seem like new oil, they are crucial for anything related to new technologies.
@Hypotemused
@Hypotemused 8 місяців тому
@a16z - when is part 3 being released?
@a16z
@a16z 8 місяців тому
This week!
@Hypotemused
@Hypotemused 8 місяців тому
@@a16z⏳
@shangonghowe
@shangonghowe 7 місяців тому
Oh noise! 😮
@khmf1
@khmf1 6 місяців тому
How about the race for DPUs and QPUs ...GPUs are getting old man.... ever since last year and the Ethereum Switch over to Proof of Steak
@tschorsch
@tschorsch 10 днів тому
Tone down the absurdly annoying music.
The True Cost of Compute
15:29
a16z
Переглядів 5 тис.
AI’s Hardware Problem
16:47
Asianometry
Переглядів 611 тис.
Kitten has a slime in her diaper?! 🙀 #cat #kitten #cute
00:28
ISSEI funny story😂😂😂Strange World | Magic Lips💋
00:36
ISSEI / いっせい
Переглядів 48 млн
КТО СМОГ ПОБЕДИТЬ?😳
00:36
МЯТНАЯ ФАНТА
Переглядів 763 тис.
AI Hardware w/ Jim Keller
33:29
Tenstorrent
Переглядів 23 тис.
What Is an AI Anyway? | Mustafa Suleyman | TED
22:02
TED
Переглядів 657 тис.
Growth vs Efficiency: Can You Have Both?
49:22
a16z
Переглядів 4,8 тис.
What runs ChatGPT? Inside Microsoft's AI supercomputer | Featuring Mark Russinovich
16:28
AI Will Save The World with Marc Andreessen and Martin Casado
1:13:56
Deep-dive into the AI Hardware of ChatGPT
20:15
High Yield
Переглядів 310 тис.
🤏 САМЫЙ ТОНКИЙ гаджет #Apple! 🍏
0:29
Яблочный Маньяк
Переглядів 264 тис.
Какой телефон лучше всего снимает? 🤯
0:42
Why spend $10.000 on a flashlight when these are $200🗿
0:12
NIGHTOPERATOR
Переглядів 16 млн