Building High-Performance RISC-V Cores for Everything
Переглядів 97,171
День томуWei-han Lien is Tenstorrent's Chief RISC-V Architect, and he's been lead designer on chips like Apple's M1. Now he heads up a team building the highest-performance RISC-V cores on the market. Here's why RISC-V is important.
[00:00] x86 vs Arm vs RISC-V
[00:47] RISC-V initial targets
[02:43] Jim part 1
[03:13] Building a CPU Core
[04:34] Tenstorrent's Hardware
[05:48] Wei-han Lien: Arm vs RISC-V
[07:37] Wei-han Lien: 8-wide RISC-V
[09:07] Wei-han Lien: Training vs Inference
[10:10] Tenstorrent's Ascalon...
[11:06] Derivatives for Laptop
[11:31] Wei-han Lien: Chiplets
[13:09] Jim Keller: • [24b] Jim Keller Inter...
[17:46] High Performance at 128 cores!
tenstorrent.com/
The full Wei-han interview will be uploaded soon!
-----------------------
Need POTATO merch? There's a chip for that!
merch.techtechpotato.com
more-moore.com : Sign up to the More Than Moore Newsletter
/ techtechpotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at / iancutress
Follow TechTechPotato on Twitter at / techtechpotato
If you're in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : geni.us/AmazonUS-TTP
Amazon UK : geni.us/AmazonUK-TTP
Amazon CAN : geni.us/AmazonCAN-TTP
Amazon GER : geni.us/AmazonDE-TTP
Amazon Other : geni.us/TTPAmazonOther
Ending music: • An Jone - Night Run Away
-----------------------
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#techtechpotato #riscv #tenstorrent
------------
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Facebook, IBM, Infineon, Intel, Lattice Semi, Linode, MediaTek, NordPass, ProteanTecs, Qualcomm, SiFive, Tenstorrent.
@marsovac Рік тому
The first optimization Tenstorrent should do is to put sound panels in their meeting room to minimize echo.
@peterfireflylund Рік тому
Or Keller has to learn to put the mike on instead of leaving it on the table.
@Karthig1987 Рік тому
@@peterfireflylund Yes this lol
@prgnify Рік тому
Or Ian could learn to use some of the voice generation AIs to replicate Keller's voice and use it to "denoise" the audio. Denoise under quotation marks because he would be replacing the signal, and not treating it
@TechTechPotato Рік тому
@@prgnify I've already been using those tools. I even used them in part of this video for my own voice, and no-one has picked up on it. I've even fooled my own family
@prgnify Рік тому
@@TechTechPotato They truly are amazing!
@garrettkajmowicz Рік тому
I would love to see a deep dive into the architecture of the chip, and why the particular decisions were made.
@chetana9802 Рік тому
YES
@marcosviniciusrodriguescos8118 Рік тому
Its a wide chip, like apple silicon
@marcosviniciusrodriguescos8118 Рік тому
8 wide decoder
@Luredreier Рік тому
Yeah, I'm wondering about that as well.
@xerzy Рік тому
@@backacheache are you referring to RISC-V as an ISA? afaik the implementation of these cores are not open source themselves
@dylanl5793 Рік тому
I usually don’t make comments under UKposts clips, but please do feed us more contents like this one… very interesting episode, and would love to learn more!
@CjqNslXUcM Рік тому
Jim Keller is always insightful.
@ioinfinity Рік тому
*\(^___^)/* 🐼
@DEtchells Рік тому
+1 for the micro architecture deep dive from me also. Most interesting point: AI is going to write software that’s different from what humans write. That’s a pretty profound insight and was something I hadn’t thought of before. (Also “C has no loss function” 😁)
@paulw3182 Рік тому
Since your here, I assume your aware > " Software that is different from what humans write " is the basis behind Elon Musk's open letter to pause development of ChatGPT-4. That AGI, Artificial General Intelligence "proposed" ability to write code that was beyond our grasp. While probable, its a deceptive half-truth based upon the work of technologist and futurist Ray Kurzweil's concept of autonomous computing called the Singularity. Once the Turing Test threshold is passed intelligent systems will create new versions of "themselves" In reality, we could benefit from annotated assembly, or a new machine language that could break speed records, efficient and compact - but it better have solid, concise commenting :)
@ioinfinity Рік тому
*\(^___^)/* 🐒
@ioinfinity Рік тому
*\(^___^)/* 🐴
@conorstewart2214 Рік тому
There is a good chance they can’t do a deep dive. I don’t think sifive cores are open source hence the license may prevent them from talking about it too much and as for the changes they have made or their own designs that are attached then they might not want to talk too much about it in case someone copies it.
@wyattarich Рік тому
I absolutely want more!! This is content you can't find ANYWHERE ELSE! Let alone with such fantastic talking points. I get more excited through these videos than a marketing team could ever make me. The practical business applications for this are absolutely bonkers!
@ioinfinity Рік тому
*\(^___^)/* 🐼
@ioinfinity Рік тому
*\(^___^)/* 🦒
@rb8049 Рік тому
Feel free to interview Jim more. If only more people think like him.
@another3997 Рік тому
Lots of people think like him. Most come up with a "good idea" in theory and find it's not practical in reality. Sometimes people come up with great solutions to questions nobody is asking. There are thousands of "the next big thing" startups that have come and gone, whilst very few succeed and come to full fruition. Even the big names in the industry get it wrong, Intel's Itanium and P4 Netburst architecture for example. Only time will tell if this is the way forward.
@ioinfinity Рік тому
*\(^___^)/* :😺
@Hreimr Рік тому
Very cool to see more information about Risc-V, I am definitely interested in seeing more about it :)
@maxmustsleep Рік тому
Awesome video! I'd love to see more on RISC-V
@happydawg2663 Рік тому
This is very exciting, another golden interview, deeper dive please! :)
@sinakarimi798 Рік тому
Deep dive into architecture of the chip sounds wonderful!
@ioinfinity Рік тому
*\(^___^)/* 🐀
@UliTroyo 8 місяців тому
I laughed at the "auditable code" bit. "Most of whom no longer work for your company!" Jim is so right.
@kelownatechkid Рік тому
Absolutely knocking it out of the park. Thank you for your work!
@SBA_poiko Рік тому
Yes please to the deep dive!
@lahma69 Рік тому
Brilliant content. Must feel good to be given some camera time with the CEO. Congrats!
@ioinfinity Рік тому
*\(^___^)/* 🐧
@nexgen-3d-printing Рік тому
Love what their doing, will be interesting to see where they go, but we really need to get more low cost RISC5 SBC's into the DIY and Startup DEV world as this can be a driving force for performance increase and to push the platform into the mainstream, leveraging the opensource community to adapt current software to natively support RISC5 can only help.
@Cineenvenordquist Рік тому
What are they doing? You know k8s for AI training/operation/experiment good enough to call out a set of O'Reilly books, say? Is there an OS already? I mean, if that laptop thought about being closer to $35 than it is to $44,000 (dual Epyc 6 screen laptop) I would like that (but one split is at $22k and that's...will I not want housing anymore in 2025?)
@ioinfinity Рік тому
*\(^___^)/* 😄
@mnomadvfx 6 місяців тому
I can live without low cost as long as they are performant and smol at the same time. The best we can get on the ARM side of SBCs is A76 which was announced in 2018, making it a full 5 generations of core design out of date. Even just a jump to Cortex X1/Neoverse V1 level performance would be a big leap, and while SiFive's latest P870 core would match this there are no such SoC designs using it on the horizon.
@salehjamali8752 7 місяців тому
Enjoyed the video
@treyquattro Рік тому
definitely would love to see a deeper dive on the uArch, pls
@jobautomation 6 місяців тому
Super interesting content!! Thank you!!!
@anonymouscommentator Рік тому
10:42 yes please! i would love to see the core explained in detail!
@futureautomation9518 11 місяців тому
Appreciate for introducing this company, i really want to know more about other companies working on the AI Accelerators, thanks for the video.
@skinklizard Рік тому
Best episode so far, the singularity is neigh. Moore please. Giddy up!
@user-lm1bn9fj8z Рік тому
yes; info on the microarchitecture - and especially the thinking that made the decisions in the micro arch - would be welcome.
@scottfranco1962 Рік тому
So the key to these different RISC-V designs would be a good test suite and a certification process.
@stephanematis Рік тому
More. Yes. Please.
@bikemmm6167 Рік тому
Great video , 🎉❤
@TheDudeWithSome409 Рік тому
I love the audio quality in the interview When I close my eyes, I really believe this interview took place in a cave!
@clarkd1955 Рік тому
Jim is one of the smartest, sad guy I have ever listened to. Thank you so much for this video. I loved Jim’s rebuttal to the AI, black box problem (AI decisions are not auditable).
@neuroflare Рік тому
Tents to Rent was what I was reading
@MrCommunistGen Рік тому
8-wide RISC-V seems like it means serious business. I remember when Apple started building their own custom cores that they were surprisingly wide -- wider than even the latest desktop chips at the time. That seems to have done well for them. Is there a table somewhere where we can reference/compare the instruction-width of various modern CPU architectures? I feel like an outdated table exists on Anandtech somewhere but I can't seem to find it. I'd love to see how old and new architectures compare in width.
@noergelstein Рік тому
Afaik Alderlake was the first x86 Architecture with a 6-wide decoder and AMD is 4-wide up to and including Zen 4. That doesn‘t mean they are limited to that number of instructions per cycle though, as the instruction microcache may be wider.
@ioinfinity Рік тому
*\(^___^)/* 🐹
@ioinfinity Рік тому
*\(^___^)/* 🐖
@davisilm1863 7 місяців тому
@@noergelstein No, all instructions must be decoded first regardless of if they are accessed from the icache or elsewhere. IPC can not exceed decode width
@user-mj3gi6zf7i Рік тому
Very good video! I want to know more about RISK-5 and Tenstorrent work.
@another3997 Рік тому
RISC V, not RISK 5. 😉
@ioinfinity Рік тому
*\(^___^)/* 🐴
@RonWSzpak Рік тому
Jim Keller and team solve problems and challenges that move the semiconductor, firmware, compiler, software, server systems future forward at an accelerated rate! Fantastic interviews, insights and roadmap. Thank you TechTechPotato for your diligent efforts. Would be interested in Tenstorrent plans on leveraging Co-Packaged Optics. (i.e. Ranovus, Poet Technologies). Something tells me Portable, Mobile, Distributed Cloud Infrastructure is about to become a reality! Distributed microClouds/nanoClouds will be a hoot!! Such a boon for future Automotive EV Ecosystems that have to derive revenue and profit from innovative cloud products and services. Good times are coming! Insanity ensues! Ha!!
@edgeeffect Рік тому
With all the echo in that office and Jim Keller's tone of voice make the interview segments next to incomprehensible.
@Hybrid.Robotics Рік тому
I would also very much like to see a deep dive into how these new chips and how they might be leveraged for robotics.
@vintagekyoshodotcom 5 місяців тому
RISC-V is gaining so much momentum it's crazy! So excited!
@jannegrey593 Рік тому
yes for deep dive. Also More Jim Keller is like More cores - always good ;)
@ioinfinity Рік тому
*\(^___^)/* 😄
@JasonPlayne Рік тому
It'll be interesting to see the power envelope that these different core designs run in. Also curious in the performance of the cores - though I doubt we will be running vanilla Linux on it :D
@Luredreier Рік тому
Well, you can run Linux on RISC V today, so it would probably run on this too, even if it probably wouldn't be able to utilize any of the closed source IP in it...
@JasonPlayne Рік тому
@@Luredreier you sure can. it doesn't look like it has storage on it (past firmware) so you probably won't be running Ubuntu or fedora is more what I meant
@ioinfinity Рік тому
*\(^___^)/* 😃
@linx1970 Рік тому
Ascalon analysis pretty please ❤
@freakinccdevilleiv380 Рік тому
Awesome I'd like to see a chat between Jim Keller and Jeff Hawkings 🤯
@knofi7052 Рік тому
LOL, Jim made me lough when talking about the blue screens of Windows! 😊
@ioinfinity Рік тому
*\(^___^)/* 😄
@leteethgirl8778 Рік тому
he right about auditing in projects of that scale
@youtubeaccount931 Рік тому
Very cool
@petehall1900 Рік тому
Yes more hardware deep explanation
@KomradZX1989 Рік тому
I really love all your videos. I'm no where CLOSE to being as smart as you, but the way you talk and present things sure makes me feel smart 😂. Is YT your full time job or do you do things with chip makers?
@TechTechPotato Рік тому
There's a video for that! ukposts.info/have/v-deo/nKR4bX9qpJCdq6M.html
@ioinfinity Рік тому
*\(^___^)/* 🐹
@ioinfinity Рік тому
*\(^___^)/* 🐘
@KomradZX1989 Рік тому
@@TechTechPotato haha thanks! 👍
@j340_official Рік тому
Excellent video. Thank for the content and I wish Jim and his company success in ramping risc-v designs and bringing them to market. When you mention they have laptop designs, are they windows laptop designs or some other OS? Finally, Santa Clara, isn’t that where intel is? So Jim is just down the street eh?
@TechTechPotato Рік тому
Almost everyone has a Santa Clara office. But on laptop designs, probably not Windows, but a Chromebook or Linux most likely.
@j340_official Рік тому
@@TechTechPotato I figured that it would be Linux-based as my understanding was that windows didn’t have a risc-v port. I wish them success. Good to see Jim do good things.
@ioinfinity Рік тому
*\(^___^)/* 🐰
@ioinfinity Рік тому
*\(^___^)/* 🐁
@justindressler5992 Рік тому
After the tech restrictions with China I expect RISC-V will grow in leaps and bounds especially in China. They have GNU toolchain and can run Linux. From a security point of view RISC-V on Linux from multinationals will be better than using US controlled tech. I personally like the idea of a third instruction set in mainstream not controlled by US. This will improve competition and innovation. The x86 instruction set and extensions have barely changed in 10 years and even ARM is mostly just modifications to old instruction sets apart from the 64 bit extensions. RISC-V ISC already supports 64 bit. But this AI acceleration looks vary exciting I will keep an eye on this company may become a NVidia competitor in the future.
@ioinfinity Рік тому
*\(^___^)/* 🐕
@ioinfinity Рік тому
*\(^___^)/* 🐒
@PlanetFrosty Рік тому
I’m extremely interested in the architecture of the chip along with more of the design philosophy. I very specific applications in mind.
@ioinfinity Рік тому
*\(^___^)/* 🐕
@esra_erimez Рік тому
It appears that there is a manufacturer focused on all market segments from IoT, phones, laptop, desktop servers and DPUs. These are exciting times.
@ioinfinity Рік тому
*\(^___^)/* 🐕
@The_Orchestrator_of_Chaos Рік тому
Looks promising
@jasonstash2562 Рік тому
Deep dive into the core IP! Pls
@jonahy-m2099 Рік тому
More Uarch details would be much appreciated
@sloanNYC Рік тому
The past 10 years have been really fascinating watching how designs change based on compute needs and what tradeoffs to make in the full system and all the optimizations at the instruction level on up.
@ioinfinity Рік тому
*\(^___^)/* 🦊
@Shakjj Рік тому
Maybe throw Jim´s Mic into the hallway next time. :D
@tristan7216 Рік тому
I want a deep dive into Askelon architecture please 😸🔥
@ioinfinity Рік тому
*\(^___^)/* 🐒
@Fractal_32 Рік тому
If a larger company wanted to include some of Tenstorrent’s IP/chips on package would Tenstorrent permit them access? Assuming they become popular and used for a lot of tasks it may be nice to move their package from an add in board to an on package solution.
@TechTechPotato Рік тому
Yup, that's one business model
@another3997 Рік тому
I suspect that if this were to happen, Tenstorrent would licence it just like Intel and AMD cross licence x86 technology. The uptake and success then depends on price and licensing restrictions. Which is where you start to lose any benefit of the open ISA... you become wholly dependent on one company.
@ChristianStout 2 місяці тому
It would be neat if they could build a consumer graphics processor with RISC-V. I'm sure it's possible, i just don't know what it would take to make it economical.
@user-qf6yt3id3w 11 місяців тому
I'd love to see a microarch deep dive.
@mix3k818 Рік тому
How many years do you think it'll take before RISC-V processors can comfortably rival high-power ARM processors of today?
@Andrew-rc3vh Рік тому
Not many at all. You see ARM put their licence fees up and coupled to the issue with the US banning Western chip technology to China, the country wants to switch to open source RISC-V ASAP. The idea is they can build all the tool chains and compilers from scratch and not be chained to US companies that could be banned from doing business. You see it is like they have their own UKposts and Google, they want their own home-grown software as well. Chiplets were also something they developed to get around the EUV ban. Huawei built the Harmony OS in record time.
@PainterVierax Рік тому
probably something like 5 years, the time for the foundation to finalize the ISA extensions and for designers to refine the different microarchitectures. The issue remains the price though.
@reddeimon475 Рік тому
10? Which is quite fast if we compare to ARM history.
@PainterVierax Рік тому
@@reddeimon475 ARM history is quite different. A lot had to be paved before the 2010 decade, both from the company itself and other links of the chain. Moreover Risc-V benefits from the community shared effort and experience and a clean design as well as huge interests from non-US companies and countries.
@another3997 Рік тому
@@PainterVierax The community shared effort is not something that's going to help. Companies like this will come up with proprietary, closed CPU designs based on the RISC V ISA, and have complete control over them, then they can charge what they want. This open ISA is nothing like the open software model. The "community" is very different.
@mastertantoo Рік тому
I love this content. I watch it when my wife is out the house.
@ioinfinity Рік тому
*\(^___^)/* 😄
@studiomodoki Рік тому
Deep Dive Please, Exciting times,
@ianlee6416 Рік тому
Still need open source synthesis tools and whatever the software is to used to physically modify the actual doped area.
@SudeepJoshi22 Рік тому
uArch breakdowns please!
@aarrcchhoonntt 10 місяців тому
Cool gizmo, but I'm putting it along with photonics, germanium substrate and spintronics in the "No it can't run Crysis" bucket.
@1NIGHTMAREGAMER Рік тому
So it has all riscv instruction sets?
@ICANHAZKILLZ 10 днів тому
Does JIm not have coding standards and CI testing to audit code? 😅 Great video honestly, love it
@refink33 Рік тому
I want to invest in Tenstorrent right now. In 10 years time they could be something major
@TheDoubleBee Рік тому
I'm genuinely excited about RISC-V, I hope it replaces both x86 (32- and 64-bit) as well as ARM (Cortex A and M) in the medium future.
@Apocalymon Рік тому
Many companies are gonna move from ARM, as they recently announced extreme price hikes.
@lawrencedoliveiro9104 Рік тому
Given that RISC-V is already shipping in the billions of cores, that puts x86 at number 3 or number 4 in the market.
@another3997 Рік тому
@@lawrencedoliveiro9104 The problem with your logic is fairly obvious. X86 has a totally different market to either ARM or RISC V. It's like saying JCB has a tiny share of the entire automobile market. Several of the fastest supercomputers ever made are based on the IBM POWER architecture... and most people have never even heard of that. Most of the other top 500 Supercomputers use x86.
@another3997 Рік тому
That is unlikely to ever happen, for a variety of reasons.
@lawrencedoliveiro9104 Рік тому
@@another3997 Following your same logic, you are trying to imply that RISC-V will not be successful until it takes over the construction-equipment market.
@chrisxlim Рік тому
Do you think we will ever see them on a regular desktop?
@another3997 Рік тому
If you have a regular desktop, then yes. I have several CPUs sitting on my desktop.
@johola Рік тому
is there a roadmap for a tenstorrent ipo?
@TechTechPotato Рік тому
Not yet
@7rich79 Рік тому
What could be a potential use in the consumer space? Could it be an AI add-in card for PCs, analogous to perhaps how many years ago Ageia Physx was intended for physics simulation?
@ioinfinity Рік тому
*\(^___^)/* 🐼
@MatthewHarrold Рік тому
I heard there would be one open source Core design ... is that enough given the boost RISC-V has given them? $0.02
@simonbrown8509 Рік тому
How does open-source work for hardware ? Do you have to put the designs made from open source IP into the public domain, just as a GPLv3 software license would enforce ?
@DFPercush Рік тому
I'm not sure what specific license they use, but it's not GPL. It allows proprietary designs. RISC-V is an ISA, i.e. a list of possible instructions and their binary format, including several optional extensions for things like floating point math, vectorization, etc. Designing the circuitry to interpret those instructions and do the actual work, that's up to the manufacturer, and designs will vary widely in how they do that. That part does not need to be open source. Companies don't have to publish their verilog files or litho masks. All it means is that manufacturers don't have to pay royalties to use that instruction set.
@PainterVierax Рік тому
@@DFPercush Risc V is pushed by Berkeley, so the ISA is BSD licensed, which is known as a permissive license that allows forks to get proprietary licensed (unlike a copyleft license like the GPL). There are many Risc-V cores designed, some are opensourced but the majority are closed sourced.
@paulw3182 Рік тому
I would love a drop in RISC-V desktop processor. Especially dumping the legacy of hidden "features" within the x86 architecture.
@another3997 Рік тому
At this moment in time, a Risc V desktop machine would be very slow in comparison to both x86 and ARM. The ISA may be open, but the architectural designs and implementations of actual CPUs haven't yet reached maturity. If a company comes up with a competitive design, they still have to make it competitive in terms of price, availability and third party support.
@paulw3182 Рік тому
@@another3997 Its inevitable our understanding of computers will radically change. Today's Internet of things comprised insecure, inflexible embedded systems must evolve. The future resides in leveraging the power of the network to offload and distribute compute over a wide area. New systems comprised of low power NvLink or Mellanox style interconnects could alter how humans interpret or view what a "computer" is. It's possible, our isolated single purpose built machines will be enhanced then superseded by networks comprised of embedded nodes, where openness and security are paramount. As for today, there are legitimate security concerns within proprietary hardware design. For example, it would great to upgrade or deny "features " within the Intel ME. When it comes to a "drop in" solution for the desktop, low power options focusing on security and scalability would be interesting. New add in cards which promote "low cost" data science would be great! The RTX 8000, A100 are unaffordable, power hungry and overkill for smaller tasks.
@orangeraven3869 Рік тому
How much DDR can the top chip address? Is it over over 256GB or are these just toys still?
@lawrencedoliveiro9104 Рік тому
16:53 In the open-source world there are several examples of large code bases being successfully maintained over periods of decades. The largest one is probably the Linux kernel, currently at about 20 million lines. They have a policy that nothing stays in the code base without a maintainer to respond to bug reports. If nobody is able to handle problems with a piece of code, then it gets dropped--as Microsoft discovered the hard way, when it was contributing patches for Hyper-V.
@another3997 Рік тому
The open source software world is very different to the Risc V open ISA world. It's only the Instruction Set that is open. Chip designers are free to implement whatever features and chip designs they want using that Instruction Set. Think of Risc V as like a programming language, the built in commands are fixed by the creators of the language, but the 3rd party software can be written any way the programmer wants. And the language creators have no control over that.
@ioinfinity Рік тому
*\(^___^)/* 🐼
@shanent5793 Рік тому
Sad to see Keller resorting to voodoo at the end of that interview. Modularity is an engineering principle that allows us to reason about a five million line program. Safety critical systems don't run on Windows.
@PainterVierax Рік тому
And the guy cautiously omitted that opensource licensing already allows thousands of people to audit that code in search for bugs, vulnerabilities or ways to optimize.
@aravindpallippara1577 Рік тому
I have seen plenty of medical equipment still being run on windows at least at the interface level (and that too in xp sometimes - the horrors) The average joe couldn't care less of safety critical systems sadly
@tristan7216 Рік тому
Lots of embedded systems run windows or obsolete OS's. It's a major security problem, because your milling machine has a windows NT controller and they don't support it any more, or your switch runs CentOS 7.9 and you can upgrade the OS to Rocky 9 but good luck getting the drivers and switch CLI to run on that because the mfgr doesn't give out source and the drivers are behind a high paywall on the silicon vendor's web site.
@shanent5793 Рік тому
@@tristan7216 MS' own EULA says windows is not to be used in safety critical systems. Workers are not supposed to be anywhere within the swing of a mill while it is under numeric control, and CNC machines are user-programmed, it's not windows' place to refuse a command that crashes the milling head into a part
@lawrencedoliveiro9104 Рік тому
Surely if you buy a machine with a six- or seven-figure price tag, you would also extract some binding commitments about the support of that machine that would last the expected lifetime of its usefulness. Continuing to use something that is unsupported simply because you cannot afford to replace it means you are just one failure (hardware or software) away from bankruptcy.
@ChrisSmith-rm6xl Рік тому
Dare I hope for a RISC-V chip that is a direct competitor with the Raspberry Pi RP2040? Including something like the RP's PIO state machines and (as long as I am dreaming) the ability to run micro python programs?
@JohnMullee Рік тому
Mainframe class IO at last? For so many cores, there's obvious hurdles with cache coherency unless you go NUMA. And then there's the compiler backends..
@timothyhuber5322 4 місяці тому
I’d love to see posits running on RISC V
@RahulAhire Рік тому
Ian, How does it compares to Cerebras?
@badadvice787 Рік тому
Will Skynet be run by RISC V? This is vital information for the future of humanity! If I get some ambition and can find information I find palatable I will try to go down the Architecture rabbit hole.
@ioinfinity Рік тому
*\(^___^)/* 😄
@velo1337 Рік тому
deep dive !
@ClokworkGremlin 5 місяців тому
I love the concept of Risc-V, but I have yet to see any way to actually take the files and turn them into a working computer that doesn't involve going right back to a centralized market, since the circuitry to go between the peripherals and the CPU is only manufactured by a handful of Chinese companies, and there is *zero* documentation available on DIY-level motherboard design.
@catchnkill 5 місяців тому
What files? RISC-V is just free instruction sets for a CPU architecture. Nothing else.
@aniksamiurrahman6365 Рік тому
God, so many exiting improvement, but none of them for end users like us.
@solidreactor Рік тому
Would love to see how "easy" (or hard) it is to port a neural net made for x86 cpu to a tenstorrent compute card. In my case it's written in c++ without any ml specific libraries. Interested to see what kind of structures, algorithms or kind of compute it support for acceleration.
@kazedcat Рік тому
For Tenstorremt I think you need to write your AI in Pytorch. Everyone is already using Pytorch for AI anyway so it is much more efficient for them to focus their efforts on creating tools for Pytorch only.
@ioinfinity Рік тому
*\(^___^)/* 😄
@tristan7216 Рік тому
Xilinx and I think AMD used chiplets, it works. Xilinx can ship parts with different mix and match capability like HBM. And it probably boosts yield and reduces design time. But the interconnect (NOC) adds complexity. You don't *have* to use chiplets tho, you could go the other way: Cerebras.
@ioinfinity Рік тому
*\(^___^)/* 😄
@fredbecker607 Рік тому
A defect on a chip is not as critical. Much smaller investment for each piece.
@boydmcree9085 Рік тому
are they going to market?
@esra_erimez Рік тому
15:04 Colossus: The Forbin Project
@autozone5335 Рік тому
Great content 👍 A deep dive into Ascalon's custom microarchitecture is highly desired
@learningtoride1714 4 місяці тому
I see news about CPUs like the Veyron V1 and V2 RIS-V CPU and they look very interesting, but I cant see any motherboards or systems using them that you can buy. Does anyone know if there such a motherboard/system and where to get them?
@TechTechPotato 4 місяці тому
They're not in production yet. Unless you're a leading customer perhaps.
@learningtoride1714 4 місяці тому
@@TechTechPotato is that the v2 not in production yet or both the v1 and V2 not in production?
@learningtoride1714 4 місяці тому
Actually my question should really be, other than the Milk-V Pioneer, are there any other commercially available CPU/motherboard/complete systems with 64+ cores. I would be very interested in these. Thank you if you are able to help.
@user-yc5fq9bv3u Рік тому
05:00 is that 1200 GiB/s or 1200 Gib/s ethernet?
@swenic Рік тому
11:11 Derivatives for Laptops slide is marked as confidential
@enhex Рік тому
will the CPU be available for anyone to buy?
@ehiebert1297 Рік тому
Thanks for the video. Jim Keller seems to be at the forefront of advancing CPU tech. AMD to Arm back to AMD to Intel now Risc V and Apple is in there as well.
@aravindpallippara1577 Рік тому
you forgot intel - upcoming arrow lake is rumoured to use the royal core which had Mr Keller's involvement in development
@ehiebert1297 Рік тому
@@aravindpallippara1577 Jim Keller's list of work on CPUs is long and impressive, and my list was just off the top of my head, forgot Apple and had to edit it in.
@user-do7rk3ui5y 2 місяці тому
What price I bought for use server
@letMeSayThatInIrish Рік тому
There should be cats at the end!
@davidgunther8428 Рік тому
I'm wondering how accessible making a custom RISC-V chip is because while the ISA is open and low cost, producing anything on a recent process is very high cost. It seems that this won't really be accessible to academia, but will be to significant sized companies with lots of resources.
@TechTechPotato Рік тому
Plenty of university shuttles today already building RISC-V designs.
@davidgunther8428 Рік тому
@@TechTechPotato can an FPGA implement a RISC-V design? I imagine it might, since even ASIC are just connected groups of gates and memory.
@DFPercush Рік тому
@@davidgunther8428 Sure, if you get a good enough FPGA, but it would probably have garbage performance. FPGAs don't tend to have very high clock speeds, usually maxing out around a few hundred MHz. And you wouldn't have much room for cache or extra cores.
@another3997 Рік тому
It's a case of companies designing workable CPUs that can be produced cheaply whilst still having some kind of performance or energy consumption benefits over the competition. Remember, the ISA is open, but the CPU designs themselves are most likely to be proprietary, and a lot depends on how much companies charge to use their design.
@BenEehayeh 11 місяців тому
Would each chiplet have its own RAM, and its own storage, say 1meg RAM and 1meg storage?
@m_sedziwoj Рік тому
One of most interesting part was why chiplets, and that you don't have choice. Question is, what Nvidia think about it? Because they more and more looks as giant with clay legs.
@ioinfinity Рік тому
*\(^___^)/* 🐒
@samanthaqiu3416 Рік тому
avoid deep prediction pipelines, make more cores with vectorization instead to amortize instruction latency
LowSpecGamer
Переглядів 740 тис.
Lex Clips
Переглядів 79 тис.
Freethink
Переглядів 1 млн
Tech way
Переглядів 9 млн
ASMR Detected
Переглядів 54 тис.
Creative Passion 88
Переглядів 750 тис.