Create A Personalized AI Chatbot with ChatRTX

  Переглядів 28,850

NVIDIA GeForce

NVIDIA GeForce

Місяць тому

Create a personalized chatbot with the ChatRTX tech demo. Accelerated by TensorRT-LLM and Tensor Cores, you can quickly get tailored info from your files and content. Just connect your data to an LLM on RTX-Powered PCs for local, fast, generative AI.
Try it now. Available to download now for GeForce RTX 30 and 40 Series owners: www.nvidia.com/en-us/ai-on-rt...
Learn more about ChatRTX: blogs.nvidia.com/blog/chat-wi...
Subscribe to @NVIDIAGeForce today!
GeForce Instagram: / nvidiageforce
GeForce TikTok: / nvidiageforce
GeForce X: / nvidiageforce
GeForce Facebook: / nvidiageforce
GeForce Community Portal: www.nvidia.com/en-us/geforce/...
#ChatRTX
#Chatbot

КОМЕНТАРІ: 188
@Neynuo
@Neynuo 29 днів тому
I always wanted to chat with my graphics card
@infini_ryu9461
@infini_ryu9461 17 днів тому
That's basically what you are doing when using any chatbot. ChatGPT is a bunch of server-side GPUs you talk to. lol
@user-nh7be1wg5s
@user-nh7be1wg5s 14 днів тому
Like Me
@mbnqpl
@mbnqpl Місяць тому
Next, cookingRTX.
@vito180mafia2ee
@vito180mafia2ee Місяць тому
It is already was with Jensen Huang
@Blue-bf8lv
@Blue-bf8lv Місяць тому
just crack an egg on your 4090
@puddles5501
@puddles5501 Місяць тому
2026: RTseX.
@vito180mafia2ee
@vito180mafia2ee Місяць тому
@@Blue-bf8lv egg cooling system. Use protein for cooling your GPU
@JARFAST
@JARFAST 28 днів тому
what languages ​​does nvidia support? chat with rtx. arabic
@CyanideAlto
@CyanideAlto Місяць тому
I thought this was April Fools at first but then I saw the date 💀
@mori0
@mori0 Місяць тому
same lol
@OneTwoMark
@OneTwoMark Місяць тому
Same
@Guarrow
@Guarrow Місяць тому
I thought that there's no way it was the night of the 31st lmao, thought I went into a time jump or something
@Diablo-ji6vq
@Diablo-ji6vq Місяць тому
Thank you Nvidia for investing time and money in this, when what I would like is not to run short of Vram in 1 year.
@JonoFunk
@JonoFunk Місяць тому
Excited to test it out!
@gtamike_TSGK
@gtamike_TSGK Місяць тому
Sounds like ToeJam and Earl music
@domagojbelic5772
@domagojbelic5772 Місяць тому
Well that looks pretty cool. The background music is pretty chill.
@rexedicus9626
@rexedicus9626 Місяць тому
Its really helpful in medical school studies
@CG_Media95
@CG_Media95 Місяць тому
Damn now we need RTX to run ai
@Klon-22
@Klon-22 День тому
so how do you run AI and chat with your file local on your computer? There is no program
@444ranger444
@444ranger444 Місяць тому
your link is broken Nvidia
@k4rl33
@k4rl33 7 днів тому
Can be the folder path in a remote location? Would be cool to have online services providing data and then do the stuff in local...
@gavingraves8748
@gavingraves8748 Місяць тому
The use cases presented in the video don’t even make sense… Why would you move your text file into nvidias ai and then ask it a question that was written on it when you can with less steps just open and read it yourself?
@pixelpairplay
@pixelpairplay Місяць тому
Visualize possessing a document spanning 1,000 pages.
@9tr0n
@9tr0n 28 днів тому
upload your entire textbook then ask it the homework questions
@user-fe1nr3ws1z
@user-fe1nr3ws1z 15 днів тому
It can read multiple books in a minutes, can you?
@gavingraves8748
@gavingraves8748 15 днів тому
@@user-fe1nr3ws1z I don’t care what it can do if that isn’t useful 💀
@anasahmed1508
@anasahmed1508 Місяць тому
#ChatRTX very nice name. Wonderful
@OneTwoMark
@OneTwoMark Місяць тому
Why would it be limited to 30 and 40? What tech is it using the 20 series doesn’t have?
@max3eey
@max3eey Місяць тому
Money
@TexelGuy
@TexelGuy Місяць тому
It is a weird omission since the 20 series has been getting crazy good 'AI' feature support through drivers to this day (RTX VSR/Video HDR, Ray Reconstruction, DLDSR). Someone on reddit theorized it's because the 20 series tensor cores lack bf16 floating point format support, which is specifically helpful for running LLMs like what Chat with RTX does. That doesn't mean the 20 series can't do Chat with RTX at all, since those cards still have TensorRT support. Nvidia might have to create a different model for them, which may have to be either slower or lower quality. It would be great if this would be cleared up by Nvidia themselves, like how they did for DLSS Frame generation, though this one app isn't as big of a deal as that.
@nilst93
@nilst93 Місяць тому
Ai
@Eleganttf2
@Eleganttf2 Місяць тому
People in this comment section reeks of clueless and baseless assumptions smh, It's because flash attention 2 doesn't support the Turing architecture. This means that it'd be extremely slow and less accurate. The 20 series also doesn't support CUDA 12.x versions. It's a gpu from 2018 dude what do you expect ?
@Diablo-ji6vq
@Diablo-ji6vq Місяць тому
In the Flash attention 2 requirements it doesn't say anything about Cuda 12 but Cuda 11.6 and they also mention that they are going to add support for Turing.
@riven4121
@riven4121 Місяць тому
One step closer to JensenRTX
@CellarDoorCS
@CellarDoorCS Місяць тому
I'm getting: " 404 Page Not Found We’ll Be Right Back" on the download page.
@tallgymbro
@tallgymbro Місяць тому
Same, are you living in the us ? Cause im not and i think thats why
@GemuTabi
@GemuTabi Місяць тому
Im Glad that its still works on RTX30 series. nice. but sad that 2000 series is not capable. its still in RTX though
@zintoki8211
@zintoki8211 13 днів тому
Do they support this app or it is just forgotten tech demo? I don't see any patch notes. They didn't even fix instalation error for custom installation path? Download link is broken...
@olivierpaire5190
@olivierpaire5190 Місяць тому
Nice Mistral awesome
@mrawesome2704
@mrawesome2704 Місяць тому
Does it work on Macs?
@Vipr1n_
@Vipr1n_ Місяць тому
does it work in the gtx 1660?
@beaulear7202
@beaulear7202 Місяць тому
Will this becomw available on 20 series?
@Eleganttf2
@Eleganttf2 Місяць тому
I dont think it will since Turing doesn't support flash attention 2
@StephenMcGregor1986
@StephenMcGregor1986 14 днів тому
No, 20 series is old news. My Commodore 64 and Atari 2600 won't run it either mate.
@StephenMcGregor1986
@StephenMcGregor1986 14 днів тому
Does this work on my Bluetooth toothbrush, CASIO calculator, Coleco Vision and Commodore 64?
@phonigmob3917
@phonigmob3917 Місяць тому
Why not series 20 ? those are rtx too
@Rebe-Caufman
@Rebe-Caufman Місяць тому
those are junk
@brandonejem8620
@brandonejem8620 Місяць тому
Got no problem with mine.​@@Rebe-Caufman
@Fztrm
@Fztrm Місяць тому
@@brandonejem8620 20 series being old and only second gen tensor might have something to do with it, outdated and slow maybe
@t8z5h3gaming
@t8z5h3gaming Місяць тому
@@Fztrmkinda funny as the Nvidia tesla T4 is also a staple in AI and is based off the 2070's
@dreamqore
@dreamqore Місяць тому
20 series is like 20 years old 💀
@RSV9
@RSV9 День тому
Does ChatRTX also work with other languages ​​apart from English and Chinese, for example Spanish?
@Crimsonoverlord.
@Crimsonoverlord. Місяць тому
pretty soon youl never have to think for yourself.. if things crash.. your doomed...".which way do i go."..f.e.a.r reference..lol
@00Clive00
@00Clive00 Місяць тому
What about my Geforce 256?
@00_Quant
@00_Quant Місяць тому
Can this do my maths homework?
@fadlhlisl
@fadlhlisl Місяць тому
lol
@nugrahasetyaardi6001
@nugrahasetyaardi6001 Місяць тому
I just try it, and nothing cool. What makes it special is it runs locally on your average gpu consumer rtx 3000 & 4000 and it is free. But in terms of performance it is just an llm with multimodal input (and only docx pdf txt are supported)
@JJ.R-xs8rf
@JJ.R-xs8rf 6 днів тому
> "(and only docx pdf txt are supported)" Yep, and that's why it's useless. I got tons of data in excel files, Outlook, my calendar software, script files, coding files.... all data that this dumb thing wouldn't be able to use.
@DeliciousDogMeat
@DeliciousDogMeat Місяць тому
lets get funky
@hassanaoude7895
@hassanaoude7895 Місяць тому
I’m jealous.. Lost all hope in my 7900 XTX 😂
@90kuky
@90kuky Місяць тому
Not something I expected from Nvidia. But they slowly moving toward creating a game with good AI
@HitemAriania
@HitemAriania Місяць тому
broken links and now downloadable when u finaly reach the site
@Pavan_AI
@Pavan_AI Місяць тому
But the system requirements were too high 🙃
@iammrsujit
@iammrsujit Місяць тому
I have 3060 6GB varient. Bring this for 6GB users also. 😢
@mbnqpl
@mbnqpl Місяць тому
cmon, you have to pay more to nvidia
@moksq42
@moksq42 Місяць тому
Cmon, bro. Spend some money and get lil better like vanilla 4070
@Billy00714
@Billy00714 11 днів тому
35GB?
@StussyFlo
@StussyFlo Місяць тому
The link does not work
@Ale4D
@Ale4D Місяць тому
Link not working
@LizardonXY
@LizardonXY Місяць тому
Couldn’t get it to install smh
@peliguyrulez
@peliguyrulez Місяць тому
WIN 10 support...
@_skiel
@_skiel Місяць тому
please give the 5090 64gb vram - kkthx :D
@arnoldvargasdaza862
@arnoldvargasdaza862 Місяць тому
Why not on rtx series 20??? 😡😡
@Eleganttf2
@Eleganttf2 Місяць тому
Because its an architecture from 2018 plus it doesn't support flash attention 2 for god sake
@klic6013
@klic6013 Місяць тому
interesante
@SceneArtisan
@SceneArtisan Місяць тому
Graphics cards doing chat,.. what next,.. CPUs doing knitting?
@Kaichi-Sama
@Kaichi-Sama Місяць тому
NVIDIA KNOW WHAT WE WANT LOCAL AI
@Eliee4379
@Eliee4379 4 дні тому
can i ask to my gpu why nvidia being overly greedy?
@Navinash
@Navinash Місяць тому
I'm using a laptop with RTX3050 6GB VRAM, will it support for me or the additional 2GB VRAM is necessary for it to run. Thank you.
@Eleganttf2
@Eleganttf2 Місяць тому
Necessary since its a 7 Billion parameters
@infini_ryu9461
@infini_ryu9461 17 днів тому
6GB is going to limit you very heavily in regards to AI as everything being released currently are 7 billion parameters and up. Unless you're fine with going at a snails pace, you can use opensource backends with CPU support to use your system RAM.
@Bharatsanjeev-vm7ji
@Bharatsanjeev-vm7ji Місяць тому
MAKE A gpu without external power like rtx4060
@Hellseeker1
@Hellseeker1 Місяць тому
Butt what if I wanted to train my own private bot that connected to the internet? It be way cooler if these other places didn't try to make it a money scam. They charge you for text amount and lock you out with time constraints and subscription models. This is not the future I was promised. A.I. suppose to help humanity, not turn a profit.
@barsaf9989
@barsaf9989 Місяць тому
Will this work with cloud based file servers? Or just local for now?
@t8z5h3
@t8z5h3 Місяць тому
If you can mount it like a normal drive (SMB drive mapping) it should work.
@8020Alive
@8020Alive Місяць тому
Cloud ☁️ support enabled
@StephenMcGregor1986
@StephenMcGregor1986 14 днів тому
I used this once, closed it now fucked if I know how I get back into it. Usability = 0/10.
@VASSER574
@VASSER574 21 день тому
Yo, the rtx 3050 6gb won’t be able to run this app 😂
@syatek
@syatek Місяць тому
Link to demo: "404 Page Not Found"
@hue_momo2355
@hue_momo2355 2 дні тому
I couldn't open it😡😡😡
@marikono9433
@marikono9433 8 днів тому
Time to rizz my gpu
@Sunderland.312
@Sunderland.312 Місяць тому
The RTX 4070 doesn't support Llama. I wish they had added more VRAM to this card.
@veloce5491
@veloce5491 Місяць тому
why is called rtx. what on earth does this have to do with ray tracing???
@t8z5h3
@t8z5h3 Місяць тому
Rtx is a global term for the hardware that enables raytracing, the RT cores and tenser cores
@erichhugo1
@erichhugo1 Місяць тому
Getting it to work ain't easy
@circuitnerd
@circuitnerd 24 дні тому
Or you know, just organize your files better >_>
@serbiangamer
@serbiangamer Місяць тому
What about us GTX users? Screw us, ha?
@vherostar
@vherostar Місяць тому
GTX cards dont have AI cores so wouldn't work even if they enabled it tbf.
@allansolano5587
@allansolano5587 Місяць тому
I mean in this specific case you do need the AI cores and sadly gtx dont have those
@anasahmed1508
@anasahmed1508 Місяць тому
No more support for GTX
@gtamike_TSGK
@gtamike_TSGK Місяць тому
GTX is obsolete 😂
@losirk4491
@losirk4491 Місяць тому
get a job
@commanderoof4578
@commanderoof4578 Місяць тому
The Nvidia app doesnt even save your list of games or even scan correctly after you reboot so i dont see this working correctly neither Have to uninstall and reinstall the Nvidia app every single time i start my computer to get the stupid games list to populate
@Nalguita
@Nalguita Місяць тому
How wonderful, when you brought out the first RTX with the super fascinating Tensor Cores and all the marketing you did about them, now you have already forgotten about them. I understand that they have been around for a while and probably wouldn't work as well, but if they have Tensor cores why are you excluding them. This is one of the reasons why after spending my whole life with Nvidia I have switched sides. You already screwed me with 3dvision and Physx, I see that you are doing the same now with the RTX 2XXX. When the 5000 comes out I will have to add another dedicated card for AI as in the Physx era?. I really hope someday you will have real competition and stop treating consumers like garbage. I also don't forget what you did with the 790i ultra motherboard chipset.
@Fztrm
@Fztrm Місяць тому
Who will you switch to? Everyone will screw you over one way or another
@Nalguita
@Nalguita Місяць тому
@@Fztrm Yes you are right, but it is not just once or twice, it has been a few times and I am not only talking about marketing, but also about hardware. First a very expensive board with 790i Ultra Chipset, a lot of problems, thinking it was the board I changed it for an Asus Striker Extreme 2, same chipset, same problems, then they took out one more chipset and did not manufacture more. Then a 9800GX2, 600 Euros in its day, when the graphics were cheaper. The worst graphics card I have ever had in my life. Then a Gtx 480, it got to 90Cº with the fan at 100% in a simple game like l4d2. Then came the 970, with its 4Gb of which 512Mb were a joke, and then the fucking marketing with things like Physx that even with 2 graphic cards games like Mafia 2/Sacred 2/ Batman worked like ass. About SLI we don't even talk about it. Now with a red card, its streaming is garbage and RT is behind but when it comes to playing I'm quite happy. Edit: I understand that with such complex hardware there can always be problems, but when they are always the same ones you get tired of it. As you say, surely the same thing happens with the competition, but after so many times it is clear that I just have to change and try. Sorry if my English is not good i am using translator.
@Fztrm
@Fztrm Місяць тому
@@Nalguita AMD has screwed me over more than anyone, K6, Bulldozer, AM5 (pop goes the 7800X3D) because of lack of information from AMD's side....i still have a SECOND 7800X3D because it is simply the best gaming CPU there is now (And hopefully AMD learned their lesson and i won't have this one pop too) ...Intel screws over people regulary. It is all the same with every single one of them, not once, multiple times. They are all the same, whoever screws you the most is the ones that can afford to do it at the time.
@Nalguita
@Nalguita Місяць тому
@@Fztrm Yes, my friend, you are right. I speak from my experience, so far with Nvidia. That does not mean that AMD does not have problems, the first Radeon 7xxx with the Vapor Chamber, the first Ryzen 7000 with the bios the 5000 with problems of disconnections in the Usb. The same Intel now with the consumption and before spending years bringing out rehashes. But as I said I've been with Nvidia for years and I'm tired of their "lies" and the problems I've had with them, for me it was time to change. I have a 6800xt and a Ryzen 5000 and so far I am happy, I have no complaints about the graphics card, that does not mean that there are no people with them. About the Ryzen I could tell you that on the Asus website I have more than 22 versions of Bios, but since I bought it late I haven't had any serious problems. Best regards.
@Fztrm
@Fztrm Місяць тому
@@Nalguita I think everyone is in for a wild ride the next few years on all sides now with all the ray tracing and new features, many with hardware they thought "future proof" will be disappointed
@offset_07
@offset_07 Місяць тому
Why don't 20 series cards support #KAPITALISTNVIDIA
@Eleganttf2
@Eleganttf2 Місяць тому
It's because flash attention 2 doesn't support the Turing architecture. This means that it'd be extremely slow and less accurate. The 20 series also doesn't support CUDA 12.x versions. It's a gpu from 2018 dude what do you expect ?
@HailAzathoth
@HailAzathoth Місяць тому
How about no
@jonlpage
@jonlpage Місяць тому
W H Y
@steamhd4315
@steamhd4315 Місяць тому
look up why the nvidia stock is so high rn
@mdioxd9200
@mdioxd9200 Місяць тому
Yes please I would like Nvidia to access my local data thank youu
@flashyweiner
@flashyweiner Місяць тому
I guess the waffle house has finally found it's new host then
@JJ.R-xs8rf
@JJ.R-xs8rf 6 днів тому
Useless, hardly anyone uses his computer this way at home, who the hell write appointments in a doc or txt file? Either we use an app on our phone, or some kind of calendar application on our PC.
@nothing-fh8vi
@nothing-fh8vi Місяць тому
lmao what is this even useful for
@WOMFT
@WOMFT Місяць тому
I'm sure my data stays private
@Guarrow
@Guarrow Місяць тому
Seems pretty useless to me
@tropixi5336
@tropixi5336 Місяць тому
why tf does a gpu need a chatbot?!
@VertegrezNox
@VertegrezNox Місяць тому
Gross
@RussianXP_
@RussianXP_ Місяць тому
not inspired at all K
@NevermoreNeverAgain
@NevermoreNeverAgain Місяць тому
I don't need, nor do I want, any "AI" anywhere near me. Come back when you have actual AI, a sentient computer, and we'll talk...
@muhtasimahmedtausif2090
@muhtasimahmedtausif2090 Місяць тому
😂😂😂😂 RTX where is GTX
@hedzsooo
@hedzsooo 13 днів тому
In the museums?
@blitzkreig4887
@blitzkreig4887 Місяць тому
WTF is this. It's like Nvidia creates RTX ON/OFF memes and trolls themselves for clout.
@sameer52
@sameer52 Місяць тому
I have RTX 3050 4 GB, is it compatible ?
@Eleganttf2
@Eleganttf2 Місяць тому
No lol your 3050 laptop only has 4gb vram
@sameer52
@sameer52 Місяць тому
@@Eleganttf2 what's the minimum vram required?
@Eleganttf2
@Eleganttf2 Місяць тому
@@sameer52 8GB because the LLM model is worth 7 billion parameter, in laptop it means you must get atleast a laptop with an RTX 3070 or RTX 4060
@DiluteOxygen
@DiluteOxygen Місяць тому
​@@Eleganttf2what about 3060 12gb varient pc
@Eleganttf2
@Eleganttf2 Місяць тому
@@DiluteOxygen its good
NVIDIA'S NEW OFFLINE GPT! Chat with RTX | Crash Course Guide
7:54
TroubleChute
Переглядів 77 тис.
AI Generated Videos Just Changed Forever
12:02
Marques Brownlee
Переглядів 8 млн
Кровосток - разговор с легендами / вДудь
2:12:57
Артем Пивоваров х Klavdia Petrivna - Барабан
03:16
Artem Pivovarov
Переглядів 3,8 млн
Agon Light 2 - My Leaf
5:22
Learn Agon
Переглядів 14
The Best GPUs of 2024 So Far - March GPU Pricing Update
16:51
Hardware Unboxed
Переглядів 151 тис.
Apple Vision Pro - A PC Guy’s Perspective
24:49
Linus Tech Tips
Переглядів 2,7 млн
This Isn't Just A Chatbot (OpenAI Should Be Scared...)
10:13
Theo - t3․gg
Переглядів 120 тис.
How JavaScript Ruined the Web
15:02
Eric Murphy
Переглядів 92 тис.
I'm Deliberately Burning In My QD-OLED Monitor - 1 Month Update
11:38
Monitors Unboxed
Переглядів 145 тис.
How to Create and Use Perplexity Personal AI Chatbot Agents! #95
17:38
Josh Evilsizor
Переглядів 30 тис.
AWS’s Future is…Q?
16:15
Theo - t3․gg
Переглядів 26 тис.
Test IQ CHALLENGE!  Gegagedi- countryballs animation #countryballs #shorts
0:26
CountryBalloons Animation
Переглядів 2,5 млн