This has such fantastic applications for games. No more of those repetitive boring monologues from NPCs 🙂

As soon as games start implementing this technology NOT running locally, good luck playing that game in 5 to 10 years when the company no longer wants to bear the cost

Having an online-only GPU is a very bad move because firstly it makes games completely dependant upon the internet connection speed even if the game or app itself doesn't and secondly it's giving Nvidia the ability to control who and how consumers use their hardware. It opens the door to allowing a corporation to just stop supporting older hardware by denying them access to the cloud thereby forcing users to upgrade.

So against running anything like this through the cloud. Privacy & security issues aside, it just enables companies another way to completely **** you down the line. Will there be added costs for the server usage? What if a person has slow internet or no internet? No...they need to develop an AI core onto the cards to run it locally (yes, big ask).

I am really against moving to cloud computing for a gaming experience, as we know aside from just the latency issues that would make every game feel sluggish to play interacting with NPCs in this manner, you would never get that fluid feel of a real conversation, where people react to what you are saying in real-time, like when someone gives a little laugh while you are mid-sentence etc. As new models get made & the data required gets smaller (3 papers down the line), all this will be possible & better done locally. Also as AI becomes more generalized using a single model for tackling multiple tasks like this, I foresee future GPU drivers containing all the data required to tackle these tasks in a simple install, or if a game wants to use their own generalized model it would be downloaded with that. We are entering an age where we will have fast access petabytes of storage locally on desktop PCs which will be ample for larger models too anyway!

I hope the locally run scene will catch up soon with these "safe" in the cloud corporations

Hi, could you do a video about the paper: Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training? It's basically a paper on how LLMs can be trained to have alternative, deceptive motives that are really hard to untrain or detect. For example, the model could be set to start to provide vulnerable (malicious) code snippets to coding-related prompts when the prompt mentions a certain keyword e.g. "2024".

cant wait to gassligth the police to stop chasing me in gta 7 because my grandmother used to tell me a bedside story where the police stopped chasing me.

Thank you for keeping us updated, even when the information does not come from Papers! I'm thrilled to see what the future will bring!

But the games would require internet conection to run... :/

Cloud improvements are not improvements at all! If I cant use it offline, I wont use it.

2:22 _"It sounded a little stiff, could have been a bit more natural..."_ Said *Dr. Károly Zsolnai-Fehér.*

We need to get rid of the „in the cloud“ part ASAP

It has to be mentioned that RTX implementation is by far not everything that went into the new Half Life 2 ‚remix‘. The majority of models and textures have been entirely redone or in the least upscaled which is a huge contribution to the big jump in fidelity

Wasn't this bar scene published like months ago?

4:04 Yay, more games with nice tech (but we forget that we don't actually improve or optimize anything but scale instead, so you'll need new parts that will cost couple thousands each. Not that yay anymore xD). Will we ever see something that is a bit better and at the same time doesn't require multiple times bigger space, tech, memore, etc. and more resources in general. That's what "improvement", "evolution", "progress" etc. means 😅 Not just scaling sht for eternity. At this rate we'll have to save now to buy the $100K, low end PC by the year 2050. (Love to hear developers say: "You may need to upgrade your pc to be able to play this game or use new features. Heh" every single year).

I'm always excited to see a new video. What a time to be alive!!! :D

Oh no. They're going to start charging us monthly for that functionality on the nvidia cards, aren't they?

Aren’t the auto generated characters & dialogue almost a year old?

And now seriously. Nice achievement, hope someone will implement it.

Another great video🥳 Cloud based will not be a permanent solution. Soon AI will be integrated into the firmware - for the latest LLM simply update the firmware

Notice how we've been getting annoyed that when you buy something you don't own it, for instance a game because of things like DRM. So now they just came up with a way you have to connect to their servers because your home computer isn't powerful enough.

What a time to be alive!... Unless you need a job.

I can really see this tech being used for virtual relationships. You 3D map your house / room, then wear a 3D helmet and talk and interact with the model in the augmented reality space.

NVIDIA isn't really a graphics card company anymore, it's an AI company.

I'm not a fan of single player games reliant on a cloud based LLM

"Our quantum AI has determined that you have no purpose or use. You are scheduled for processing. Thank you for your sacrifice in saving the climate."

whatatimetobealiiiive! i love this dude

Applying correction: Calculating NVidia BS factor: NVidia claimed thousands of cores in its graphic processors, while actually having up to 128 in high end models. Supercharging * Nvidia BS factor = NVidia has introduced some minor graphic effects in games.

Very good content, keep it up, happy new year!🍾

And so ❤ much more!

Well, I hope the connection to the cloud will be optional. I prefer to have control and knowledge over what is happening with my data.

I miss the old TMP Talk about fluid sim TMP Videos about light transport TMP Actual papers TMP I hate the new TMP AI this and AI that TMP Supercharge NVIDIA TMP Generative Neural Net LLM TMP

Can’t wait until this is local.

Graphics card that needs a cloud to work? Seems like a horrible investment. As soon as they decide to shut down the servers, you have an expensive brick on your hands.

so for this feature, we will need mandatory internet connection. great

Hmm it gives me Oblivion radiant ai vibe

The Ai is moving faster than my pc. Llm mistal 8x7b size almost 80gb size, require 32 gb ram. Sdxl model 7-10gb each.

I'm waiting for the video where Károly Zsolnai-Fehér admits it's an AI. What a time to be an AI!

What a time to be alive!

anyonce guess what that means for the price development of cards who are not up to that yet

Not sure if this is a good or bad news

STOP CALLING US 'FELLOW SCHOLARS'! I'm just a man watching UKposts.

5:05 so img2img inpaint in SD? edit: yep

Just had a thought, that blew my mind. If AI, in particular the interaction with NPCs, becomes as good as talking to real humans, then being a computer geek might actually be helpful for once -- no socially akward geeks anymore!

I suspect that a fully adequate character AI should be possible on a local card. The big parameter demand for language models must be the extreme knowledge, speaking multiple languages at the same time. A modest character with no academic training is probably possible with only a few gigaparams. Maybe a very large model can synthesize training data for an intelligence with very little knowledge. Your average person can't quote the entire bible verbatim and pass the bar exam plus speak to the finer points of quantum chromo dynamics and civil engineering codes in new york city in the 1950s in aramaic. Of course it's easier to just use a genius AI to emulate any character but at some point it might be very demanding to run the entire world centrally instead of using people's powerful local cards. With ram having dropped 75% in price recently we should have 50GB cards soon. I hunch that you can do very well rounded conversational intelligences with 20b. Maybe even 1b.

Nah... Raytracing + Skyrim... Then we're talking ;)

It's really weird hearing all this dystopian progress voiced with your usual breathless excitement. I just can't share your enthusiasm for more autonomy and even agency being ripped from consumers.

Downloading characters voice from the cloud ? without us noticing ? hmm

so many jobs will be lost. WHAT A TIME TO BE ALIVE!

So who's using exactly this tech to run an LLM as a Dungeon Master-type role for a tabletop styled RPG akin to Dungeons and Dragons?

They are rushing this tech. But still. Its awesome. A few papers down the linr and we wont need the cloud computing. It until then. This is quality data

Having an LLM take meeting minutes and notes is going to free up so many people from doing absolutely inane work during even more inane meetings.

2:16 The mouth movements following the audio is nothing special to be fair. They did this already in the early 2000's; just by analyzing the waveform. And judging from the video; the ai version did not look any better than what they achieved algorithmicly 20 years ago.

I worried ai will clog the Internet with garbage to the point that it is useless

Oh boy, this local/cloud hybrid gaming again? Worked so well for XBOX when they announced it. Bad idea. Only if it is fully optional and the game will be good without it.

Yeah no cloud bs, that's not the advancements I want Also pls don't become an Nvidia shill

Guys help me understand. Where is Nvidia actually going with this ? I know and everyone knows that era of x86 is over. And as we understand next gen ARM CPUs will have integrated A.I. so where does it lead ? Are we going to see a "neural network SOC" that will run operating system, or games and will render not by processing the data but like "imagining" it... Similar to how we do during sleep. In 10 years from now we have no idea where all of this going to be.

I just want a Raytraced and remastered Morrowind 😭!!!

The content is GOOD but the choppy narration is hard on my ears.

I wonder how people are gonna afford the new features if we are all broke with no job by 2050 😂

I wonder If I'll back to my gamer years being 45

Are you being paid by Nvidia?

Pls, no more AI news, i'm Tired, there are AI news everywhere, it already reach saturation

The natural AI response in game is cool but does that mean that everything you say (and how you say it) gets analysed, so every intention can be backtracked to its probable origin thought process, leading to automated user flagging of prospective potential of behaviour dangerous towards political interests? In other words: Will this automated analysis of my questions, responses, interests and thought processes develop into subliminal behaviour surveilance? Will games of the future become surveilance prisons through non-local AI? Over the past decade my government has teached me to trust no one and always expect to get scammed and exploited by the people you rely on / have to trust. They teached me that trust = risk.

Super!

Remember guys: you will own nothing, and you will be happy

2:20, You think that sounds stiff? It's already better than any voice acting in any bethesda game. xD

Hopu you all have NVIDIA stock...

Венгрия, вы лучшие! Привет из России )))

There is something really awful about the photoshop AI

I can't help but think that this channel has lost itself a bit with all the AI hype around. I know that covering this stuff is cool and it brings a lot of views and the views are what pays the bills, but this channel used to be the place where low-key but awesome research papers came to shine. The place that talked about stuff that the mainstream media missed. The underdogs of papers. etc. etc. Now you are covering stuff that dozens of other channels cover as well. Even non-paper-related stuff like this video.

NVIDIA is one of the best companies to ever exist. I’m so sorry for cheating on you in the 90s with Radeon and Voodoo.

I want an AI that can generate games/worlds from my input without the need for a game developer at all.

I hope that someday when AI takes over more and more jobs, that humans get to work less, get paid still, and enjoy life..

2nd.

Is this video entirely sponsored by Nvidia? :)

carol john afahir

My preference would be if there's no code, no model, no paper, don't make the video. Focus your efforts on things that help everyone, not clickbait marketing!

4th

today!......... we are going to see!...........how nvidia!.........

Next roombas would be able to walk on four legs ..

Athsmatic chihuahua

The stuff has nothing to do with papers anymore, is in part 6 months old from NVIDIA and has nothing to do with adding value to our lives. You are invested in NVIDIA we get it. Just like we get that you will sell 50% right before or after the earnings report, thus not adding value to the market actually. Rethink of what your channel has become

dr fffffffffffffffffffffffffffff

Holo-deck here we come

Maybe NVIDIA can super charge not having to take out a second mortgage for a GPU next! (⊙ω⊙;)

scary

Oh, "great". Now you do not own the game, and next step you do not own your graphics card. Pay for subscription! There is no need to have 64GB LLM for game, that only can be started on the server. LMs need to be developed well and need to be trained for certain game. Each character should have it`s own text knowledge base and it is only way to not ruin game. I see this tendency for a long time: big companies want`s to make almost any product linked to their servers and monthly subscription. And in the same time they prefer to keep money and rent ready-made huge and over Same for cloud gaming, same for photoshop. The real solution of dialogs: more energy effective hardware and memory, 2GB more memory, language model trained for game, more human work. Current AI-models still closer to the start of their development, they are very huge, still too complex, still have low energy efficiency. So I hope not for cloud service but for new neural coprocessors. Clouds are great to rent when you do not want to buy overpowered hardware just for 5 week in the year. And you need to deal with certain task. But not for constantly used real-time software.

Run game by cloud ?? lol .. NO THANK YOU.

Bro talks one word at a time

Nah this is just crazy

What a time to be gay

Bro all of this is old news, you're just regurgitating it for easy revenue.

first lol

You will own nothing and be ...

First 🥇🎉

Sucks to be a voice actor.

i cant listen to this pronounce

This is a low level for your channel. Nothing more than Nvidia propaganda here.