youtube.com/@SushidadVideos in your workflow, how/when do you pass the stock info to the LLM? It knows about what items it already has in stock, and even comes up with alternative suggestions to your inquiries (i.e. Starfury 5000 instead of Firefly 3000). So the info about the items in stock don't look like they are being made-up by the LLM. The conversation is generated on the fly, I get that, but how do you provide the info about the items in stock to the LLM?

Impressive, but most of stuff it says about the products and its use and all just made up and not part of the actual game?

Amazing work, this opens up many different ways to make RPG-style gameplay and many other games I am sure. However, how practical would this be for a development team of all sizes? What is the Cost for Auto AI to speak each time and the length of multi commands if the game is online multiplayer setup?

How’s the product he’s talking about appearing on the screen?

How did you make it trade stuff?

this is very cool but can we use our own chatapi instead of chatgpt?

Ai generated Speech will both revolutionize gaming but will also kill the Voice acting industry. And also in the same vain as "Minority Report", Ads will be tailored to the individual and will become nauseating in time!

I would love this as an in game AI computer in No Mans Sky. Kinda like a real Cortana in the game as it can it kinda boring and tedious sometimes.

This us amazing, but you have to be editing the video.. right? I mean, all of the test with this I've seen online have a delay of at least 10 seconds and your wait time is under 3 seconds. Can you confirm you edited the video or if not, what kind of tricks are you using?

Future game exploits will just be people gas lighting NPCs into giving you stuff for free lol

Now imagine if the AI could give you quests. Objectives to do, people to talk to, things to put in the ground. You could make a good procedurally generated game that never runs out of content.

Tutorial by any chance?

Using your headset to talk to NPC's is a weird concept, but possible in the near future. Goddamn, gaming is going to be weird in a few more years lol.

Welcome to the future folks.

RIP Kevin

That puppy pun was magical

A future Mass Effect with tech like this would be pretty neat. I still think incorporating dialogue written by humans will always be important, but having tech like this mixed in would be super dope.

Detroit become Human + ChatGPT

Make the robot execute actions

are you going to release it?

Amazing. Future of games is bright. I wanr to play it. I want make games with it. You dont even need do more things in it. I want to buy it now. Just show how. This is a complete game alredy

what a great project man ! i am looking forward for games with feature like this one.

incredible idea. for improving the player experience you could implement an animation like.. the screen on its face lit up of a colorwhen listening and another one when talking, so that the player understand that the npc is listening. just an idea

What a time to be alive. Cant wait to verbally abuse women in game and have them realistically respond

"That's just kevin" 💀

It's mindblowing

This timeline is insane. I grew up on super Mario bros.

This is amazing, congratulations

I'm with a new company called Skynet looking for some willing participants in AI research. We will be developing machine behavior profiles to make them seem more.. human like. Let us know if you're interested in joining the team!

Did you have to add anything additional to the prompt to get this to work this well? It’s very fun to see.

I have a personal prediction that FGPA ai accelerator cards may become a thing in the future

To fix the lag, you can make it so the npc talk while the text is generating. Basically talking while thinking

This in elite dangerous. Please!

Creators: make a "lore bookshelf"(data table) that let's you put in "books"(lore strings) created through prompting AI with game knowledge, and let the npcs use certain "books" as dynamic knowledge they can draw from about the game. Use Alpaca instead of gpt for game character AI chatbot, and "train" it on your game knowledge to let the NPCs feel more real.

I would love to see what great games can be made with this kind of AI. I am excited for both small inde proyects and big AAA games with this technology.

niceee

Wow! Can you please make a tutorial on how you got the NPC to have a custom knowledge base and personality?

Do you have a patreon? This is what I have dreamed of doing for years, so I would be happy to join a membership or pay for a detailed up to date video guide on this. Let me know :)

Robotic voices dont do it for me, regardless of how well the AI works.

Hey, I am interested in doing something similar for my school project. Your project looks really cool. Which prompt did you give to OpenAI exactly at the start?

Awesome proof of concept!

looks awesome. now just add ElevenLabs voice to a more natural speech hehe. With llama/alpaca there is the possibility to run a language model locally , the only problem is that the game will need a lot more RAM, but hey it will be a game with a intelligent entity in the code!

This is a great proof of concept! I wonder how soon it would be possible to not rely on the internet and to be able to train different kind of characters in different moods.

This is unreal.... so frickin' cool. The future is now

Very cool!

This is amazing, you’ve done great to figure out how to get this integrated, thanks for sharing! I’d like to try adding it to an NPC in my game. Could you please do a step by step tutorial on how you’ve set this up with GPT and other details of your setup. That would be awesome!

Incredible work, this is very inspiring!

Hi! some weeks ago I tried to do something similar using the KellaM plugin but I didn't achive make it work with the Chatgpt API, do you know if it's needed to purchase some tokens or something to make it work?

:) the future of school.