NVIDIA & Inworld AI demo on-device capabilities for AI agents in video games

During GDC 2024, we worked with NVIDIA to develop Covert Protocol, a demo that unlocks social simulation game mechanics using Inworld’s AI agents.

Today at Computex, we’re unveiling the next phase of our work together, with a hybrid deployment of Covert Protocol that brings NVIDIA Riva Audio Speech Recognition (ASR) and NVIDIA Audio2Face on-device for an even faster player experience and economical deployment costs.

In the video, we give a deep dive into the various models and systems powering interactions with our AI agents. In this scene, the player has found a conference badge lying around the hotel, and decides to re-approach Diego, who is the conference keynote speaker and has previously been dismissive. Watch how Diego’s demeanor changes after the player pretends to be a conference attendee, rather than a random tourist.

Covert Protocol is just one example of how developers can take advantage of hybrid deployments to integrate advanced AI capabilities into their games. As more powerful multimodal and language models become smaller and more efficient, the future of on-device AI for developers feels not just promising, but inevitable.

Learn more about how we created this demo:

🎮 Learn about AI-powered gameplay: https://bit.ly/49mSJ3V
🛠 Build with dev docs: https://bit.ly/3VFNeKF

#gaming #gamedev #gamedevelopment #games #gaming #indiegames #artificialintelligence #aicharacters #chatbot #chatbotdevelopment #unrealengine #unity #unitygameengine #oculus #metaverse #avatar #virtualreality #madeinunreal #virtualcharacter #madeinunreal #gpt3 #gpt4 #naturallanguageprocessing #chatgpt #chatgpt #globalgamejam #inworld #npcs #AINPC #NPCAI #chatGPT #nvidia #ondevice #aiagents

Скачать видео