Welp, NVIDIA has finally lost it as they are going to stuff NPCs in games with actual intelligence through its latest project Avatar Cloud Engine (ACE).
As a custom AI model foundry service, it has the capability to integrate AI-powered natural language interactions into the beautifully crafted world of various games to create customized speech, animation, and conversation for additional immersion into the lore and settings.
The use of Generative AI here revolves around 3 main parts – NVIDIA NeMo handles the foundation of the large language model, NVIDIA Riva for automatic speech recognition and text-to-speech, and NVIDIA Omniverse Audio2Face that generates realistic face movements that correspond to the words being pronounced.
One of the first collaborations showed off is with NVIDIA Inception startup Convai on how to harness NVIDIA ACE for Games as a developer. For your information, Convai specializes in cutting-edge conversational AI for virtual game worlds with its end-to-end real-time avatar platform integrating ACE modules for realistic and smart NPCs.
As a result, the demo showed the generative AI-augmented NPC Jin replying to natural language queries in a “human” way while sticking consistently to the narrative backstory.
Aside from tech demos, Team Green also confirmed that NVIDIA ACE for Games not only supports running locally via GeForce RTX-equipped PCs but also in the cloud with one of the ways being NVIDIA DGX Cloud.
Regardless of which one, both of them are optimized for latency so that every interaction performed in the virtual world is immersive and responsive.
