NVIDIA has introduced a new set of AI—based tools – NVIDIA Avatar Cloud Engine for Games. It will help developers create more lively non-player characters.
Now there are three key technologies in the set:
▪️NVIDIA NeMo. A language model that allows you to generate meaningful replicas.
▪️NVIDIA Riva. Automatic speech recognition of the player and text-to-speech conversion of replicas.
▪️NVIDIA Omniverse Audio2Face. Generation of facial animations depending on the audio track.
According to NVIDIA, these AI technologies are already being used by developers. For example, GSC Game World in S.T.A.L.K.E.R. 2: Heart of Chornobyl and Fallen Leaf in Fort Solis.