NVIDIA GTA 5 mod lets you talk to every NPC in cloned voices with under 1 second latency ANDROID Redmi K100 confirmed for October 27 launch with 165Hz display and Snapdragon 8 Elite ACCESSORIES Thanko launches USB-powered heated gaming gloves for around $22 ACCESSORIES Godox A2 brings 1/8,000s sync xenon flash to iPhones for around $85 AMD Lenovo ThinkCentre M75t Gen 6 adds Radeon RX 6400 graphics in Eurozone, UK, and Singapore GAMES Arkham Horror The Card Game Second Season Gets Blood Token Mechanics in New Russia-Exclusive Campaign DLSS Super Meat Boy 3D update adds DLSS and FSR support alongside crossover character GAMES Mass Effect Legendary Edition multiplayer restored by community mod with 66 characters and 19 maps INTEL Xiaomi Redmi Book 16 2027 swaps Core Ultra for Wildcat Lake Core 5 320 for better battery life ACCESSORIES WALLHACK SP-005 Berserk glass mousepad launches worldwide for $139 GAMES Cosplayer Maria Davydova Brings Baldur’s Gate 3’s Dark Urge to Life in Dark Fantasy Photoshoot STEAM Cleaner Company launches January 26 with four-player co-op sci-fi cleaning chaos STEAM Taskey’s Midnight Toybox turns a child’s bedroom into a deadly board game GAMES The FINALS update makes the announcer call out your actual player name

GTA 5 mod lets you talk to every NPC in cloned voices with under 1 second latency

Owen Carter 0 comments 2 min read

Universal Modder releases NPCTalk, a GTA 5 mod that lets players speak to NPCs in cloned voices with under 1 second latency using NVIDIA and Cerebras AI.

GTA 5 mod lets you talk to every NPC in cloned voices with under 1 second latency
GAMES

NPCTalk, a new GTA V mod made by Universal Modder, introduces AI modding by allowing the user to speak into their mic to get NPCs to talk back at them in their cloned voices. This new mod fundamentally changes player interaction in the game by introducing real-time voice interactions on top of existing text-based dialog choices. Will this level of immersion continue through active gameplay, though?

GTA 5 character using voice interaction mod
NPCTalk enables real-time voice interaction with Grand Theft Auto V NPCs.

Universal Modder's NPCTalk brings real-time AI voice interaction to Grand Theft Auto V

NPCTalk combines multiple AI models to process your voice and provide responses. For speech recognition it utilizes Nemotron from . As for the language model to generate responses, that's a Cerebras-hosted model.

Finally, voice synthesis comes from Fish Audio's Drama 3 model. It's all processed with the inference running on rented modal cloud gpu's to manage the computing power.

According to Universal Modder, the system can generate responses in less than a second. It also ensures that the NPCs remain true to character and mimic their physical gestures. The mod creator said that he got every NPC in GTA 5 to reply in their cloned voice and portray what you're saying.

NPCTalk requires Script Hook for it to work. This is a very important technical dependency for the interaction to occur.

Next week, Universal Modder will be releasing a free and playable version of NPCTalk to users around the world. However, he does explicitly say that it doesn't work for GTA Online as Script Hook isn't allowed in the multiplayer game. So, expect that this is something that will only be useful when playing in single player mode for the campaign.

With real-time speech recognition and dynamic voice synthesis, NPCTalk provides real-time speech recognition and voice synthesis for AI game modding. The next release will provide a chance to assess the stability and latency of the cloud-based inference solution. We'll get to see how the mod performs when multiple requests to NPC's are processed at the same time in the next release.

Source: TweakTown

NVIDIA

Related stories

Discussion

0 comments

Leave a comment