Voiced characters that use generative AI in real time instead of prerecorded lines and a dialogue tree come to mind as an obvious use. How cool would that be, to be playing an RPG and ask any character any question you want and get an actual verbal answer? No way you can do that with voice actors.
Ever seen the game Vaudeville? It’s a fairly basic detective game but all the characters have their own LLM and AI voices. I bought it for the reason you described. I just had to see the technology in action and I can definitely see a future with generative text/voices in games.
It’s not perfect by any means but I think it’s a very cool approach to a detective game. There have been updates to it since I played that address most of the problems I had with it like characters forgetting past conversations and giving conflicting info.
I had spitballed an idea similar to this a few months back. Build the characters, world, and situations, and give the AI that information. Pick a few specific pieces of info the AI would have to tell you at specific times, basically to act as guide rails. Then, let the AI and the player just… Interact.
That’s pretty much Vaudeville. The only things you can do is click on locations and talk to people, each of whom has some bit of information you need to figure out.
It’s basically an experiment to see what works and what doesn’t with the idea. I appreciate that they kept the scope small (no quests, no WASD movement) and have been implementing changes as they discover the shortfalls (like the ones I’ve mentioned). If it ever does get released as a finished game, it’ll be more like a proof of concept for other games to build off of.
I find it to be very off putting that Baldur’s Gate 3 doesn’t have voice actors for the main character.
There are so many different races that would have different voices and different accents that it wouldn’t be financially viable to do that with voice actors either.
The only real ethical concern is around the training data. If all voices are compensated / actively consent to be used in an AI program, then this is just a tool. People losing jobs doesn’t really matter to an individual company. Industries change and technology advances.
So the real problem is they are using these types of tools, built of the skill of other voice actors, without properly compensating them or getting their consent.
Do you have any source for those claims? There are plenty of better reasons to develop voice synthesis than replacing voice actors.
Voiced characters that use generative AI in real time instead of prerecorded lines and a dialogue tree come to mind as an obvious use. How cool would that be, to be playing an RPG and ask any character any question you want and get an actual verbal answer? No way you can do that with voice actors.
Ever seen the game Vaudeville? It’s a fairly basic detective game but all the characters have their own LLM and AI voices. I bought it for the reason you described. I just had to see the technology in action and I can definitely see a future with generative text/voices in games.
It’s not perfect by any means but I think it’s a very cool approach to a detective game. There have been updates to it since I played that address most of the problems I had with it like characters forgetting past conversations and giving conflicting info.
I had spitballed an idea similar to this a few months back. Build the characters, world, and situations, and give the AI that information. Pick a few specific pieces of info the AI would have to tell you at specific times, basically to act as guide rails. Then, let the AI and the player just… Interact.
That’s pretty much Vaudeville. The only things you can do is click on locations and talk to people, each of whom has some bit of information you need to figure out.
It’s basically an experiment to see what works and what doesn’t with the idea. I appreciate that they kept the scope small (no quests, no WASD movement) and have been implementing changes as they discover the shortfalls (like the ones I’ve mentioned). If it ever does get released as a finished game, it’ll be more like a proof of concept for other games to build off of.
I find it to be very off putting that Baldur’s Gate 3 doesn’t have voice actors for the main character.
There are so many different races that would have different voices and different accents that it wouldn’t be financially viable to do that with voice actors either.
They originally did for the beta (for origin characters at least) but the players didn’t really like it so the feature was removed
Depends how much you’re willing to spend
The only real ethical concern is around the training data. If all voices are compensated / actively consent to be used in an AI program, then this is just a tool. People losing jobs doesn’t really matter to an individual company. Industries change and technology advances.
So the real problem is they are using these types of tools, built of the skill of other voice actors, without properly compensating them or getting their consent.