AI-powered PlayStation characters are being tested at Sony — what we know

Horizon Forbidden West on PC
(Image credit: PlayStation Studios)

AI is pretty much everywhere right now, and it was only a matter of time before game developers started leaning on the technology as well. According to The Verge, one anonymous source has shared an internal video from PlayStation showcasing AI-powered game characters — specifically Aloy from Horizon Zero Dawn.

The video was shared on YouTube, but has since been pulled due to a copyright claim from Muso — a copyright enforcement company. However The Verge does detail what was allegedly present in the video, alongside a GIF of the AI-Aloy in action.

If that small clip is representative of the stage this tech is at, it definitely needs a little more work before it’s implemented in real games.

AI characters could be coming, but they’re not ready yet

playstation AI NPCs featuring aloy from horizon zero dawn

(Image credit: Sony)

The demo video is narrated by Sharwin Raghoebardajal, a director of software engineering at Sony Interactive Entertainment. Raghoebardajal works on video game technology, which includes AI, and uses the video to demonstrate an AI-powered version of Aloy.

The demo uses a combination of AI-powered synthesized voice and facial movements. Technology utilized included OpenAI’s Whisper for speech-to-tech, GPT-4 and llama 4 for conversations and decision making and some of Sony’s own internal tech. The Emotional Voice Synthesis (EVS) system generates speech, while the Mockingbird technology turns the audio into facial animations.

This allows the player to have an actual conversation with Aloy, using a number of in-game prompts. Though the results are a little uncanny, and it’s likely that this is why the video emphasizes that this is just a prototype, it proves that something like this could be possible.

As The Verge notes, this technology was first showcased internally around a year ago, before a more advanced version was shown at the Sony Technology Exchange Fair back in November. The demo is running on PC, but Sony has apparently been able to get some of this tech running on PS5 consoles with "little overhead".

Sony isn’t alone in this

The PlayStation logo on a PS5 Pro

(Image credit: Future / Tom's Guide)

Sony isn’t the only company to be dabbling with the idea of using AI to power characters inside video games, nor is this a particularly new idea. I’m reminded of a section from The Salmon of Doubt, which reprinted an AV Club interview with author Douglas Adams.

Speaking about the game Starship Titanic, Adams lamented the fact that the game wasn’t able to construct its own text-to-speech sentences “on the fly” without making characters sound terrible with poor quality audio. Eventually, this led to the game using pre-recorded lines and the limiting the amount of responses the player could encounter.

Almost 30 years after its release, it seems AI could easily have made Adams’ initial goal a reality — and the rest of the games industry knows it. Not only is Sony apparently working on adding AI characters to its games, so are NVIDIA and Microsoft.

Sadly while Adams seemed focused on crafting unique experiences for the player, for the love of the game and story, there are concerns that the big corporations are just concerned with profit.

If I worked at a video game studio, or as a voice actor, I’d definitely be concerned that the higher-ups would want to replace my work with AI-generated equivalents. And, as reported by GamesRadar, that's why many voice actors are currently on strike.

We’re just going to have to wait and see how all this pans out in the coming years.

More from Tom's Guide

Tom Pritchard
UK Phones Editor

Tom is the Tom's Guide's UK Phones Editor, tackling the latest smartphone news and vocally expressing his opinions about upcoming features or changes. It's long way from his days as editor of Gizmodo UK, when pretty much everything was on the table. He’s usually found trying to squeeze another giant Lego set onto the shelf, draining very large cups of coffee, or complaining about how terrible his Smart TV is.

You must confirm your public display name before commenting

Please logout and then login again, you will then be prompted to enter your display name.

Read more
Xbox Copilot Prototype
I write about video games for a living, and Xbox's new AI Copilot has me concerned
Nvidia ACE
I played with Nvidia's AI NPC prototypes — now they're real, and I fear I'll never finish a game again
OmniHuman screenshot of AI generated video
TikTok parent company just launched stunning AI video generator — OmniHuman-1 is taking the world by storm
Shutterstock Sora image
OpenAI just announced that its Sora AI video generator is coming to ChatGPT
Sam Altman
OpenAI takes aim at authors with a new AI model that's 'good at creative writing'
Sora
Forget Sora — here's the 5 best AI video alternatives you can try today
Latest in Playstation
The PlayStation Portal on a counter with the start screen for Horizon Forbidden West
PlayStation Portal just got upgraded cloud streaming features — here’s what’s new
God of War Ragnarok
PlayStation’s epic March sale is live with PS5 games from $3 — here’s 17 deals I’d buy
Horizon Forbidden West on PC
AI-powered PlayStation characters are being tested at Sony — what we know
The Last of Us Part I screenshot with a Tom's Guide deal tag
PlayStation launches new sale with big discounts on essential PS5 games — here’s my 17 favorite deals from $2
PS VR2 headset with PS VR2 Sense controllers
PlayStation VR2 getting a $200 price drop in March — is it worth buying now?
The PlayStation logo on a PS5 Pro
Ex-Sony executive predicts the PS6 will arrive in 2028 — what you need to know
Latest in News
NYTimes Connections
NYT Connections today hints and answers — Wednesday, March 19 (#647)
Chromecast with Google TV connected to display
Google finally pushes out full Chromecast fix for users who factory reset — here’s what to do
A picture of a skull and bones on a smartphone depicting malware
Hundreds of malicious Android apps with 60 million downloads found spamming Android users with ads and stealing credentials
Switch 2 console and logo
Nintendo Switch 2 rumor just tipped possible release date — and it's much sooner than we thought
Hacker typing on laptop in darkened room
Hackers create "BRUTED" tool to attack VPNs – how to stay safe
Malware
Dangerous new password-stealing trojan automatically reinstalls itself on infected PCs