Sony Leaks AI Aloy Video Demo

An internal leak has surfaced showing Sony testing AI-enhanced PlayStation characters.

News outlet The Verge uncovered an internal demonstration video reportedly produced by PlayStation Studios' research division, featuring Horizon's protagonist Aloy to showcase AI-driven character interactions.

The video was later removed from YouTube after receiving a copyright strike from enforcement firm Muso, which works with Sony Interactive Entertainment. IGN has reached out to Sony for official comment.

According to The Verge's report, PlayStation software engineering director Sharwin Raghoebardajal converses with an AI-powered Aloy using voice commands and computer-generated responses complete with synthesized facial animations.

The technical implementation uses OpenAI's Whisper for speech recognition, GPT-4 and Llama 3 for conversational logic, Sony's EVS for voice synthesis, and the company's Mockingbird system for facial animation.

During the tech preview, Raghoebardajal asks how Aloy is feeling, prompting the response: "Hello, I'm managing alright. Just dealing with a sore throat. How have you been?"

Notably, the voice doesn't belong to original actress Ashly Burch, instead using a robotic TTS voice common in social media content. The AI Aloy's facial expressions appear rigid during the exchange.

When questioned about her search for her mother, the AI responds: "I discovered I'm a clone of Dr. Elizabeth Sobeck, which led me to understand my purpose and origins."

The prototype then transitions into Horizon Forbidden West's game world for continued conversation during gameplay - creating an odd dynamic where players converse with a character they control.

PlayStation 5 Game Rankings

Vote for your favorites

New matchup

View results or continue voting

This prototype, developed in collaboration with Guerrilla Games, represents Sony's internal research efforts. Raghoebardajal states this demonstration shows "just a glimpse of what is possible," though Sony hasn't confirmed plans to implement the technology in consumer products yet.

The development aligns with industry trends, as competitors like Microsoft actively pursue AI applications in gaming. Xbox recently unveiled Muse, an AI system designed to generate game design concepts.

While generative AI remains controversial in gaming circles due to ethical concerns and quality issues, major publishers continue exploring its potential. Electronic Arts considers AI fundamental to operations, while Capcom tests the technology for environmental design concepts.

PlayStation Productions head Asad Qizilbash addressed AI's role in gaming, noting its importance for younger demographics: "Gen Z and Alpha audiences expect personalized experiences. AI could enable NPCs to dynamically respond to player actions, creating deeper immersion."

This debate follows Activision's acknowledgment of using generative AI for certain Black Ops 6 assets, which received mixed reactions from players.