Ubisoft Tests Generative AI in Teammates

Imagine talking to characters in a game and having them respond instantly to your words, as if they were real teammates. That is exactly what Ubisoft is testing in the Teammates project, which builds on the earlier Neo NPC experiment presented at GDC 2024. This playable research project explores how generative artificial intelligence (AI) can improve the player experience through real-time voice commands and dynamic character behavior. Teammates features an AI assistant named Jaspar and two NPC companions, Pablo and Sofia, who support the player and respond to their voice instructions.

The team behind the project, including Generative AI Gameplay Director Xavier Manzanares, Narrative Director Virginie Mosser, and Data and AI Director Rémi Labory, share their perspectives. The goal is to test the limits of player interactions through natural speech, improve immersion, and explore unique features that would not be possible without this technology. According to them, Teammates differs from other AI projects by focusing on deeper player engagement.

Teammates Is an Experimental Game

Teammates is primarily a research project, but players can try it out. It is built around first-person shooter mechanics, with the player taking on the role of a resistance member in a dystopian future. The objective is to sneak through an enemy base and find five missing team members. In the short playable level, players must collect the final memories of those who came before them to discover their fate while defending themselves against groups of enemies. In addition to the AI assistant Jaspar, the player is accompanied by two NPC teammates, Pablo and Sofia, who have advanced AI-powered abilities.

The game takes place in an action-packed environment where players face enemy patrols. For example, in the opening scene, they encounter two guards but do not yet have a weapon. They must therefore use their voice to tell Sofia and Pablo to hide behind nearby cover, then give them precise instructions on when, how, and whom to attack. The player’s voice directly affects how the situation unfolds and how the battle ends.

Jaspar Is More Than Just an Assistant

Jaspar is an AI assistant that goes beyond standard functions. It can mark enemies or objects, provide details about the story and game world, change game settings during gameplay, or even pause the game—all based on simple voice instructions. In addition, Jaspar is a dynamic character in the story. The system processes information from the surroundings in the Teammates experiment and contextual cues, allowing it to interpret and adapt to the player’s voice input and actions.

Xavier Manzanares describes how Jaspar emerged from the initial tests: “Our early experiments revealed that players quickly connected with AI-driven NPCs and the concept of a voice assistant. Jaspar helped players when they got lost or did not know what to do, could open menus and settings, and talk about the world and the story. We really grew fond of Jaspar and saw how a system like this could be interesting for many different types of games.”

Voice Commands

The same technology also powers the two NPC companions, Sofia and Pablo. Like Jaspar, they can be controlled directly by voice or spoken to, with the difference that Sofia and Pablo physically exist only within the game world. Players can give them commands such as attacking a specific enemy or taking cover, and they respond in real time.

Virginie Mosser emphasizes collaboration with the technology: “We hope players will feel that they are creating the story themselves, not merely watching it. When I speak to Sofia, she responds to what I say, and that changes my experience. To me, this is a real breakthrough and allows players to experience the story in their own way.”

Rémi Labory adds: “This technology opens the door to new, personalized experiences. Player input shapes character responses in real time, something traditional development cannot achieve. We are also delivering a complete process that guides players from the introduction through to the final evaluation, which is new.”

Why AI Is Key

The team is aware of the criticism surrounding AI in the gaming industry, where companies such as EA and Krafton are making major moves, while developers fear job losses and the loss of the human element in design. The goal of Teammates is not to replace creators, but to empower them by combining the strengths of technology with human creativity.

Virginie Mosser admits: “At first, I had the same concerns as many others. But I discovered that the opposite is true—it does not remove humans from the process. I still write the story and the characters’ personalities, but instead of fixed lines, we create boundaries that allow NPCs to improvise within the game world while staying within the lore and motivations we have given them. They can improvise, but we still set the rules and guide the story and characters.”

The team is dedicated to research and testing to push the boundaries of what is possible. They want to expand the ways players interact with games and create deeper experiences with stories and character interactions through AI. Teammates has already been tested by several hundred players in closed tests, and their feedback is shaping its continued development. They plan to continue testing, building tools, and gathering feedback from real players and creative teams at Ubisoft to improve the systems. All of this is being done with an emphasis on human creativity, ingenuity, and curiosity. They are also preparing an explanatory video about the project, so stay tuned for updates.

Additional source: decrypt.co