This Skyrim mod that makes NPCs AI chatterboxes just got a massive overhaul

Skyrim’s got a lot of NPCs. Thing is, most of ’em are dolts. They don’t have any kind of distinct personality or routine, and sometimes do the dumbest stuff imaginable. I’ll never forget the time a dragon flew down to attack me near a settlement, destroying some fencing in the process, and the entire town swivelled before charging towards me, daggers drawn, completely ignoring the massive dragon in their midst that had actually caused the damage.

In recent years Skyrim’s peerless modding scene has seen various experiments incorporating AI elements into the game, with varying results: PCG’s Chris Livingston took a ChatGPT-powered Skyrim companion for a test drive and it nearly got him killed by repeatedly failing to solve the game’s easiest puzzle. Another that’s been around since 2023 is Mantella, which uses various AI LLMs alongside speech-to-text tech to enable NPC conversations, and last week received a major update.

Mantella boasts NPCs that “have memories of your previous conversations, are aware of in-game events, have vision, and can even perform actions.” You can see an example of a conversation below (which is from a version before this patch) and, yeah, it’s stilted in places and the voicework is clearly rudimentary computer babble: but it works.

Here’s another, showing an NPC follower being scornful about the player’s dance moves.

Installing Mantella is fairly straightforward (here’s an installation guide, and a collection of community resources), and the new version (0.14) improves nearly every element of it, focusing particularly on NPC awareness and how they interact with the world. Among the improvements made in this version are:

• Advanced actions—Mantella can now trigger complex in-game actions. Actions can now be triggered in multi-NPC and radiant conversations. Advanced actions can be enabled in the `Actions` tab of the Mantella UI
• Nearby NPC tracking—Nearby NPCs are now added to the context and can be targeted by actions
• Combat targets are now tracked, and their deaths are added to the context
• Vanilla dialogue awareness—Vanilla dialogue interactions are now added to the LLM’s context
• NPCs can approach the player and start a one-on-one conversation (disabled by default)

This version also supports group conversations involving up to five NPCs, with the winning detail that they’ll no longer bellow across the room at each other, but group up like people would when talking.

A user with the un-improveable name BongChompsky says: “How do the voices work…? How on earth is the AI able to use the NPC voices so well? Is it because Skyrim is so thoroughly data-mined? I was shocked to hear some voices from Mod NPCs as well. Strangely, Hjoromir from Interesting NPCs has Aval Atheron’s voice… the dark elf who sells meat in Whiterun, lol. Like some others have posted, I am floored by this mod.”

If I can offer a more sceptical take, Mantella definitely points towards one future path for mods in particular, and it is an undeniably impressive production that can surprise you unexpectedly. But this isn’t a revolution so much as an extremely cool gimmick, one that puts me in mind of that AI cliche about it being as wide as the ocean but as deep as a puddle. Mandela brings something new and different to a world we’re all so familiar with, but this is still very much a work-in-progress.