Tag Archives: aivoice

Tooling for expressive TTS

Over the last several years I’ve been working on a number of ways to make computer generated speech more expressive.
Not just a bit, but radically more so.

A Christmas Carol - audiobook excerpt

Several years ago before the Cambrian explosion of neural speech models – I spent a lot of time working on parametric synthesis. The thought being that one could animate speech in the same way that Pixar animators manipulate wireframe models to create the illusion of life in CG characters. This work resulted in a couple of patents which have since been outpaced by the rapid development in machine learning and neural speech synthesis.

Once spline control of parameters became obsolete, I switch my focus to developing better tools for managing large scripts and multiple takes of a large cast of characters. The most recent incarnation of this is tied to the open source TTS package “Chatterbox Turbo” from Resemble.ai.

As a proof of concept, I wanted to use these tools to create a long form excerpt from “A Christmas Carol”. I designed a pleasing narrator voice, and an appropriately grumpy one for Scrooge.

ChatterWolf

Recently I’ve gotten fascinated with a game called Werewolf – which is based a similar social deduction game “Mafia”. Players have limited information and have to talk amongst themselves to try and figure out who did what to whom, and who knew what when, before time runs out.

This is all an outgrowth of my decades-long obsession with speech driven entertainment. Modern players are increasingly drawn to games that talk back. With the advent of real-time text-to-speech rendering and emotionally adaptive voices, a new class of voice-forward games can deliver immersion and intimacy unmatched by traditional click-through dialog trees. This framework delivers up-to-the-minute world-aware, character-centric dialog, allowing each NPC to feel alive, distinct, and self-aware.

Social Deduction Games are interesting. A number of studies have been released that look at Werewolf and games like it as a measure of how effectively LLMs can keep track of imperfect information and reason out solutions amongst themselves. Games like Werewolf, Mafia, and Spyfall depend on the core tension between what players know and what they pretend they know. Modeling this requires support for misinformation, asymmetric perception, and role-aware deception. This enables each character to operate within their own worldview – capable of lying convincingly or expressing genuine uncertainty – all while maintaining logical consistency with prior actions. They’re not perfect, but the debate can take surprising turns on occasion.

“The Harbor House Affair” – a 1930’s Who done it?

The beauty of the simple Werewolf mechanic is you can map any number of settings and mappings to the framework.


1. Arctic Research Outpost (Cold War, 1962)
Setting: An isolated American research station on the Greenland ice sheet. Long nights. Radio static. Everyone’s trapped.
 
Dr. Elaine Mercer – Station director. Calm, controlled, visibly exhausted. Career scientist whose last posting ended abruptly after an “equipment failure.”
Walter Briggs – Mechanical engineer. Gruff, practical, distrustful of theory. Knows the station’s systems better than anyone.
Yuri Volkov – Soviet “exchange” scientist. Polite, reserved, observant. His credentials check out… mostly.
Anne Carlisle – Young meteorologist. Nervous, defensive, eager to please. Keeps meticulous logs, sometimes too meticulous.
Father Thomas Keene – Chaplain and morale officer. Warm, articulate, oddly perceptive. Claims to be here for “spiritual support,” but asks very pointed questions.
 
Killer reskin: Saboteur / infiltrator
Seer reskin: Analyst / profiler / confessor
Swapper reskin: Technician rerouting access, logs, or credentials
 

2. Luxury Transatlantic Liner (1935)
Setting: Mid-Atlantic, three days from New York. First-class glamour above, locked doors and rumors below.
 
Margaret Ashcroft – Wealthy widow traveling with too much luggage and no clear destination. Socially adept, emotionally opaque.
Henry Bell – Ship’s purser. Impeccably polite, knows everyone’s business. Keeps records others assume are private.
Lucien Moreau – European art dealer. Smooth, charming, evasive about his past clients.
Clara Finch – Young governess escorting a child who never seems to appear. Easily flustered, deeply observant.
Samuel Reed – Retired naval officer. Straightforward, rigid, uncomfortable with ambiguity. Watches routines closely.
 
Killer reskin: Assassin / blackmailer
Seer reskin: Information broker / reader of people
Swapper reskin: Thief switching cabins, papers, or identities
 

3. Desert Cult Compound (1978)
Setting: A remote spiritual commune in the California desert. Solar panels, white robes, whispered doubts.
 
Evelyn Cross – Charismatic leader. Soft-spoken, reassuring, never raises her voice. Knows everyone’s weaknesses.
Jonah Pike – Head of security. Protective, suspicious of outsiders, deeply loyal to Evelyn.
Maribel Santos – Recent arrival. Idealistic, conflicted, struggling with doubts she tries to hide.
Caleb Wright – Accountant and logistics manager. Quiet, precise, uncomfortable with improvisation.
Ruth Holloway – Elder member. Maternal, observant, remembers “how things used to be” before the group grew.
 
Killer reskin: Enforcer / true believer
Seer reskin: Confessor / spiritual guide
Swapper reskin: Manipulator of assignments, rituals, or blame
 

4. Deep-Space Salvage Ship (Late 22nd Century)
Setting: A long-range salvage vessel towing a derelict alien craft. Corporate contracts, minimal oversight.
 
Captain Rhea Solano – Pragmatic, mission-focused, under pressure from corporate HQ. Hides how much she knows.
Ishaan Patel – Xenotech specialist. Brilliant, distracted, emotionally detached. Obsessed with the alien hull.
Mara Vance – Security officer. Cynical, alert, assumes the worst of everyone—including herself.
Leo Kincaid – Systems operator. Friendly, talkative, eager to help. Knows the ship’s internals intimately.
Dr. Yelena Orlov – Medical officer. Calm, incisive, unsettlingly perceptive. Notices changes others miss.
 
Killer reskin: Infected crew / alien agent
Seer reskin: Diagnostic expert
Swapper reskin: Systems tech rerouting permissions or sensor data
 

5. Small-Town Political Campaign (Modern Day)
Setting: Final week of a heated mayoral race in a dying Midwestern town.
 
Diane Keller – Candidate. Polished, relentlessly composed. Keeps her real thoughts well hidden.
Mark Feldman – Campaign manager. Tense, sleep-deprived, constantly calculating risk.
Rachel Nguyen – Volunteer coordinator. Earnest, observant, hears things people assume don’t matter.
Tom Wilkes – Local radio host. Folksy, probing, knows the town’s secrets.
Eddie Morales – Data analyst. Quiet, precise, socially awkward. Knows far more than he lets on.
 
Killer reskin: Saboteur / opposition plant
Seer reskin: Journalist / data analyst
Swapper reskin: Operative manipulating information flow