Tag Archives: Audio

Interactive Audiobook

A closer look at the audio animation engine developed for interactive fiction.
A closer look at the audio animation engine developed for interactive fiction.
Ever wonder what happened to those text adventure games? You know the ones like “Zork” and “A Hitchhiker’s Guide To The Galaxy”. A paragraph of text would come up on screen. You type in what you want to do, and then you get to read what happens next. Imagine a mobile device with speech in, and multiple channels of audio out. A hands free, eyes free, audiobook that you can push around with speech.

What follows is a short video of the actual working prototype I coded for iOS. The “story” is nothing special, it’s only intended to illustrate the capabilities of the platform – namely the delivery of interactive fiction through complex audio and narration with speech input. Everything you hear in the demo is made up of hundreds of individual sounds being mixed on-the-fly based around what the player/reader does within the story.

Ambient Sound Toy

Here’s an updated incarnation of an older graphic interface for creating and controlling probability-based ambient or rhythmic audio that I built in 2006-ish.

WHAT IS THIS?
PULSAR is a probabilistic sample playback machine. Each row in the rack plays one sound, triggered randomly, on a loop, or manually. Rows run independently — layer as many as you like up to 64. The sound engine runs in your browser using the Web Audio API. All sounds are sample-accurate when using Beat Sync.

At some point, I may make the desktop version of this for ambient installations. Its got multi-channel USB output and MIDI sync capabilities too. But I just haven’t packaged it up yet. One of these days…