Play: The Hertzian Collective by Geoffrey Shea

March 29, 2010
Written by
Twilio
Twilion

Twilio Bug Logo

Congratulations to Geoffrey Shea, creator of Play: The Hertzian
Collective, a musical sound game/toy created with projected video images
and played collectively by viewers on their mobile phones.

For the past two weeks, we've run a developer
contest category
for phone controlled multi-player games, and among
the fun submissions the Hertzian Collective struck us as the most
unique and impressive installation.

What is Play: The Hertzian
Collective?

Visual rhythms and a spoken text explore schoolyard
games: the structured and unstructured play we invented as children. 
Arranged in three groups of overlapping, circular, video-projected
images, rhythm sequences are controlled by viewers dialing a toll free
phone number and selecting beats by pressing buttons on their keypad.


Inviting
and participatory, structured something like a primitive musical
instrument or an elaborate clockwork toy, visitors with mobile phones
take control of some part of the action or another. Exploration quickly
gives way to jamming and collaboration as each player realizes that they
are sharing control with other viewers standing nearby.

This is a
video of some people playing:

Created at the Mobile Experience Lab (www.mobilelab.ca) at the Ontario
College of Art & Design by Geoffrey Shea with software development
by Rob King.

Interview with Geoffrey Shea

How did you get into building interactive
art like the Hertzian Collective?

I've been working in the Mobile Lab at OCAD with software artist Rob
King for several years on a range of playful projects, some of which you
can see here: www.mobilelab.ca.
In specific, together with the rest of the team, we did the Cell Phone
Xylophone (a musical instrument) and Tentacles (a game) which used
pretty convoluted phone to network patches. We'd need to get a phone
number, connect to online VOIP services, send user controls to a PBX
server, forward those commands through a VPN to the on-site controller,
etc.

How did you
hear about Twilio?

When I talked to Rob about
starting to set that all up for Play:
The Hertzian Collective, he suggested we just use Twilio, which cut the
complexity at least in half. He had already used it in some other
projects and so was confident that it would do the job. Part of our
initial objective was to make it as accessible as possible, so we wanted
any cell phone at all to work as an interface. Not just for the 10-20%
of people with smart phones.

What
technology/gadgets/languages etc. did you use to build the app?

Play:
The Hertzian Collective actually incorporates a lot of elements
that you could find in the other Mobile Lab works and in my own work as
an artist and musician. It's like a big, publicly installed rhythm
sequencer. People who come by see the set of video images projected onto
overlapping disks and the rotating heads and then see that they are
encouraged to dial up and take control. Three different phone numbers
connect to three different sets of controls: one for the 8-disk music
sequence, and two to control the two talking head poets. After playing
around and figuring out how the whole thing works, you finally realize
that you're actually jamming with other players who have dialed in, to
make a collaborative sound/text mash-up. (That's the Collective.
Hertzian because it's on radio waves/phones and sound waves. And Play
because it is half game and half instrument.)

How long did it take to build?

Between writing the
text, recording the music and performers, building
the projection surface, programming the display in vvvv and the network
communication in Python and Twilio, we spent about six months putting
the whole thing together.