Bug Muldoon — Three Ways to Move a Character

Motion Capture

2010 — 2011

Bug Muldoon steps off the keyframe timeline and is performed live. Vicon infrared cameras read face and body, Autodesk MotionBuilder solves the motion onto the character, ORAD tracks the studio camera from a printed pattern on the bluebox wall, and ELSET renders the result in real time. The studio sits on the stage of Theater im Zimmer, a theatre in Hamburg, running since 2004 — lighting truss beneath a stucco cornice, cyclorama behind red velvet.

The bluebox on the stage of Theater im Zimmer, lit, with tracking pattern, lighting truss and three cameras — The ELSET virtual studio, lit and running — ORAD tracking pattern centre-frame, three cameras, and the theatre's proscenium and chandelier above the truss

Toolchain

Studio: ELSET virtual studio, Theater im Zimmer, Hamburg — operating since 2004
Camera: ORAD tracking, reading the printed pattern on the bluebox wall
Render: ELSET, real time
Body: Vicon infrared, rig-mounted beneath the ceiling
Face: Vicon infrared, floor tripods at close range
Solve: Autodesk MotionBuilder
Performers: Martha , body · Sandra , face
Output: Live to broadcast, no render queue

The stage at Theater im Zimmer during the build, cyclorama going in beneath the lighting truss — Build — cyclorama and truss going in

Six Vicon infrared cameras mounted around a single chair for close-range facial capture — Face capture with 6 infrared cameras

Two performers in the bluebox, one wearing body-tracking markers, one wearing facial markers — In the rig — body markers

Close-up of a performer's facial marker array against the blue cyclorama — Face marker array against cyclorama

Clip 03 · Bug Muldoon driven live in the ELSET virtual studio · 0:27 — recorded output, rendered as performed

Generative AI

2026

The same character, the same company, a third instrument. Bug Muldoon: MayDay is generated shot by shot under human direction, from a character this company has owned outright for fifteen years. The pipeline is deliberately model-agnostic: no single vendor can stop the production, and no vendor authored it. What took an animator a week in 2007 and a performer an afternoon in 2010 is now directed.

Bug Muldoon: MayDay — three scenes from the current cut

Production

Film: Bug Muldoon: MayDay — animated feature
Method: Keyframe-led generation, human-directed shot by shot — the model executes, it does not author
Character: Owned outright since 2010–2011. Nothing is generated from someone else's IP.
Authorship: Every shot directed, selected and approved by a named human, logged for the record
Tooling: Model-agnostic by design, with open-weights fallback archived so the production cannot be stopped by a vendor
Status: Storyboard and scene tests

Clip 04 · Bug and the Professor inspect the sting · 0:18

Clip 05 · The Professor, Netta, Jake and Velma — the hypnosis · 0:12

Clip 06 · Slade, the Queen and the wasps · 0:29

	01 · Keyframe	02 · Motion Capture	03 · Generative AI
Years	2007–2010	2010–2011	2026
Motion from	An animator's hands	A performer, live	A directed model
Tracking	—	Vicon · ORAD camera tracking	—
Render	Offline, frame by frame	ELSET, real time	Generated, shot by shot
Output	Finished title sequences	Live to broadcast	Shot-by-shot to edit

Behind the three technologies

A history of real-time simulation in broadcast

Bug Muldoon did not arrive in a vacuum. The people who made him have been building real-time character simulation for television since before the term existed — first as European research, then as broadcast product, then as a permanent virtual studio installed inside a Hamburg theatre.

1975 — 1981

Ampex Video Art

At the New York Institute of Technology, in the late 1970s, pioneering digital paint software was developed by Dr. Alvy Ray Smith (later co-founder of Pixar). Ampex subsequently licensed and integrated this software technology into a commercial hardware system known as AVA (Ampex Video Art), introduced in 1980. Engineering project management for Ampex's AVA system was led by Junaid Sheikh (later founder of ABEKAS). Richard Kunicki, head of VAP (Video Art Production) in Hamburg, Germany, became the first to order the AVA system prototype, bringing state-of-the-art computer graphics technology to the European broadcast market.

1991 — 1995

MONA LISA — European research project R2052

Modelling Images for Synthesis and Animation. Authored by Richard Kunicki and funded by the European Community, carried out by VAP in a consortium with the BBC, Daimler-Benz, DVS, Siemens Thomson and three universities. The project laid the scientific groundwork for real-time simulation; its results were published by Springer Verlag as Image Processing for Broadcast and Video Production, ISBN 3-540-19947-0.

1994 — 1998

ELSET and the VAP Medienzentrum

Richard Kunicki invents ELSET — Electronic Set — the virtual studio system that still renders in Hamburg today. In the same period he builds and runs the VAP Medienzentrum, a 10,000 m² television studio complex.

1995 — 2000

COMPET — a character performed live to buyers

A computer pet with a monitor for a face, driven by a performer in real time. A magnetic field read the body; a studio camera was mechanically synchronised to its virtual twin so the character could share a frame with a human presenter. Shown at NATPE in New Orleans and on the show floor at Cannes with S4C International.

2001 — 2005

Theater im Zimmer

A Hamburg theatre comes under the same management, and from 2004 an ELSET virtual studio is built into its stage — lighting truss beneath a stucco cornice, tracked cameras in front of a cyclorama. It is the room where Bug Muldoon would later be performed live.

COMPET performed live · VAP and LIVE Television with S4C International · 1:34

COMPET toolchain

Performance: Protozoa, San Francisco — Brad deGraf's real-time performance software, then close to prototype
Body: Ascension Flock of Birds, magnetic field positioning
Camera: Live camera mechanically synchronised to the virtual camera
Shown: NATPE, New Orleans — press launch 4pm, Tuesday 20 January 1998, stand 3121 · Cannes, stand RO.B37/C38
Partners: VAP Video Art Production GmbH · LIVE Television · S4C International, Cardiff

Press launch card: S4C and VAP invite you to meet the new virtual reality character, NATPE 1998 — Press launch, NATPE 1998

VAP and LIVE Television trade flyer — VAP / LIVE trade flyer

VAP and S4C flyer for COMPET at Cannes — VAP / S4C flyer, Cannes

COMPET performed live on the show floor at Cannes, presenter and motion-tracked performer — Show floor, Cannes — the performer's tracking hardware at right

A performer in a marker suit in the Theater im Zimmer bluebox, with Hugo the troll shown live in a virtual set on the output monitor beside him — Theater im Zimmer, 2004 — the performer in the marker suit, and Hugo standing in a virtual set on the output monitor at the same moment

What this photograph shows

In the room: A performer in a retroreflective marker suit, on the theatre stage
On the monitor: Hugo, rendered live inside a virtual set, moving with him
Behind: The ORAD tracking pattern on the bluebox wall, reading the camera position
Character: Hugo, created by Ivan Solvason — the first interactive television character, later seen in 43 countries
Latency: None to speak of. There is no render queue between the two halves of this picture.

Wide view of the virtual studio on the theatre stage: performer in marker suit, tracked cameras, output monitor, beneath the theatre's stucco cornice — The full stage — tracked pedestal cameras left and right, the performer centre, the output monitor at his feet, and the theatre's stucco cornice above the lighting truss

The through-line

The same person, at both ends of thirty years

A child stood beside a real-time character on a trade-show stand in Cannes, before she was old enough to find it strange. She later wore the markers herself in the bluebox at Theater im Zimmer, performing Bug Muldoon's body. Today Dr. Martha Kunicki directs the AI that moves him, and researches human–AI co-creativity for a living.

Hand-keyed, then performed, now co-created — by the same family, in the same house.

A child standing in front of the backlit COMPET stand poster at Cannes — Cannes — in front of the COMPET stand poster

Management and Supervisory Board

The people behind the production

The board is not decorative. It contains the inventor of the virtual studio this film's second generation was shot in, the creator of the world's first interactive television character, and the producer who made Bug Muldoon in the first place.

President of the Management Board

Richard Kunicki

Engineering, Warsaw · Film School, Łódź

Inventor of the ELSET virtual studio. Author of MONA LISA, the European research project that established much of the groundwork for real-time simulation in broadcast, run by VAP in consortium with the BBC, Daimler-Benz, DVS and Siemens Thomson.

Built the 10,000 m² VAP Medienzentrum in Hamburg, and led VAP and LIVE Television for more than two decades.

Chairman of the Supervisory Board

Andrzej Górski

Since 2008

Economist and founder of Arconex, which began in architectural design and moved into new media technology. Arconex developed virtual studio software on VAP's commission from 1993, and the working relationship dates from then.

Supervisory Board

Ivan Solvason

Since 2007

Founder of ITE, Interactive Television Entertainment, in 1988. Creator of the world's first interactive call-in television format and of Hugo, broadcast in 43 countries to an audience of more than 400 million, with over 14 million games sold. ITE was sold to Olicom and then to NDS, part of News Corporation.

Later founder of GOIP International and Sunstream TV.

Supervisory Board

Ralph Christians

Since 2009

Founder of the Magma group in Germany and Iceland in 1984, and of Magma in Ireland in 1994, now the holding company of Magma Scripting House. More than 200 hours of animation distributed in over 80 countries.

Named European Producer of the Year for 2008 by Animation Magazine. The first Bug Muldoon 3D animation was produced under his direction.

Supervisory Board

Sandra Kunicki

Since 2007

Visual communication, University of Kent and the Kent Institute of Art & Design, after art and design studies in Switzerland. Worked on advertising campaigns and live television at VAP, RTL Stormy Entertainment, LIVE Television and Hotdog Filmproduction in Cologne and Hamburg.

Founder of design-zone, delivering visual communication services since 2007.

Supervisory Board

Szymon Dąbrowski

Since 2012

Corporate finance. Formerly with Bank Handlowy, Polbank EFG and Deutsche Bank PBC; since 2009 President of Nomus Business Consulting, advising companies on financing and transactions.

Supervisory Board of EUROINVESTMENT S.A., formerly Virtual Vision S.A. Biographies condensed from the company's published corporate disclosures.

Why now

We were right, but we were too early.

Every idea on this page was correct. A character performed live, rendered as you watch, directed rather than drawn — that is how animation works now. It is simply that in 1998 it took a magnetic rig, a synchronised studio camera and a room full of engineers to do it for ninety seconds.

The idea was never the problem. The cost was. Real-time character production demanded a 10,000 m² studio complex, a European research consortium and a broadcast truss bolted into a theatre ceiling, and it produced minutes rather than features. Three decades of that arithmetic is why Bug Muldoon exists as three title sequences and not as a finished film.

Generative production removes the arithmetic. The same ambition now needs a director, a model and an owned character — not a building. What this family spent thirty years being too early for has become the ordinary way to make an animated feature, and the people who were early still hold the character, the rights and the craft.

What we bring that a new studio cannot

A character we own outright. Rights acquired 2010–2011, chain of title intact — we are not generating someone else's IP.
A finished visual language. Bug Muldoon already exists on screen in three technologies. Nothing has to be invented from a blank page.
A producer with a catalogue. Over 200 hours of animation distributed in more than 80 countries, and a European Producer of the Year.
The inventor of the virtual studio. ELSET, MONA LISA, and the research that put real-time simulation into broadcast in the first place.
A researcher inside the new tooling. Human–AI co-creativity as an academic discipline, not a press release.

Rights and contributors

Produced by

Magma Films produced the Bug Muldoon material from 2007 to 2009; LIVE Television produced in 2010. All rights to the material were acquired in 2010–2011 by the company then trading as Virtual Vision S.A. VAP Video Art Production GmbH, Hamburg, built and operated the ELSET virtual studio.

Magma Films 2007–2009 LIVE Television 2010 S4C International 1998 VAP Video Art Production GmbH Hamburg

The company

Virtual Vision is the production identity. The company behind it is EUROINVESTMENT S.A., incorporated in Warsaw in 2007 as Virtual Vision S.A. and renamed in December 2014, a subsidiary of VAP Video Art Production GmbH, Hamburg. It holds the rights to the Bug Muldoon material.

BUG MULDOON™ registered trademark of Magma and Telepool · ELSET™ trademark of VAP · COMPET™ trademark of VAP / S4C · HUGO created by Ivan Solvason · All rights to the Bug Muldoon material acquired 2010–2011

One movie, three decades of animation technology.

What this record is evidence of

We finish what we start

We are early, not late

We own what we show

Keyframe

Motion Capture

Generative AI

The same character, three times over

A history of real-time simulation in broadcast

Ampex Video Art

MONA LISA — European research project R2052

ELSET and the VAP Medienzentrum

COMPET — a character performed live to buyers

Theater im Zimmer

The same person, at both ends of thirty years

The people behind the production

Richard Kunicki

Andrzej Górski

Ivan Solvason

Ralph Christians

Sandra Kunicki

Szymon Dąbrowski

We were right, but we were too early.

Produced by