Skip to content
Back to Projects
Build2026

EmboDi

An open-source mixed reality directing system for staging 3D scenes, rehearsing actions, and recording stories in your physical space

Mixed RealityEmbodied AuthoringAI
EmboDi

Birthday teaser: An illustrative composite of a mixed reality blockout and generated video imagery. The cinematic imagery does not represent live headset rendering.

Overview

EmboDi (Embodied Director) is an open-source mixed reality system for directing 3D scenes in a physical space. Creators place objects and actors, shape actions and motion paths, rehearse a scene, and record it with virtual cameras.

The workflow makes spatial relationships visible during authoring. Creators can work at room scale to arrange a story and adjust its timing before generating the final video appearance.

Direct a Scene

  1. Build the scene. Place actors and props in the room to establish positions, scale, and relationships.
  2. Direct the action. Specify character actions and motion paths within the scene.
  3. Rehearse and revise. Play the scene, observe how actions unfold, and adjust the staging or timing.
  4. Frame and record. Position virtual cameras and capture the scene for the video creation workflow.

From Blockout to Story

The birthday and zombie examples show how a spatial blockout can guide different visual stories. The teasers align each blockout with imagery from its corresponding generated video.

EmboDi zombie teaser with colored blockout actors in a real lab on the left and generated zombie imagery on the right

Zombie teaser: an illustrative composite of the mixed reality blockout and generated video imagery, aligned to the same room view.

Explore the Project

The demo video shows the authoring process and example outputs. Source code and setup instructions are available in the EmboDi repository.