Data in Motion is a new media performance that brings together music, science, and contemporary circus. In this project, I developed wireless sensors at the Czech Technical University in Prague (CVUT FEL) capable of detecting acceleration and 3D rotation in real time. These sensors are compact enough to be embedded inside juggling balls, turning movement into a live musical instrument. Together with Pavel Husa, we have presented the tech at Forbes, Comic-Con O2 Universum Arena, Sigraaph LA, South by Southwest (SXSW) and many other venues.
The performance centers on a juggling act where every throw and catch generates sound. A pendulum-based modulation system shapes these signals into expressive, evolving music, creating a synesthetic experience that blends motion, sound, and perception. The show is further enhanced by real-time video visualization and an interactive lighting system, tightly synchronized with the performer’s movements.
A key innovation of this work lies in producing real-time, musically coherent output that is accessible and engaging for general audiences—something that has remained a challenge in similar experimental projects.
The project builds on long-term scientific research, culminating in a publication presented at SIGGRAPH 2023, one of the most prestigious conferences in computer graphics and interactive techniques. Since then, I have expanded the system to include interactive light control, modular synthesizer integration, and more robust motion tracking algorithms.
Beyond the performance itself, Data in Motion serves as a platform for further artistic exploration. I designed the technology to be accessible to other creators, providing code examples, DAW integration, and flexible tools for musicians and multimedia artists. Current collaborations include partners from the University of Maryland (USA), HTW Dresden (Germany), the Tangible Music Media Lab (Austria), and Synth Library Prague (Czech Republic).
In addition to artistic applications, the sensor technology also shows potential in fields such as medical diagnostics—particularly for analyzing walking gait—as well as in retail environments, where it can be used to create interactive installations and engaging customer experiences.
