20 April 2025
Traditional approaches to integrating visuals with music often involve sound-reactive systems where visuals respond to audio input. While effective, these systems typically treat sound and visuals as separate entities, limiting the potential for a truly unified audio-visual creation experience.
In this work, EMERGE partners from the University of Bristol present a detailed description of an innovative tool for music creation that merges sound and light through a unified system. By leveraging the Tonnetz approach a geometric representation of tonal space, and cellular automata to generate evolving musical patterns and synchronized light displays, the project offers users an intuitive platform to explore musical harmony and synesthetic experiences. Key features include real-time synchronization of sound and light, the implementation of scales and chord progressions, and the integration of web-based control for multi-unit management. This tool aims to democratize music creation, making complex musical concepts accessible through an interactive, multi-sensory interface.
Read the paper in the link below.
More Information
