Created by Daito Manabe, Continuum Resonance is an installation where autonomous artworks installed in each space of “VS” interact with each other by sharing mathematical algorithms, music programming, and 3D architectural data. For this exhibition, and inspired by the work of Iannis Xenakis (1922-2001), Daito has collaborated with Sinan Bökezoy (artist/composer) to develop the 3D acoustic software PolyNodes, creating an audiovisual resonance space where the space itself fluctuates three-dimensionally.
PolyNodes is an innovative generative audio synthesis tool that combines music production and 3D sound design. The system was developed with an approach that sets it apart from conventional DAWs (Digital Audio Workstations), by featuring a mechanism that visualizes sound in 3D space and enables intuitive operation. While it allows for the creation of new sounds without the need for music theory or advanced programming skills, it also provides a production environment for experts with deep knowledge of acoustics to visually express their insights and explore new possibilities in sound design. The software automates the generation and modulation of sound through algorithms and rules, creating soundscapes and acoustic structures that unfold along a time axis through design modeling, without direct human input.
This project is the result of a synergistic collaboration between Manabe’s background in mathematics- based media art and sound art, and Bökesoy’s expertise in composition and generative sound synthesis, exploring new methods of expressing sound and architecture.
Behind The Scenes by Daito Manabe + Sinan Bökesoy
In addition to linear geometric concepts, it incorporates parameters such as Black Hole and White Hole to accommodate non-linear changes. Generative sound synthesis is not defined solely by model complexity, algorithmic manipulation, or the latest AI techniques. Rather, it is characterized by its ability to intuitively reflect the designer’s thinking as software that accurately grasps and embodies acoustic design elements such as timbre evolution, acoustic interactions, and structural nuances of sound. The design of the algorithm itself becomes the composition process, expressing the evolution and interaction of sounds.
For the VS exhibition, running from 6th September until October the 14th, 2024, Daito explores the technical and expressive possibilities of PolyNodes through four exhibition spaces of different shapes, exploring the relationship between acoustics and three-dimensional space through real-time generation and pre-designed perspectives. In the Work 1 (STUDIO C), visitor’s position data and the spatial characteristics data of the exhibition area are analyzed. The projected visuals display the sensor information and the operation of PolyNodes (debug-views). This creates a space where one can concretely understand the effects and functions of PolyNodes.
“Continuum Resonance” incorporates human movement, and embodies the attempt of transcending the dualism between observer and observed. It maps the spatial information of human body with multi-scale approach to “PolyNodes” sonic architecture, which enables continuous manipulation from microscopic to macroscopic layers of its sonic structure.
Behind The Scenes by Daito Manabe + Sinan Bökesoy
In the Work 2 (STUDIO B), the focus is on the Black Hole parameter that activates non-linear spatial effects and projection visuals are generated in real-time using the generated sound, and sensor data. The Work 3 (V Space) takes on the Augmentation aspects of the envrionment using visitor movement, camera footage and static data (architectural space characteristics). Furthermore, the shadows of the three-dimensional objects are projected onto the walls, visualizing and expanding them into audiovisual experience. It is also possible to experience AR (Augmented Reality) through a special display. Finally, the Work 4 (STUDIO A), utilizes a specially shaped area with high ceiling, using spatial measurement data, dancers’ physical movement data, and pre-created PolyNodes sound sources as materials. With the themes of body, space, and music, it develops a unique expression that is only possible in this particular space. Visitors can experience an immersive audiovisual environment that makes full use of multi-projection techniques.
The visual comparison between the Phillips Pavilion and a sample geometric structure from “PolyNodes” invites a question: Is this similarity a coincidence, or does it reflect a universal approach to designing with sound and space? It is this universal aspect which strikes us when following our inspirations, the composer greats such as I. Xenakis and their formalized approach, and using today’s tools of creation where many of these inter-connections are revealed and new structures upon these timeless theories are built. In this context, the exhibition “Continuum Resonance” of Manabe delivers the bridge between the virtual generative forms of “PolyNodes” to the physical realms of architectural space and acoustics.
Behind The Scenes by Daito Manabe + Sinan Bökesoy
PolyNodes was made with Unity and is available as a stand alone application for OSX, Windows (64bit only). Recommended systems are OSX Monterey or higher, Windows10 or higher and Apple Silicon M1 1st gen. equivalent or better. It can be purchased here. If you are a CAN Member, we’ll have a few copies to give away so head over to Discord to learn more.
Project Page | Daito Manabe | PolyNodes
For full credits, see exhibition guide (PDF). For more about the installed works, see Behind The Scenes text by Daito Manabe + Sinan Bökesoy.
/++
/++
