SOAVE – Stage Orchestra Audio Video Experience
MEDITECH Consortium
- Consorzio MEDITECH
OUR SERVICES
- Accessibility
- Exhibition Design
- Digital Design
- Interaction Design
- Video Production
An immersive experience to enjoy symphonic music from inside the orchestra
In the SOAVE (Stage Orchestra Audio Video Experience) project, ETT designed and developed a virtual reality application that allows users to experience a symphony concert from inside an orchestra, experiencing first-hand the visual and sound impact of different listening points: from the conductor’s podium to the string or wind sections. The experience is based on 360° video footage synchronised with dynamic spatial audio, carefully recorded and integrated into the virtual environment.
Seven synchronised audio-video recordings have been made, allowing the user to take on different perspectives: conductor, audience, or musician, moving virtually to five positions within the ensemble.
At any time, the user can change their viewing and listening perspective by selecting from the various available positions. The same piece of music is thus perceived differently depending on the section of the orchestra chosen, offering an authentic understanding of the sound and visual experience of each musician. The application manages the change of audio-video source in real time, resuming the musical performance at the point where it was interrupted.
Equipped with a VR headset, users can freely explore the scene thanks to a teleport system navigation system, choosing from which location to listen to the performance and perceiving in real time the acoustic change generated by the new perspective. The experience is made possible by an advanced audio/video synchronisation system that uses technologies developed by ETT for the project: spatial audio engine, intuitive interfaces and multilingual content also designed for museum and educational use.
The experience is designed to be accessible in three ways: via synchronous streaming, through a specific website, or in virtual reality with a headset, to offer maximum accessibility in different contexts, from museums to educational settings and concerts.
Alongside the VR app, ETT developed a prototype for a physical immersive installation to provide a multisensory experience. In a space equipped with multiprojections and directional speakers, visitors can move freely and perceive the musical performance from different vantage points, as though standing on stage among the musicians. This setup was validated using a digital twin to simulate the installation and assess its immersive and scenic effectiveness.
ETT’s work spanned all key phases of the project: analysis, design, development, and testing of the VR application; 360° filming; audio and video post-production; system integration; release of the experience; and support for its presentation and dissemination.
The result is an innovative and engaging experience that enhances the appreciation of ensemble music and expands the ways in which orchestral performances can be listened to and understood, with significant applications in museums, education, and the performing arts.
