Streaming the Classics into a New Era

The Challenge: Innovating the Classical Music Experience

In today’s digital landscape, audiences crave interactive and immersive experiences that traditional classical music performances lack. The industry faces several challenges:

• Limited accessibility: Geographic and economic barriers prevent many from attending live concerts in renowned venues.
• Static experiences: Conventional recordings and broadcasts fail to provide the engagement modern audiences desire.
• Need for innovation: Orchestras and venues require new methods to connect with audiences and enrich the concert-going experience.

Our Solution: Enhancing 4forty.io with Immersive Technologies

Spork is spearheading the development of immersive streaming tools integrated into the 4forty.io platform, which in turn has been integrated into the Sinfon.io iOS app. We have transformed how audiences experience classical music performances. Our innovative approach combines cutting-edge video and audio technologies to deliver an unparalleled, immersive concert experience directly to users’ devices.

Key Developments and Features

Custom 360° Video Player for iOS

• Immersive viewing experience: We built a bespoke 360° video player for iOS, allowing users to virtually attend concerts and experience performances as if they were seated in the concert hall.
• User-friendly design: Intuitive controls enable effortless navigation of the 360° environment, enhancing engagement and enjoyment.
• Multiple viewpoints: Users can switch between different camera angles, exploring various perspectives of the performance.

Integration of POLIMI’s 3DoF Technology

• Three Degrees of Freedom (3DoF) audio experience: In collaboration with Politecnico di Milano (POLIMI), we integrated their advanced spatial audio technology into our app. POLIMI developed a JUCE plugin, which we incorporated as an Audio Unit via CoreAudio in our iOS app.
• Dynamic audio interaction: This technology allows users to look around the concert space, and the audio changes dynamically with the movement of their device, enhancing the sense of presence and immersion.
• Enhanced sensory experience: By synchronising visual and auditory elements, users enjoy a more realistic and engaging concert experience.

Live Streaming Milestone: London Philharmonia Orchestra Concert

One of the most significant achievements of our project was the successful live streaming of the London Philharmonia Orchestra concert from the Royal Festival Hall on November 10th.

Technical Highlights

• Multi-camera setup: We collaborated with Metacamera to stream four 4K 360° equirectangular video feeds. Each camera was strategically placed to capture different viewpoints of the concert hall, providing users with a variety of perspectives.
• Multiple viewpoints: Users could switch between these four 360° camera angles in real-time, allowing them to choose their preferred view of the performance.
• Ambisonic microphones: POLIMI attached an ambisonic microphone to each 360° camera. This setup captured spatial audio corresponding to each visual perspective, enhancing the immersive experience.
• High fidelity stereo recording: In addition to spatial audio, we incorporated a full stereo orchestral recording provided by Floating Earth, utilising over 40 microphones placed throughout the orchestra for optimal sound quality.
• Customisable audio experience: Users could choose between the immersive 360° audio from the ambisonic microphones or the high-quality stereo recording. This flexibility allowed users to tailor their auditory experience, either immersing themselves in the spatial audio or enjoying the richness of the professionally mixed stereo sound.