This patent refers to the joint effort at Zylia to develop a fully functional recording and playback system for live-recorded 6-degrees-of-freedom audio enabled by simultaneous Ambisonics sound fields.
Such a system could be used to enrich powerful spatial audio experiences in the future.
My contribution was mainly to develop and implement the interpolation strategy itself used during the playback stage.
“‘Endless‘: feature film & cinematic performances. The threshold between reality and hallucination: a convulsive beauty & uncanniness of metamorphosis.”
My roles: spatial sound capture / re-recording mixer (Ambisonics)
This is a binaural installation I presented at the Exploseum museum* in Bydgoszcz (Poland), using spatial audio to bring to life sounds of a possible past.
Voices, machinery, movement etc. are added to this now empty room which used to be part of a German Nazi explosives-making complex.
Here’s a reproduction of the installation, but as a 360 / VR video with Ambisonics audio.
* A a unique example of industrial architecture on a global scale, practically unchanged since World War II. The facilities adapted for tourist purposes are part of one of the largest armaments factories, in the past intended for military tasks of the Third Reich.
A Live Action Sci-fi Virtual Reality Series & Immersive Experience. A hyper-digital sci-fi virtual reality series immersed in a near future Los Angeles where personal data is the new currency and weaponized A.I. Police drones enforce the law. POV: Points Of View is a Sci-Fi VR Series & Installation developed to experience the systemic threat of bias in A.I, Artificial Intelligence. AI’s are machines that learn from US.
This is a quarantine-psychological-relief virtual environment I created for my personal use.
Relaxing drones everywhere and a TV set on an alien planet. That’s it!
Since I was a kid, I always liked spending time in hiding or secret places. In the past years I built a few virtual hideouts. This one was made in 2020 and it has served me well during these pandemic times.
There’s something about being immerse, surrounded by drone sounds that I just love.
IN PROTEST is a project from GRX Immersive Labs and is being produced by a core team of Black immersive storytellers and creative professionals led by Alton Glass and Adam Davis-McGee.
6DoF (six-degrees-of-freedom) refers to the possibility of a rigid body (or a representational device of it) to move freely in three transitional and three rotational degrees.
Designing sound for immersive VR 6DoF experiences is usually done by using mono or stereo sound artificially spatialised through software processing the seeks to replicate reverberation, diffusion and other acoustic behaviors.
Now, doing a live sound recording, in a physical acoustic space so it can be used in the context of 6DoF VR is said to be impossible or, at least, very hard.
To try and achieve just that, I used simultaneous recordings made with 9 ZYLIA ZM-1 microphone arrays, placing multiple ambisonics sound files in a scene I built in Unity 3D. The sound sound sources in those recordings are physical objects.
The following video explains the process, step by step:
Here we have 2 videos that share the same source material (audio and video recordings), but that had different post-processing workflows, resulting in:
A 360-degree video with 1st order Ambisonics audio, and
A ‘tiny planet’ video with binaural audio.
(Actual videos bellow)
I prepared the videos (concept, audio / video recording and editing) for ZYLIA and they were published on their YouTube channel.
The recordings were made at Barigui Park, Curitiba (Brazil). For some more details, you can check this short tutorial blog post.
Eduardo Patricio 