Category: VR

Endless VR – Immersive movie by Wojciech Puś (2022)

“‘Endless‘: feature film & cinematic performances. The threshold between reality and hallucination: a convulsive beauty & uncanniness of metamorphosis.”

My roles: spatial sound capture / re-recording mixer (Ambisonics)


E N D L E S S (VR) – Credits

Cast: Szymon Czacki , Magdalena Wawrzyńczak , Pierre Emö , Lina Bembe , Anton Tsyhulskyi , Jorge Benavides , Pat Dudek , Edmund Krempiński, Jerzy Tabor

Director/cinematography/screenplay: Wojciech Puś

Sound design and music: Thomas Köner

Additional music: Wojciech Puś

Animation/VFX: Jerzy Tabor

Camera assistant: Tomek Lechicki

Gaffer: Michał Bratkiewicz

Camera assistant (VR): Marek Titow

Mixer / re-recording mixer (Ambisonics): Eduardo Patricio

Production (VR): Krzysztof Pijarski , Krzysztof Franek / Vnlab Pwsftvit

Development VR: Pola Borkiewicz , Jacek Nagłowski

Exploseum sound installation, Binaural / Ambisonics (2022)

This is a binaural installation I presented at the Exploseum museum* in Bydgoszcz (Poland), using spatial audio to bring to life sounds of a possible past.

Voices, machinery, movement etc. are added to this now empty room which used to be part of a German Nazi explosives-making complex.

The installation was part of a larger project carried out by lecturers (Jędrzej Rochecki, Adam Mart and I) and students from Feliks Nowowiejski Academy of Music.

Here’s a reproduction of the installation, but as a 360 / VR video with Ambisonics audio.

* A a unique example of industrial architecture on a global scale, practically unchanged since World War II. The facilities adapted for tourist purposes are part of one of the largest armaments factories, in the past intended for military tasks of the Third Reich.

POV: Points of View – VR Sci-fi movie (2021)

A Live Action Sci-fi Virtual Reality Series & Immersive Experience. A hyper-digital sci-fi virtual reality series immersed in a near future Los Angeles where personal data is the new currency and weaponized A.I. Police drones enforce the law. POV: Points Of View is a Sci-Fi VR Series & Installation developed to experience the systemic threat of bias in A.I, Artificial Intelligence. AI’s are machines that learn from US.

(Official website)

My role: sound design and spatial mixing (Ambisonics).

IMDB

Premiere on Tribeca Festival: https://tribecafilm.com/films/pov-points-of-view-2021

Alien Shelter – VR environment – Unity 3D (2020 / 2021)

This is a quarantine-psychological-relief virtual environment I created for my personal use.

Relaxing drones everywhere and a TV set on an alien planet. That’s it!

Since I was a kid, I always liked spending time in hiding or secret places. In the past years I built a few virtual hideouts. This one was made in 2020 and it has served me well during these pandemic times.

There’s something about being immerse, surrounded by drone sounds that I just love.

IN PROTEST – VR film series (2020)

IN PROTEST is a project from GRX Immersive Labs and is being produced by a core team of Black immersive storytellers and creative professionals led by Alton Glass and Adam Davis-McGee.

My roles: sound design; spatial / Ambisonics mix.

The first 7 episodes are already available on Oculus TV: “First Response | IN PROTEST: Minneapolis & St. Paul”

Behind the scenes interview: https://www.oculus.com/blog/behind-the-scenes-of-in-protest-with-alton-glass-and-adam-davis-mcgee/

Toward live recorded 6DoF audio – Unity and ZM-1 microphone arrays (2018)

6DoF (six-degrees-of-freedom) refers to the possibility of a rigid body (or a representational device of it) to move freely in three transitional and three rotational degrees.

Designing sound for immersive VR 6DoF experiences is usually done by using mono or stereo sound artificially spatialised through software processing the seeks to replicate reverberation, diffusion and other acoustic behaviors.

Now, doing a live sound recording, in a physical acoustic space so it can be used in the context of 6DoF VR is said to be impossible or, at least, very hard.

To try and achieve just that, I used simultaneous recordings made with 9 ZYLIA ZM-1 microphone arrays, placing multiple ambisonics sound files in a scene I built in Unity 3D. The sound sound sources in those recordings are physical objects.

The following video explains the process, step by step:

Related paper presented at the 146th AES Convention in Dublin (2019):
http://www.aes.org/e-lib/browse.cfm?elib=20274

(More information and reference to previous recordings can be found on this blog post from ZYLIA.)

The initial proof-of-concept was recently presented at Game Sound Con in Los Angeles, LA and AES Convention in New York, NY – USA.

Los Angeles, LA and AES Convention in New York, NY – USA.

Ambisonics and binaural audio for 360-degree and ‘tiny planet’ videos (2018)

360-degree video


‘Tiny planet’ video

Here we have 2 videos that share the same source material (audio and video recordings), but that had different post-processing workflows, resulting in:

  • A 360-degree video with 1st order Ambisonics audio, and
  • A ‘tiny planet’ video with binaural audio.

(Actual videos bellow)

I prepared the videos (concept, audio / video recording and editing) for ZYLIA and they were published on their YouTube channel.

The recordings were made at Barigui Park, Curitiba (Brazil). For some more details, you can check this short tutorial blog post.

Up ↑