Immersive Audio


Jon Schorah - new TV-Bay Magazine
Read ezine online
i

In 2012, the Oculus Rift Kickstarter campaign burst onto the scene, initiating a new wave of public interest in sense-enveloping immersive experiences. 5 years later, the consumer reality is mixed with some very public let-downs like Google Glass (which is coincidentally enjoying a re-birth at the time of writing, now as a technical tool in the workplace), and other technologies such as Dolby Atmos® becoming almost commonplace experiences. What does this mean for the audio professional and how is the near future shaping up in 2018?

Now that the initial hype has settled down, it's clear that some immersive experiences fit well as a natural extension of existing technologies, while others require the consumer to embrace new equipment and services, with the latter being somewhat slower to come to practical fruition than the former.

Perhaps the most successful application today is that of movie theatre sound. Generally, the domain of the seasoned professional, with an accompanying budget, it seems that the adoption of technologies such as Dolby Atmos, DTS-S and Auro-3D® has been both rapid, and welcomed by the consumer. While it's true to say that initial production of audio in these formats has been something of a custom set-up, popular editing software is catching up fast and with Pro Tools® now enabled for native 7.1.2 tracks, the process has become much easier. However, there is still work to be done here. Most modern NLE/DAW systems do not support native object tracks, so at the moment the technology remains as an opportunity appealing to the more dedicated or adventurous producer.

If a significant contributing factor to the widespread adoption of immersive audio in the cinema market can be put down to the negligible effort required on the part of the consumer (who doesn't want an improvement for nothing?), then the same factor could explain the somewhat stalled start that appears to have materialized in the gaming market. It could be argued, of course, that game audio has always been object-based and to some extent immersive, in that the sound has been delivered in a manner that reflects the position of the players character on screen. At first inspection, gaming and headset sound and vision would seem to be a perfect fit and initial consumer interest was certainly in this direction. However, mass market adoption, even in this narrow arena has yet to materialize. Reasons for this are open to debate, but cost is a significant factor. Game developers are certainly more than capable of delivering a quality experience, but the cost to the consumer seems to remain elusively high.

360 video on the other hand, is immensely accessible, with viewers needing nothing more than a smartphone or tablet and a pair of earbuds to enjoy an immersive experience for, in most cases, very little additional outlay. Samsung recently released figures that indicated 50 percent of its VR content consumed was in fact 360 video, with gaming actually on the decrease, at around 35 percent. It's easy to produce content for this medium with ambisonic audio getting a new lease of life as the dominant format for producing a fully immersive 3D audio environment. As first order, ambisonic audio is generally employed, precise localization is somewhat difficult. However, in mobile settings, the listening environment is often compromised and the sense of space, even at this level, can deliver a real improvement over stereo.

In between the movie theatre and 360 mobile video lies TV. Here, several factors combine - production, delivery mechanisms and consumer equipment. On the production side, in theory, audio produced in an object-based format will automatically translate to the home environment as the decoders configure the audio to the available speaker arrangement at the set top box. This, however, pre-supposes the availability of an object-based mix. It's still early days, however, the tide is changing with many post-production studios installing 7.1.2 and 7.1.4 rigs in preparation for the inevitable transition away from a channel-based workflow to the more flexible object-based proposition, even as the editing software rushes to keep pace with the demand.

Production pre-dates consumer adoption, but even if an immersive soundtrack is available, the systems needed to replay this have to be in the home there is little to be gained from an immersive soundtrack in a stereo playback environment. New speaker developments, including upward firing technologies that avoid the requirement for ceiling speakers, and specially developed sound bars may indicate a way forward, bringing a true immersive enhancement for the everyday home listener.

What does all this mean for today's audio post-production engineer? With some applications moving forward at high speed and others still in their infancy it can be difficult to know where to invest your time and energy. As with all emerging technological transitions, the key is flexibility. DAW and NLE audio technologies are still catching up with the demands of immersive audio production. Concepts are wide and varied with object, ambisonic, high channel count and binaural audio all enjoying their own application. Within these fundamental choices there are many formats as well as myriad encoding options to deliver the resulting mix to the consumer.

Translating a mix from stereo to a 3D setting itself can be a challenge, as much of the recorded source material is stereo, as are most sound design libraries, digital instruments and FX. New tools are emerging rapidly to support these requirements, including our own Halo Upmix, now available with a 3D extension capable of upmixing to 7.1.2 and ambisonic formats. Tools such as Halo Upmix are now making 3D immersive audio possible within a traditional post-production workflow and DAW/NLE template. The need to configure a complex hybrid system is fading into the past and immersive audio is at the edge of mainstream production for those who need it, where these applications will ultimately take hold in the consumer market still remains to be seen.


Tags: iss127 | immersive audio | dolby atmos | dts-s | auro-3d | oculus rift | nugen | Jon Schorah - new
Contributing Author Jon Schorah - new

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • 7.1.2 Dolby Atmos support by Halo from Nugen Audio at NAB 2017

    7.1.2 Dolby Atmos support by Halo from Nugen Audio at NAB 2017

  • VisLM Loudness Meter update from Nugen Audio at IBC 2019

    VisLM Loudness Meter update from Nugen Audio at IBC 2019

  • Nugen Audio Loudness Meter, Halo Upmix and Halo Downmix at NAB 2018

    Nugen Audio Loudness Meter, Halo Upmix and Halo Downmix at NAB 2018

  • Nugen Halo Upmix and AMB Updates at IBC 2017

    Nugen Halo Upmix and AMB Updates at IBC 2017

  • Nugen Audio at IBC 2016

    Nugen Audio at IBC 2016

  • Nugen Audio at NAB 2016

    Nugen Audio at NAB 2016

  • Nugen Audio Loudness Toolkit at BVE 2016

    Nugen Audio Loudness Toolkit at BVE 2016

  • Nugen Audio Halo Upmix at BVE 2016

    Nugen Audio Halo Upmix at BVE 2016

  • NUGEN Audio at IBC 2015

    NUGEN Audio at IBC 2015

  • NUGEN Loudness Toolkit at NAB 2015

    NUGEN Loudness Toolkit at NAB 2015

  • NUGEN Audio at BVE 2015

    NUGEN Audio at BVE 2015

  • Nugen Audio at NAB 2014

    Nugen Audio at NAB 2014

  • NuGen Audio at IBC 2013

    NuGen Audio at IBC 2013

  • NUGEN Audio: Loudness Toolkit at NAB 2013

    NUGEN Audio: Loudness Toolkit at NAB 2013

  • Nugen Audio at IBC 2012

    Nugen Audio at IBC 2012


Related Shows
  • The KitPlus Tv Guests of Season 2

    The KitPlus Tv Guests of Season 2


Articles
AJA Video Systems - Ki Pro GO User Review with Spellbinder Films
Ben Sherriff The Ki Pro GO is a portable multi-channel H.264 recorder offering up to 4-channels of simultaneous HD and SD recording to off the shelf USB drives with redundant recording capabilities. Our friend Ben Sherriff tales a look
Tags: AJA | ki pro go | dit | h.264 | recorder | live events | usb recording | 10bit | Ben Sherriff
Contributing Author Ben Sherriff Click to read
In Ear Monitors Help The Cast And Crew of Americas Got Talent Cope With Covid19 Restrictions
KitPlus Capturing performances for television is a stressful business, especially if the programme is being filmed live. You want everything to be perfect but you are also aware that many things can go wrong, even with the best laid plans.
Tags: bubblebee | inear | sidekick | KitPlus
Contributing Author KitPlus Click to read
ERA IaaS at University of Salford
KitPlus The University of Salford (UoS) is widely recognised in both academic and professional circles as a leading educational establishment in acoustics and media production. In 2011 the University moved its television and radio courses from its main campus just outside Salford city centre into the Orange Tower on the main piazza of MediaCityUK (MCUK).

This purpose-built hub for broadcasters, facility houses and production companies was created when redevelopment of the old Salford Quays docks area began in 2007. UoS was among the first institutions to consider moving to MCUK, along with the BBC, which had already committed to transfer many of its departments from London.

Tags: era | salford university | university of salford | seagate | mcuk | KitPlus
Contributing Author KitPlus Click to read
ITN using Densitron Intelligent Display System across multiple news programmes
KitPlus Impressed by the system’s flexibility, ITN has gradually rolled-out the IDS solution for display and control applications across ITV, Channel 4 and Channel 5 news output
Tags: ids | densitron | itn | newsroom | display | KitPlus
Contributing Author KitPlus Click to read
Using Modern Technology at Envy Provides a View into the Future of Post Production
Michael Darer ENVY’s use of modern technology, including remote edit capabilities and their expansive use of Signiant Media Shuttle, enables them to collaborate with customers and partners around the world, and made the transition to remote work during the COVID-19 pandemic any easy one. Although project files and media are stored securely on-premises at ENVY’s facilities in London, they are able to collaborate globally thanks to their forward-thinking approach to post production.
Tags: envy | signiant | media shuttle | assetts | Michael Darer
Contributing Author Michael Darer Click to read