Authoring and Monitoring for the emerging 3D immersive Broadcast Audio formats


Anthony Wilkins TV-Bay Magazine
Read ezine online
by Anthony Wilkins
Issue 107 - November 2015

The world of broadcast audio is on the verge of a major revolution. Numerous 3D Immersive formats are under development and will find their way into the mainstream of broadcast production and distribution in the near future. Unlike the world of relatively constrained channel based coding as we are accustomed to (most commonly Left / Right for Stereo and Left / Centre / Right / Surround Left / Surround Right + LFE or Low Frequency Effects for surround), these new codecs will support more channels and/or object based audio coding. For the end consumer, there will be two major benefits from this new approach, a greater sense of involvement or immersion, and a degree of personalisation.

Greater involvement will come from an increased channel count typically by the addition of overhead height channels. Several proponents including the MPEG-H Alliance (Fraunhofer IIS, Technicolor and Qualcomm), Dolby and DTS have successfully demonstrated broadcast compatible systems based on 5.1.4 or 7.1.4 layouts where 4 overhead speakers have augmented the traditional 6 or 8 floor level speakers. This creates a 3D sound image where the viewer or listener is immersed in audio in all dimensions.

Object based audio will give the end user the option to personalise their experience by selecting from a number of audio sources and controlling the level and maybe even the position in the mix. In object based audio, an object is essentially an audio stream with accompanying descriptive metadata. The metadata carries information about where the engineer placed the object in the mix and at what level, and is used to re-create, or render, the audio experience for the end user. Objects may be static and placed at a fixed point in the mix (for example dialog) or dynamic where they are panned across the 3 dimensional soundscape (maybe a plane flying overhead). Depending on restrictions and limitations decided at the point of content creation (and signaled in the descriptive metadata), the end user could select which audio source(s) they want to hear from an on-screen list and perhaps vary the level at which they are reproduced. Think of a sporting event where the options could include home or away commentary, crowd sounds, the referee or match officials voice or pitch side microphones at team ball games. At motor racing events examples could be commentary, drivers voice or pit crew communication.

Does this mean multiple speakers need to be installed to avail of these new benefits? Not necessarily, although of course the best experience will result from a full installation of discrete speakers at both floor level and overhead, however where this is not practical (most likely the majority of typical domestic situations), the final renderer will re-create the mix as accurately as possible based on the actual number and location of speakers the end user has. An increasing number of Soundbars that are designed to sit underneath a display are already available to create a surround experience without consuming valuable space. Better still, a wall mounted Soundframe completely surrounds the display and can give an incredibly realistic reproduction from the height channels.

What does this all mean for the broadcaster? A complete re-build of existing facilities and a total re-think about the audio processing equipment required for outside broadcast vehicles? Well, if we get it right, it should entail just relatively minimal changes to overall workflow and hardware, but inevitably some additions to production and distribution equipment. In the case of object based audio, the metadata appropriate for the final codec needs to be created and added to the audio for insertion into a conventional SDI stream, and the engineer needs to be able to monitor this complex mix (and all the potential downmix variations) to ensure that the distribution chain is fed with all available objects correctly. Loudness levels should also be considered in respect of existing standards and there should be provision for local insertion of content at any point in the chain. Although this all sounds somewhat futuristic, the fact is that the broadcast industry is already seriously considering the potential adoption of these concepts. At Jnger Audio we have already worked closely with Fraunhofer IIS to design a prototype Multichannel Monitoring and Authoring unit (MMA) that is capable of directly interfacing with existing mixing consoles via AES, SDI, MADI, Dante or even analog audio formats. At NAB 2015 there was a comprehensive demonstration of a complete object audio based end-to-end broadcast chain including the original outside broadcast capture, distribution via the network operation centre, insertion of local content from an affiliate station and finally reception at the end-users home with full control of object selection and audio reproduction via Soundframe. At all stages of the distribution chain, the audio could be monitored to verify metadata parameters, downmix(s) could be auditioned and loudness levels could be checked and corrected if required.

Although that particular demonstration was using the MPEG-H codec, it is important to understand that the monitoring and authoring unit is agnostic, or independent, of the final codec used for transmission. Such a device would be easily adaptable to create and monitor metadata for any of the existing or future 3D Immersive formats irrespective of vendor or developer.

www.jungeraudio.com

Tags: iss107 | broadcast audio | 3d immersive formats | facilities | equipment | authoring | monitoring | Anthony Wilkins
Contributing Author Anthony Wilkins

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Infinity Arm - Matthews Studio Equipment at NAB 2016

    Infinity Arm - Matthews Studio Equipment at NAB 2016

  • Cineline Fluid Head from Miller Camera Support at NAB 2014

    Cineline Fluid Head from Miller Camera Support at NAB 2014

  • Belfast TOUR

    Belfast TOUR

  • Miranda on BroadcastShow LIVE at IBC 2013

    Miranda on BroadcastShow LIVE at IBC 2013

  • Tektronix at IBC 2013

    Tektronix at IBC 2013

  • Thear Technology at BVE 2013

    Thear Technology at BVE 2013

  • Guntermann and Drunck GmbH at BVE 2013

    Guntermann and Drunck GmbH at BVE 2013

  • Bexel at NAB 2012

    Bexel at NAB 2012

  • Thear Technology Limited at ProVideo2011

    Thear Technology Limited at ProVideo2011

  • JVC monitoring solutions DT-G, DT-E, DT-U, and DT-V range at BVE 2018

    JVC monitoring solutions DT-G, DT-E, DT-U, and DT-V range at BVE 2018

  • IP, 3G-SDI + HDR generation, analysis and monitoring from Phabrix NAB 2017

    IP, 3G-SDI + HDR generation, analysis and monitoring from Phabrix NAB 2017

  • Apantac monitoring over IP at NAB 2016

    Apantac monitoring over IP at NAB 2016

  • Wohler MPEG Monitoring Series at IBC 2014

    Wohler MPEG Monitoring Series at IBC 2014

  • Wohler MPEG Monitoring at BVE 2014

    Wohler MPEG Monitoring at BVE 2014

  • Bridge Technologies QoE Monitoring with Mobile Videowall Display at IBC 2013

    Bridge Technologies QoE Monitoring with Mobile Videowall Display at IBC 2013

  • The Telos Alliance at IBC 2016

    The Telos Alliance at IBC 2016

  • Wohler at IBC 2016

    Wohler at IBC 2016

  • Phabrix Qx at IBC 2015

    Phabrix Qx at IBC 2015

  • Phabrix TAG and Rx at IBC 2015

    Phabrix TAG and Rx at IBC 2015

  • NUGEN Audio at BVE 2015

    NUGEN Audio at BVE 2015

  • Phabrix RX series at IBC 2014

    Phabrix RX series at IBC 2014

  • Volicon Products at IBC 2014

    Volicon Products at IBC 2014

  • Volicon at IBC 2014

    Volicon at IBC 2014

  • Wohler DPP at BVE 2014

    Wohler DPP at BVE 2014

  • Wohler Technologies on BroadcastShow LIVE at IBC 2013

    Wohler Technologies on BroadcastShow LIVE at IBC 2013

  • Volicon on BroadcastShow LIVE at IBC 2013

    Volicon on BroadcastShow LIVE at IBC 2013

  • Calrec Callisto at IBC 2013

    Calrec Callisto at IBC 2013

  • Bridge Technologies PocketProbe App at NAB 2013

    Bridge Technologies PocketProbe App at NAB 2013

  • Sound Devices at NAB 2013

    Sound Devices at NAB 2013

  • TSL Products at NAB 2013

    TSL Products at NAB 2013

  • TSL Systems at BVE 2013

    TSL Systems at BVE 2013

  • TSL Products at BVE 2013

    TSL Products at BVE 2013

  • Oxygen DCT at BVE North 2012

    Oxygen DCT at BVE North 2012

  • RTW at NAB 2012

    RTW at NAB 2012

  • TSL at NAB 2012

    TSL at NAB 2012

  • Qualis at NAB 2012

    Qualis at NAB 2012

  • Digital Nirvana at NAB 2012

    Digital Nirvana at NAB 2012

  • Leader at IBC2011

    Leader at IBC2011

  • Murraypro at IBC2011

    Murraypro at IBC2011

  • DK Technology at IBC2011

    DK Technology at IBC2011


Related Shows
  • Sony monitoring at BVE with Den Lennie

    Sony monitoring at BVE with Den Lennie


Articles
Using Wireless Transmission
Jeremy Benning Wireless acquisition is a staple of live sports, entertainment and reality shows where cable free capture permits shots not previously possible, for health and safety reasons, and gives the camera-operator greater artistic licence to roam. The same is increasingly true of narrative drama where cinematographers are keen to work handheld or Steadicam where that helps tell the story. Any equipment which frees their movement and time by being lighter, easier to use and reliable in performance is going to tick a lot of boxes.
Tags: iss134 | wireless | 4k | transmission | Jeremy Benning
Contributing Author Jeremy Benning Click to read or download PDF
An Epiphany Moment
Peter Savage 2 I had been negotiating the sale of my company and had reached the really hard end of the bargain. We were close to agreeing the final sum after a lot of too-much-give-and-not-enough-take negotiation. The solicitors were calling me, keen for a deal. It had come down to one sticking point and, in my hard ball “I am the Wolf of Wall Street” guise, I wasn’t going to let it go. It would make a value difference of 1.5% on the total outcome. Not much, you might think, but I had already nearly fallen out with the solicitors over their fees and I was giving my advisors an extremely hard time because the corporate adviser couldn’t see how I had already given more than an inch and the buyers were taking more than a mile. I was not going to let them win.
Tags: iss134 | azule | finance | Peter Savage 2
Contributing Author Peter Savage 2 Click to read or download PDF
Accelerated Workflows with eGPU
Mike Griggs From the UK’s National Trust to magazine publishers to manufacturers, digital content creator Mike Griggs has a wide and varied portfolio of clients for whom he creates 3D art, motion graphics and multimedia exhibits. A typical day might involve sampling birdsong near Virginia Woolf’s country estate or creating 3D animations for VR. To keep on top of these demands, Griggs wanted to take the full power of the GPU computing revolution on the road.
Tags: iss134 | sonnet | egpu | amd | post production | editing | Mike Griggs
Contributing Author Mike Griggs Click to read or download PDF
University and Mental Health
Rhiannon Jenkins University study and mental health has been in the media quite a bit over the last year, and I’m sure there are many people wondering what is going on? The issues are complex, and I suppose the focus of employability off the back of a degree course has raised the stress stakes for a lot of young people. I’m only qualified to talk about this from my perspective, and my story began when I joined a course not knowing I had a mental health condition.
Tags: iss134 | portsmouth uni | mental health | student | tvfutures | Rhiannon Jenkins
Contributing Author Rhiannon Jenkins Click to read or download PDF
Protecting the continuity of transmission
Lorna Garrett Your viewers love you. You consistently bring them their preferred channels 24/7. They’ve come to rely on you for their viewing pleasure. They never miss cheering on their beloved sports teams. They’re the envy of their friends as they watch live concerts of their favourite bands. They gather the family around and catch up on their must-see shows. They don’t have a bad word to say about you.
Tags: iss134 | garland | gpl | streaming | artel | disaster recovery | Lorna Garrett
Contributing Author Lorna Garrett Click to read or download PDF