Somewhere down the latency river


Ben Hawker TV-Bay Magazine
Read ezine online

Some people have been, understandably, getting fairly excited over the prospect of being able to deploy wireless cameras to capture and transmit 4K UHD. Manufacturers and developers are closing in on the ability to deliver systems that will offer up almost endless creative options at the highest – to date – possible picture quality.

But they’re not there yet. There is one pesky hurdle to overcome and, oddly, although it’s a low one, it’s not low enough…and may be the toughest to surmount.

Latency.

Latency is the last remaining barrier to making 4K over RF a widely deployable option. Although manufacturers and developers are investing a lot of effort and resources into reducing latency and are making considerable progress - it’s not yet where it needs to be, but I have no doubt they will continue to drive latency down

And that’s because, for live television, latency is a major issue. You can get away with a certain amount of latency in a sub-4K world. It’s done every day by simply introducing a certain amount of audio delay. Broadcasters can cope with that, but it still makes wireless HD and especially 4K UHD over RF a significant challenge. Sure. It can and is being done, but it still requires a trade-off, and it’s a fairly major one. Viewers, particularly the exploding demographic of those taking advantage of streaming services, are turning away from the annoyance of buffering, delays, and poor quality, all of which are largely down to latency issues.

The current consensus is that the lowest latency that can be consistently achieved is around 100ms. As I said, broadcasters can deal with that without too much of a problem. But to my knowledge no one has really hit the mark to get the delay down to where it’s truly usable for everyday live action.

One company claims to have achieved 75ms, but in order to get it down that far, further compromises have to be made. A lot of picture information has to be thrown out, and in my view, that’s “too much information”.

The throw out factor – for want of a better term - is usually down to the encoding. To speed up encoding, you have to sacrifice quality, which for live action at higher resolutions is unacceptable, as is the inherent delay.

I’ve experimented with the wireless transmitter options on offer to date. They all use the same chipset. Early versions had a delay of more than 1.2 seconds, which is not particularly useful for anything other than, for example, beauty shots from a helicopter that can just be cut into a programme. In applications such as that it works well and delivers acceptable pictures, but it’s not far off what you could already do with older SD radio cameras. In terms of cutting in live shots, the delay can be slightly noticeable but only if you’re a professional deliberately looking for it.

But in higher resolutions it’s just not good enough. One UK broadcaster did a test at a professional football ground with original chipset encoders. On a monitor we watched a footballer strike a ball, then suddenly saw the ball careening toward the opposite goal - and nothing in between, not even the pitch.

That’s clearly too much delay, even for a novice.

New techniques, improved chipsets, and clever encoding algorithms will no doubt continue to reduce latency. There are limits to what existing chipsets can handle, but newer chipsets are always being developed, although perhaps not as rapidly as in the recent past.

RF equipment manufacturers and, for that matter, hire companies, are always pushing for those encoding and latency improvements, but to achieve those goals, the conundrum of sacrificing information and, therefore, quality, for speed still remains. It just comes down to what individual manufacturers can come up with in their codecs, and what portions of emerging professional standards they choose to embrace or discard.

Another question is, I suppose, somewhat subjective. At what point do viewers notice the delay or quality drop? Does ultra-high quality matter? And which judges are more important? The 60 or so people in a truck or studio, or the 60 million sitting at home, on a train, on a bus – pretty much anywhere these days? Where do you draw the line? What, in the end, is the low-latency limit?

Before I get too hypothetical, let’s take a step back and get practical for a moment. Basically, I think the quality versus speed question is almost moot when it comes to UHD 4K, at least at the moment.

When I talk to various customers today, what they want in wireless RF has nothing to do with 4K, progressive video, or anything like that. What they want more than anything are creative options.

Some broadcasters argue that quality has to adhere to the highest accepted standards of established broadcasters, then quite happily settle for less, sometimes without even realising it. I’ve seen entire programmes broadcast that originated from camera feeds several MBs below a minimum acceptable standard, and no one knew the difference. So, if few, if any, notice the difference, is a push for lower latency by sacrificing quality worth pursuing?

Yes.

As I said earlier, consumers are becoming more savvy, and decidedly less tolerant. If they don’t like the channel or platform they’re using due to poor quality or incessant delays, they simply go to one of thousands of other options. Yes, they may not get the content they were seeking, but chances are they’ll find something else that interests them just as much, if not more. Another pair of eyeballs lost, quite often for good. So it’s in everyone’s interests to chase the low-latency/high quality dragon – as long as it makes sense to pursue it. Improvements will no doubt arrive in a combination of improved chipsets, advanced codecs, and new standards in due course, but I would posit that once you get to a certain level, you’re sawing sawdust.

Miniaturisation, on the other hand - already pretty well-established and improving all the time – is what really hits the sweet spot with cameramen and producers, so long as acceptable quality can be maintained. As I said earlier, they want creative options, and reliable, miniaturised transmitters give them exactly that, and more.

The ability to attach a camera transmitter to a helmet, hat, chest, or even strapped to the back of an eagle or whale opens up brave new worlds. A 4K transmitter, in and of itself, is not necessarily a selling point. Users are far more interested in something that’s compact, reliable, and with the lowest latency possible, so they take viewers places they’ve never been before.

So, lower latency with improved miniaturisation is a winning combination that is already delivering exciting new options for HD productions. When it becomes viable for live 4K UHD productions, who knows what we might see next. But for now, it’s more about where you’re going than what it’s going to look like when you get there.

However, if you can couple ultra-low, unnoticeable latency with high quality, that’s the Holy Grail, and it’s what will make the journey worthwhile.

We’re just not there, yet.


Tags: iss129 | latency | 4k | wireless | rf | presteigne | Ben Hawker
Contributing Author Ben Hawker

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Wireless 4K Transmitter from DTC Domo Broadcast at IBC 2017

    Wireless 4K Transmitter from DTC Domo Broadcast at IBC 2017

  • Matrox Unveils Monarch EDGE 4K Contribution Encoder at IBC 2018

    Matrox Unveils Monarch EDGE 4K Contribution Encoder at IBC 2018

  • 12G 4K microMUSA Jackfield and Fibre Termination Solutions from Canford at IBC 2018

    12G 4K microMUSA Jackfield and Fibre Termination Solutions from Canford at IBC 2018

  • Blackmagic Design Pocket Cinema Camera BMPCC 4K at IBC 2018

    Blackmagic Design Pocket Cinema Camera BMPCC 4K at IBC 2018

  • Apantac 4k UHD HDMI/DVI Multiviewer with KVM at IBC 2018

    Apantac 4k UHD HDMI/DVI Multiviewer with KVM at IBC 2018

  • JVC 4K Connected Camera GY-HC550 and 500 at IBC 2018

    JVC 4K Connected Camera GY-HC550 and 500 at IBC 2018

  • IMT Vislink HCAM 4k UHD transmitter at IBC 2018

    IMT Vislink HCAM 4k UHD transmitter at IBC 2018

  • Blackmagic Pocket Cinema Camera 4K at NAB 2018

    Blackmagic Pocket Cinema Camera 4K at NAB 2018

  • Blackmagic ATEM Television Studio Pro 4K at NAB 2018

    Blackmagic ATEM Television Studio Pro 4K at NAB 2018

  • 4K UHD Multi-viewer HDMI 2.0 from Apantac at NAB 2018

    4K UHD Multi-viewer HDMI 2.0 from Apantac at NAB 2018

  • Omnitek Updates for Ultra 4k Toolbox at NAB 2018

    Omnitek Updates for Ultra 4k Toolbox at NAB 2018

  • 4k and HEVC with Garland at BVE 2018

    4k and HEVC with Garland at BVE 2018

  • 6K Sony Venice and Sony 4k Palm Camcorders at IBC 2017

    6K Sony Venice and Sony 4k Palm Camcorders at IBC 2017

  • JVC 4K UHD Monitors at IBC 2017

    JVC 4K UHD Monitors at IBC 2017

  • The CFU5 4k Transmitter from Vislink at IBC 2017

    The CFU5 4k Transmitter from Vislink at IBC 2017

  • AJA Thunderbolt 3 IO 4k Plus at IBC 2017

    AJA Thunderbolt 3 IO 4k Plus at IBC 2017

  • HDR, 12G, 4k, IP - the range expands from Phabrix at NAB 2017

    HDR, 12G, 4k, IP - the range expands from Phabrix at NAB 2017

  • Quad 4k Capture and Stream with Maevex from Matrox at NAB 2017

    Quad 4k Capture and Stream with Maevex from Matrox at NAB 2017

  • 4k 60 Matrix from GDSYS at NAB 2017

    4k 60 Matrix from GDSYS at NAB 2017

  • HEVC 4k Encoding from Aviwest at NAB 2017

    HEVC 4k Encoding from Aviwest at NAB 2017

  • Apantac 4k live demo at NAB 2016

    Apantac 4k live demo at NAB 2016

  • Omnitek Ultra 4K Tool Box at IBC 2015

    Omnitek Ultra 4K Tool Box at IBC 2015

  • Snell Advanced Media (SAM) 4k workflow at IBC 2015

    Snell Advanced Media (SAM) 4k workflow at IBC 2015

  • MULTIDYNE Silverback 4k at NAB 2015

    MULTIDYNE Silverback 4k at NAB 2015

  • Atomos talking 4K on BroadcastShow LIVE at IBC 2013

    Atomos talking 4K on BroadcastShow LIVE at IBC 2013

  • Snell Kahuna Production Switcher at IBC 2014

    Snell Kahuna Production Switcher at IBC 2014

  • Snell on BroadcastShow LIVE at IBC 2013

    Snell on BroadcastShow LIVE at IBC 2013

  • Panasonic Lumix GH5 at BVE 2017

    Panasonic Lumix GH5 at BVE 2017

  • Garland at BVE 2017

    Garland at BVE 2017

  • Ikegami 8k camera at IBC 2016

    Ikegami 8k camera at IBC 2016

  • Ikegami HQLM-3120W monitor at IBC 2016

    Ikegami HQLM-3120W monitor at IBC 2016

  • Ikegami UHK-430 camera at IBC 2016

    Ikegami UHK-430 camera at IBC 2016

  • Video Devices PIX-E at IBC 2016

    Video Devices PIX-E at IBC 2016

  • Sound Devices Wingman app at IBC 2016

    Sound Devices Wingman app at IBC 2016

  • JVC GY-LS300 at IBC 2015

    JVC GY-LS300 at IBC 2015

  • AVIWEST at IBC 2015

    AVIWEST at IBC 2015

  • BBright at IBC 2015

    BBright at IBC 2015

  • Thomson Video Networks at IBC 2015

    Thomson Video Networks at IBC 2015

  • Lynx Technik at IBC 2015

    Lynx Technik at IBC 2015

  • JVC at BVE 2015

    JVC at BVE 2015

  • Grass Valley at BVE 2015

    Grass Valley at BVE 2015

  • Gearhouse Broadcast at BVE 2015

    Gearhouse Broadcast at BVE 2015

  • KITPLUS rig setup at IBC 2014

    KITPLUS rig setup at IBC 2014

  • Tektronix at IBC 2014

    Tektronix at IBC 2014

  • Cooke Optics technology at IBC 2014

    Cooke Optics technology at IBC 2014

  • Cooke Optics talk anamorphic at IBC 2014

    Cooke Optics talk anamorphic at IBC 2014

  • JVC GY-LS300 prototype at IBC 2014

    JVC GY-LS300 prototype at IBC 2014

  • MultiDyne SilverBACK at IBC 2014

    MultiDyne SilverBACK at IBC 2014

  • BBright at IBC 2014

    BBright at IBC 2014

  • Hitachi at IBC 2014

    Hitachi at IBC 2014

  • Guntermann and Drunck DP-HR range at IBC 2014

    Guntermann and Drunck DP-HR range at IBC 2014

  • Ateme at IBC 2014

    Ateme at IBC 2014

  • Quantel LiveTouch at IBC 2014

    Quantel LiveTouch at IBC 2014

  • Quantel deal with AFP at IBC 2014

    Quantel deal with AFP at IBC 2014

  • Matrox Monarch HD at NAB 2014

    Matrox Monarch HD at NAB 2014

  • Elemental Technologies Software-Defined Video at NAB 2014

    Elemental Technologies Software-Defined Video at NAB 2014

  • Elemental Technologies HEVC solutions at NAB 2014

    Elemental Technologies HEVC solutions at NAB 2014

  • Elemental Technologies Multiscreen Solutions at NAB 2014

    Elemental Technologies Multiscreen Solutions at NAB 2014

  • Guntermann and Drunck at NAB 2014

    Guntermann and Drunck at NAB 2014

  • Matrox Mojito at NAB 2014

    Matrox Mojito at NAB 2014

  • Matrox Capture Card at NAB 2014

    Matrox Capture Card at NAB 2014

  • Blackmagic URSA at NAB 2014

    Blackmagic URSA at NAB 2014

  • Blackmagic Studio Camera at NAB 2014

    Blackmagic Studio Camera at NAB 2014

  • Cintel Film Scanner: Blackmagic Design at NAB 2014

    Cintel Film Scanner: Blackmagic Design at NAB 2014

  • Guntermann and Drunck at BVE 2014

    Guntermann and Drunck at BVE 2014

  • Philip Bloom on Tour in Belfast

    Philip Bloom on Tour in Belfast

  • Cinegy on BroadcastShow LIVE at IBC 2013

    Cinegy on BroadcastShow LIVE at IBC 2013

  • Blackmagic Design on BroadcastShow LIVE at IBC 2013

    Blackmagic Design on BroadcastShow LIVE at IBC 2013

  • Miranda on BroadcastShow LIVE at IBC 2013

    Miranda on BroadcastShow LIVE at IBC 2013

  • Harmonics Tom Lattie on BroadcastShow LIVE at IBC 2013

    Harmonics Tom Lattie on BroadcastShow LIVE at IBC 2013

  • JVC GY-HM600 series camera updates at IBC 2013

    JVC GY-HM600 series camera updates at IBC 2013

  • ATEME at IBC 2013

    ATEME at IBC 2013

  • Multidyne SilverBack, BullDog and Spider at IBC 2013

    Multidyne SilverBack, BullDog and Spider at IBC 2013

  • Cinegy at IBC 2013

    Cinegy at IBC 2013

  • Facilis at IBC 2013

    Facilis at IBC 2013

  • Blackmagic Design with the new ATEM Production Suite at IBC 2013

    Blackmagic Design with the new ATEM Production Suite at IBC 2013

  • MultiDyne: SilverBACK at NAB 2013

    MultiDyne: SilverBACK at NAB 2013

  • Quantel Pablo Rio at NAB 2013

    Quantel Pablo Rio at NAB 2013

  • Blackmagic Design: Products at NAB 2013

    Blackmagic Design: Products at NAB 2013

  • Facilis at NAB 2013

    Facilis at NAB 2013

  • AJA at BVE 2013

    AJA at BVE 2013

  • JVC at BVE 2012

    JVC at BVE 2012

  • Wireless Transmitters for Boxx TV at NAB 2018

    Wireless Transmitters for Boxx TV at NAB 2018

  • Pliant Technologies CrewComm Wireless Intercom at IBC 2017

    Pliant Technologies CrewComm Wireless Intercom at IBC 2017

  • Boxx TV Wireless Transmission with Meridian, Atom and Zenith on show at IBC 2017

    Boxx TV Wireless Transmission with Meridian, Atom and Zenith on show at IBC 2017

  • Videosys Wireless Transmitters at BVE 2014

    Videosys Wireless Transmitters at BVE 2014

  • Sony Wireless Microphones at BVE 2014

    Sony Wireless Microphones at BVE 2014

  • Cobham: Mini RF Transmitters at NAB 2013

    Cobham: Mini RF Transmitters at NAB 2013

  • Cobham: RF Transmitter at NAB 2013

    Cobham: RF Transmitter at NAB 2013

  • Pliant Technologies at IBC 2016

    Pliant Technologies at IBC 2016

  • Clear-Com LinQ at IBC 2014

    Clear-Com LinQ at IBC 2014

  • Cobham new receiver at IBC 2014

    Cobham new receiver at IBC 2014

  • Trilogy on BroadcastShow LIVE at IBC 2013

    Trilogy on BroadcastShow LIVE at IBC 2013

  • Cobham on BroadcastShow LIVE at IBC 2013

    Cobham on BroadcastShow LIVE at IBC 2013

  • Anton Bauer at NAB 2013

    Anton Bauer at NAB 2013

  • Anton Bauer at NAB 2012

    Anton Bauer at NAB 2012

  • Boxx TV Company Overview at NAB 2018

    Boxx TV Company Overview at NAB 2018

  • Boxx TV updates at NAB 2017

    Boxx TV updates at NAB 2017

  • Atom Lite from Boxx at NAB 2017

    Atom Lite from Boxx at NAB 2017

  • Quantum C80 from Cineo at NAB 2017

    Quantum C80 from Cineo at NAB 2017

  • Clear-Com FreeSpeak II at NAB 2016

    Clear-Com FreeSpeak II at NAB 2016

  • Thomson Broadcast at IBC 2014

    Thomson Broadcast at IBC 2014

  • Clear-Com FreeSpeak II at IBC 2014

    Clear-Com FreeSpeak II at IBC 2014

  • SIS LIVE ManPak and LoStow at IBC 2014

    SIS LIVE ManPak and LoStow at IBC 2014

  • Cobham satellite EXPLORER products at IBC 2014

    Cobham satellite EXPLORER products at IBC 2014

  • Dejero at NAB 2014

    Dejero at NAB 2014

  • Tally Technologies at BVE 2014

    Tally Technologies at BVE 2014

  • Gearhouse Broadcast on Tour May 2013

    Gearhouse Broadcast on Tour May 2013

  • Clear-Com: Tempest at NAB 2013

    Clear-Com: Tempest at NAB 2013

  • VideoSys at BVE North 2012

    VideoSys at BVE North 2012

  • IMT Broadcast at NAB 2012

    IMT Broadcast at NAB 2012

  • IDX at BVE North 2011

    IDX at BVE North 2011

  • RTS Telex at IBC2011

    RTS Telex at IBC2011

  • Telecast at IBC2011

    Telecast at IBC2011

  • TestTree RF-Catcher at IBC 2018

    TestTree RF-Catcher at IBC 2018

  • Zixi announce their user interface control ZEN Master at NAB 2018

    Zixi announce their user interface control ZEN Master at NAB 2018

  • CueScript EMC prompter and control surface at IBC 2014

    CueScript EMC prompter and control surface at IBC 2014

  • Steffan does the Surf Forecast

    Steffan does the Surf Forecast

  • Glensound at IBC 2016

    Glensound at IBC 2016

  • Studer Glacier at IBC 2016

    Studer Glacier at IBC 2016

  • Dalet at NAB 2016

    Dalet at NAB 2016

  • Clear-Com at IBC 2015

    Clear-Com at IBC 2015

  • Dalet at IBC 2015

    Dalet at IBC 2015

  • Dalet at IBC 2014

    Dalet at IBC 2014

  • Glensound Dante at IBC 2014

    Glensound Dante at IBC 2014

  • IMT at NAB 2014

    IMT at NAB 2014

  • Glensound Cub at BVE 2014

    Glensound Cub at BVE 2014

  • Nucomm on BroadcastShow LIVE at IBC 2013

    Nucomm on BroadcastShow LIVE at IBC 2013

  • Cobham transmitters at IBC 2013

    Cobham transmitters at IBC 2013

  • Jampro Antennas at NAB 2013

    Jampro Antennas at NAB 2013

  • 4HM at BVE North 2011

    4HM at BVE North 2011

  • DekTec at IBC2011

    DekTec at IBC2011


Related Shows
  • Philip Bloom chats 4k: BVE Day 2

    Philip Bloom chats 4k: BVE Day 2


Articles
Shedding Light on the Blackmagic Pocket Cinema Camera 4k BMCPP4K
Garth de Bruno Austin “What is it about light that has us craving it?” Is the question asked in the opening seconds of Garth de Bruno Austin’s latest short, The Colour of Light. Exploring this natural, human need as well as our innate desire to control it, Garth’s film showcases everyday people going about their lives in differing degrees of luminance, whether that be an artificial streetlight or a natural morning sunrise.
Tags: iss134 | blackmagic | cinema camera | 4k | cpp4k | Garth de Bruno Austin
Contributing Author Garth de Bruno Austin Click to read or download PDF
Protecting the continuity of transmission
Lorna Garrett Your viewers love you. You consistently bring them their preferred channels 24/7. They’ve come to rely on you for their viewing pleasure. They never miss cheering on their beloved sports teams. They’re the envy of their friends as they watch live concerts of their favourite bands. They gather the family around and catch up on their must-see shows. They don’t have a bad word to say about you.
Tags: iss134 | garland | gpl | streaming | artel | disaster recovery | Lorna Garrett
Contributing Author Lorna Garrett Click to read or download PDF
An Epiphany Moment
Peter Savage 2 I had been negotiating the sale of my company and had reached the really hard end of the bargain. We were close to agreeing the final sum after a lot of too-much-give-and-not-enough-take negotiation. The solicitors were calling me, keen for a deal. It had come down to one sticking point and, in my hard ball “I am the Wolf of Wall Street” guise, I wasn’t going to let it go. It would make a value difference of 1.5% on the total outcome. Not much, you might think, but I had already nearly fallen out with the solicitors over their fees and I was giving my advisors an extremely hard time because the corporate adviser couldn’t see how I had already given more than an inch and the buyers were taking more than a mile. I was not going to let them win.
Tags: iss134 | azule | finance | Peter Savage 2
Contributing Author Peter Savage 2 Click to read or download PDF
AI in Media and Entertainment
David Candler Artificial Intelligence (AI) is a term appearing everywhere these days. What is happening in media and entertainment (M&E) that makes the industry ripe for AI? In other words, why does the M&E industry need AI?
Tags: iss134 | AI | wazee | David Candler
Contributing Author David Candler Click to read or download PDF
Keeping it remotely real
Reuben Such Everyone wants to do more with less. Always have, although it could be argued that doing more with more is something to aspire to, not many have that luxury. So let’s stick with the prevailing winds of doing more with less, and not just doing more, but doing it remotely, particularly in terms of production. Remote production, in particular, is getting a lot of attention in the field these days, but not so much in terms of the remote operation of fixed studios.
Tags: iss134 | remote control | IPE | IDS | Reuben Such
Contributing Author Reuben Such Click to read or download PDF