Ask the Experts on the Topic of Distribution and Delivery


NAB 2009 was fascinating with respect to how many customers were looking for solutions and insisting that manufacturers work together to provide solutions, as opposed to just supplying products. File-based workflows were the talk of the town (well, at least the talk of NAB) and there certainly continues to be significant discussion and implementation of moving digital files. Last time, we started this series with volume one of the most frequently asked questions on digital distribution and delivery. Herewith, we follow that with the cleverly titled: Volume Two.
I am going to be shooting in the field in New York and I will need to upload content to my producer in London from my hotel room. What do I need to know?
First, are you on an expense account? If so, you may want to consider raiding the mini-bar for the booze because you have a challenge ahead of you. Plus the value of the pound to the dollar is still pretty good. Okay, perhaps that was not an appropriate answer…
First, you will be using shared bandwidth. Whatever connectivity that hotel offers will be shared by every other guest who has access and is using that network. Second, you will have to use a transport protocol that may simply not allow you to maximise whatever connectivity you have. Third, the hotel network may not allow you to use an accelerated transport protocol. So, let’s consider the following: let’s say you shot DV25, edited it on your laptop, and now need to send the five minute finished story. You only have 894 megabytes to send. Now the problems start.
The line that you are using is being shared, so you want to be able to use a transport method that maximises that line. If you use FTP, we learned in Volume 1 that you will only be able to achieve about 60 kilobits per second on average against, say, a shared 1 megabit per second network. Now, if you use WAN acceleration, even though the link is relatively small at 1 megabit, you will be able to put more packets on the network than other users. Practically speaking, this will probably allow you to achieve upwards of a 15x improvement on speed, up to 900 kilobits per second.
On the other hand, that leads us to the next question…
What if I can’t use WAN acceleration? What if the hotel won’t allow it?
This is entirely possible. Many companies will simply not allow UDP-based WAN acceleration on their networks. They simply don’t want to give that much power (read: bandwidth) to people who have access to the network. Again, the most important thing is that the file gets through to its destination. The transport protocol that you end up using must have some form of Checkpointing and auto-resumption capability. If, for example, you are half-way through that 894 megabyte upload and you lose your connection, you will be faced with having to start the upload from the beginning unless the protocol you’re using can resume from the point of interruption. But, what is really likely to happen once your file starts to leave the hotel room? Well, that leads us to the next question…
What other networks, switches, and routers will my file be going over?
Unfortunately, unless you have a guaranteed quality of service and sustained bandwidth as part of your network provider contract, or if you are using the open Internet it is quite possible that you may encounter many hops between switches and routers as you try to send files. The net result of this is that your ability to send files may be compromised in terms of the speed with which you can send them. For example, I personally know of a company that has an open Internet connection that is used to send files back and forth between Los Angeles, CA and Santa Monica, CA. After using a program such as Traceroute, they found that there were 21 hops involved in just linking up these two locations!
As a result of this, it is important to note two things. First, whatever system you employ to send and receive files, you should be aware of whether the system provides for automatic transport protocol failover. What this means is that there should be an automatic mechanism in place such that files can be sent at the fastest rate possible using UDP (user datagram profile) methods. However, if UDP is not allowed, then the transfer should automatically continue using TCP and if that fails, then by using HTTP methods.
Most people do not realize that ISPs (Internet Service Providers) will taper levels of service when extended periods of time at high transfer rates are being utilised. One of the most recent examples of occurred in 2008 and culminated in the FCC’s ruling in August 2008 that Comcast’s throttling of BitTorrent traffic by its subscribers was illegal.
Does File Compression have any effect when sending files?
The answer is that it depends on the type of file. For example, if you have a file that does not already consist of compressed media, using file compression should have some positive results. Huffman coding is one method that can be used to reduce repeating patterns within the dataset that you need to send. You can see the results of this any time you zip a file before you send it via your email account. Data compression typically works well for files such as word processing documents, spreadsheets, and certain types of image files. Documents and spreadsheets both have high instances of repeating information in the form of letters and numbers. Some images have black and white pixels that can be represented as gray, thus reducing the information contained in the file but not affecting the quality of the file.
Compression, in a general sense, comes in two forms: lossy and lossless. The names clearly indicate the effects of their usage. Lossy compression removes data from the file and that data cannot be retrieved. Depending upon the nature and amount of data that has been lost, the effects may or may not be visible. Lossless compression reduces the data that represents the file but does so in such a way that the data is retrievable when the file is uncompressed.
However, for large media files, the amount of repeating information is typically quite low and the amount of time required to analyze and process files is typically high. For example, an uncompressed SDI video frame carries a payload of 270 Mbits (megabits) per second. Many digital nonlinear editing systems will compress (in real-time) this content so that the resulting files are approximately half that payload (to 135 Mbits/sec). The resulting images can be perfectly acceptable, but the data that has been lost can never be retrieved. If we attempt to introduce lossless compression on that same one second of 270 mbit/sec content, we will most likely find that the actual compression saving is less than 1% and, in some cases the resulting file will be even greater in file size than the original. The main reason for this is that the amount of repeating information in a moving image tends to be quite low.
For file transmission systems, lossy compression is not acceptable. The file that is sent and received must have the exact amount of data and, therefore, introducing lossy compression schemes is not possible.
I already have an asset management system that I use for automation. Why do I need another workflow management system?
As asset and content management systems find greater use in the broadcast, media and entertainment industry, there has been a quite a lot of discussion regarding whether or not the automation aspects of asset management systems are different from the automation systems of other products. Where is the dividing line between the automated steps that can be outlined in an asset management system and those that are undertaken by file management or distribution management systems?
The separation that typically exists is that there are actually two categories of automation. First, there is business process automation and, second, there is media-centric process automation. Rarely are the two actually found within one system. The former, business process automation, seeks to provide an overall view of all related processes, ranging from order entry through fulfillment and finally to billing. Even when business process automation systems and asset management systems store and process the movement of files these have almost always been small size files, still images, or short video clips. Rarely are these systems optimized for the handling and movement of large, complex media objects as found in moving video. Further, business process and asset management systems do not typically have many of the media-centric transformation capabilities such as encoding, transcoding, metadata conversion, bandwidth manipulation controls and so forth.
Only after a further examination of your overall requirements will you be able to determine if you, indeed, need both business process and media-centric automation addressed in your implementations.

Tags: distribution and delivery | iss031 | ftp | wan acceleration | networks | switches | routers | file compression | compression | asset management | N/A
Contributing Author N/A

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • JVC GY-HM650 upgrade at NAB 2013

    JVC GY-HM650 upgrade at NAB 2013

  • File Catalyst at NAB 2013

    File Catalyst at NAB 2013

  • Thomson Video Networks at IBC 2015

    Thomson Video Networks at IBC 2015

  • THOMSON VIDEO NETWORKS at NAB 2015

    THOMSON VIDEO NETWORKS at NAB 2015

  • Thomson Video Networks at IBC 2014

    Thomson Video Networks at IBC 2014

  • Thomson Video Networks at IBC2011

    Thomson Video Networks at IBC2011

  • Broadcast Networks at IBC2011

    Broadcast Networks at IBC2011

  • Ross Video at BVE 2014

    Ross Video at BVE 2014

  • Snell on BroadcastShow LIVE at IBC 2013

    Snell on BroadcastShow LIVE at IBC 2013

  • AJA at BVE 2013

    AJA at BVE 2013

  • HEVC Compression for EnGo from Dejero at NAB 2018

    HEVC Compression for EnGo from Dejero at NAB 2018

  • Guntermann and Drunck at IBC 2015

    Guntermann and Drunck at IBC 2015

  • Ericsson at NAB 2014

    Ericsson at NAB 2014

  • ATEME at NAB 2014

    ATEME at NAB 2014

  • ATEME at IBC 2013

    ATEME at IBC 2013

  • Sensio at IBC2011

    Sensio at IBC2011

  • Media Asset Management Software from Blue Lucy at NAB 2017

    Media Asset Management Software from Blue Lucy at NAB 2017

  • TMD talk asset management solutions on BroadcastShow LIVE at IBC 2013

    TMD talk asset management solutions on BroadcastShow LIVE at IBC 2013

  • Prime Focus Technologies at IBC 2016

    Prime Focus Technologies at IBC 2016

  • Blue Lucy at IBC 2015

    Blue Lucy at IBC 2015

  • EditShare at BVE 2015

    EditShare at BVE 2015

  • BroadStream ARMADA at IBC 2014

    BroadStream ARMADA at IBC 2014

  • Dalet at IBC 2014

    Dalet at IBC 2014

  • Pronology at IBC 2014

    Pronology at IBC 2014

  • TMD summarises their work this year at IBC 2014

    TMD summarises their work this year at IBC 2014

  • TMD Mediaflex at IBC 2014

    TMD Mediaflex at IBC 2014

  • Metus at IBC 2014

    Metus at IBC 2014

  • Pronology at NAB 2014

    Pronology at NAB 2014

  • Dalet at NAB 2014

    Dalet at NAB 2014

  • Cinegy on BroadcastShow LIVE at IBC 2013

    Cinegy on BroadcastShow LIVE at IBC 2013

  • Orad Hi Tec Systems on BroadcastShow LIVE at IBC 2013

    Orad Hi Tec Systems on BroadcastShow LIVE at IBC 2013

  • Metus on BroadcastShow LIVE at IBC 2013

    Metus on BroadcastShow LIVE at IBC 2013

  • EditShare on BroadcastShow LIVE at IBC 2013

    EditShare on BroadcastShow LIVE at IBC 2013

  • Cambridge Imaging Systems on BroadcastShow LIVE at IBC 2013

    Cambridge Imaging Systems on BroadcastShow LIVE at IBC 2013

  • Dalet at IBC 2013

    Dalet at IBC 2013

  • Tony Taylor from TMD talks about LTFS at IBC 2013

    Tony Taylor from TMD talks about LTFS at IBC 2013

  • Tony Taylor from TMD talks about Mediaflex CI

    Tony Taylor from TMD talks about Mediaflex CI

  • Tony Taylor from TMD talks about Post Production

    Tony Taylor from TMD talks about Post Production

  • Dalet at NAB 2013

    Dalet at NAB 2013

  • Facilis at NAB 2013

    Facilis at NAB 2013

  • TMD at NAB 2013: MediaFlex Reporting Module

    TMD at NAB 2013: MediaFlex Reporting Module

  • TMD at NAB 2013: MediaFlex Systems

    TMD at NAB 2013: MediaFlex Systems

  • TMD at NAB 2013: Content Intelligence

    TMD at NAB 2013: Content Intelligence

  • Dalet at NAB 2012

    Dalet at NAB 2012

  • TMD at NAB 2012

    TMD at NAB 2012

  • Netia at IBC2011

    Netia at IBC2011


Related Shows
  • Using cellular networks for video capture

    Using cellular networks for video capture


Articles
Perimeter LED screens management
Nicolas Houel Opened in January 2016, Parc Olympique Lyonnais, also known as Groupama Stadium, is the new home of Olympique Lyonnais football club, one of the most popular clubs in France. Since its inauguration, the stadium was a host of UEFA Euro 2016, and was also chosen to stage, among other important events, the 2018 UEFA Europa League Final and football at the 2024 Summer Olympics.
Tags: iss133 | 3dstorm | graphics | groupama stadium | liveexpert | livecg | deltacast | Nicolas Houel
Contributing Author Nicolas Houel Click to read or download PDF
Why are trade shows still important
Mike Crimp First, the disclaimer: as the CEO of a rather large trade show, my opinion is likely to be skewed. However, I wouldn’t be here – now in my eighth year at IBC - if I didn’t truly believe that well-curated trade shows like IBC are a hugely important resource for our industry.
Tags: iss133 | ibc | innovation award | Mike Crimp
Contributing Author Mike Crimp Click to read or download PDF
Taking on a self employed placement year
Joshua Round The idea of being self-employed or freelancing has always been somewhat terrifying for me. There is a level of uncertainty and responsibility that comes with the freedom of being self-employed, the likes of which makes me wonder why I chose to give it a go for my placement year as part of my university course - (BSc) Television and Broadcasting.
Tags: iss133 | placement year | university | student | education | portsmouth | Joshua Round
Contributing Author Joshua Round Click to read or download PDF
Creating Authentic Content That Counts
Frank le Mair We’re deep into the 2010’s and the way in which we consume content has changed forever. Broadcasters and content owners are fighting for eyeballs in a saturated market where consumers are watching their favourite shows on different devices across a number of platforms. To target millennials and younger generations, who generally consume short bursts of video on YouTube and social media - particularly Snapchat, Instagram and now IGTV - media companies are creating more and more authentic stories and are using platforms that are compelling for this demographic. Unlike generations before them, they have totally new video viewing patterns and ideals.
Tags: iss133 | insight tv | monster energy | amazon | millennial | Frank le Mair
Contributing Author Frank le Mair Click to read or download PDF
How todays technology platforms can make AMAZING seem mundane
Bruce Devlin - new Some things never change. It's September and it's time for another IBC. Maybe I'm getting old and maybe I have selective memory about the past, but recently there hasn't been the buzz of years gone by. Sure, as you wander around the vast halls there will be lots of enthusiastic sales people trying to give you the best demo possible, but something has changed and to survive, I believe that vendors and customers need to change too.
Tags: iss133 | ibc | class | vulture | imf user group | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read or download PDF