The Pros and Cons of Archiving in the Cloud


Lee Sheppard TV-Bay Magazine
Read ezine online

Archiving content in the cloud provides a number of key benefits. However, many media companies and content owners are still hesitant to store their assets that way due to content security implications and cost concerns. So what are the pros and cons of storing content in the cloud?

There are a number of key drivers including: access to content from any location; the ability to work collaboratively on projects; disaster recovery purposes - particularly if the material is never restored (storage costs are very low, but restore charges are high); simplicity - make one copy and let the cloud take responsibility for guaranteeing copies and availability; and low start-up costs with no responsibility for IT infrastructure (operating instead of capital costs).

These benefits mean that cloud usage is becoming more significant. However, there are some key considerations. A high-quality pipe to the cloud promises to deliver 1 Gbit/second - approximately 8 Tb per day - but in reality it will be less than that. In comparison, a single LTO7 drive offers 315MByte/second, or about 26 Tb per day. A large media operation may have 20 or more concurrent drives reading and writing to tape. This is of course a large-scale difference in throughput opportunity. Therefore, depending on the operation a pure cloud solution may be unfeasible because of sheer volume.

Partial file restore (PFR), which allows editors to select and restore elements of a clip directly from the archive in high resolution, is another factor. With assets now reaching hundreds of gigabytes or even terabytes in size, PFR becomes even more significant. However, cloud solutions are currently only geared up to restore whole files, although it is likely that solutions will be developed to address this.

As already highlighted, cost is another consideration: it can cost much less to store content in the cloud ($0.0275 to $0.01 per GB/per month for Amazon depending on class of service) than it does to restore it. Pricing models for retrieving stored assets are complex, but can result in unexpectedly high monthly bills. For instance, Amazon places restrictions on the volume of assets that can be retrieved per day, and does not take into account peak period usage. Media companies that are considering using cheap cloud storage need to consider the amount of content which will need to be restored.

Cloud archiving is much more cost-effective if (very) limited content needs to be restored: let's call this the usage ratio. A single usage ratio of 10 per cent means that at some point 10 per cent of the archived assets will be used again, at least once. If there is a high multiple usage ratio this will mean additional costs. Some organisations will have a very high usage ratio. For instance, some content is received (e.g. if it's purchased) and then stored straight to archive for definite transmission in the future. This would mean a 100% usage ratio.

A two hour 8k movie requires up to 10TB in storage; at $0.0275 per GB/month this is only $280/month but the restore costs will be much higher. The higher the usage ratio, the less competitive cloud storage becomes.

Other organisations, such as news services, may have a very low usage ratio. They could store huge amounts of raw footage but only use one per cent of it. In this instance the discussion has to focus on the cost of the LTO7 infrastructure to calculate the total cost of ownership, as well as the other considerations noted in this article.

We've looked at the benefits; but what are the risks associated with storing content in the cloud? Putting high-value licenced assets solely in the hands of third-parties can be very daunting. The archive has to be very secure and standard cloud may not be sufficient: DES encryption keys are vital. There are products available that provide this level of security but media companies are understandably worried about putting their eggs in one basket. There may also be security risks in the actual process of streaming assets to the cloud (for example, resulting in illegal copies being made). Again the streaming tools are of a high quality but there has to be great trust in third-parties. Having said this, digital media can be encrypted at source (as happens already with digital cinema before distribution to specific cinemas); nevertheless this is a consideration.

Archiving options are developing quickly and storage environments will become increasingly complex. This is resulting in an increase in hybrid archiving models. As cloud systems continue to evolve, particular types of assets are likely to be stored for determined time periods within their life-cycle on specific storage technologies for precise business reasons to take advantage of the benefits of each type of storage. Management of these decisions and processes will require sophisticated storage management systems. This is primarily what we are seeing now. Tape is here to stay, but as the archive becomes a more fundamental part of the workflow (not just at the end of the chain) customers are examining how they can get the benefits of the cloud while managing the risks and costs. Therefore hybrid archives utilising the respective benefits of tape, disk, optical storage and cloud are becoming more and more common.

A second trend with regard to cloud archiving is a move towards the private cloud and its companion object storage devices for many workflow needs. This will avoid issues associated with the public cloud whilst gaining at least some of the benefits: distribution and collaboration. The downside of course is the capital investment that can be avoided with public cloud.

The cloud is here to stay and only time will tell the degree to which media companies are willing to embrace this brave new world.


Tags: iss114 | archiving | cloud | pfr | encryption | Lee Sheppard
Contributing Author Lee Sheppard

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Dalet at NAB 2014

    Dalet at NAB 2014

  • Facilis at NAB 2014

    Facilis at NAB 2014

  • Dalet at IBC 2013

    Dalet at IBC 2013

  • Facilis at NAB 2013

    Facilis at NAB 2013

  • TMD at NAB 2013: MediaFlex Reporting Module

    TMD at NAB 2013: MediaFlex Reporting Module

  • TMD at NAB 2013: MediaFlex Systems

    TMD at NAB 2013: MediaFlex Systems

  • TMD at NAB 2013: Content Intelligence

    TMD at NAB 2013: Content Intelligence

  • Object Matrix at BVE 2013

    Object Matrix at BVE 2013

  • The Teracue Application Cloud show at IBC 2018 (German version)

    The Teracue Application Cloud show at IBC 2018 (German version)

  • The Teracue Application Cloud show at IBC 2018

    The Teracue Application Cloud show at IBC 2018

  • Blue Lucy with BLAM3 and their very own cloud at IBC 2018

    Blue Lucy with BLAM3 and their very own cloud at IBC 2018

  • Playbox Cloud Air at IBC 2107

    Playbox Cloud Air at IBC 2107

  • Cloud Media Management with Medway from Marquis Broadcast at IBC 2017

    Cloud Media Management with Medway from Marquis Broadcast at IBC 2017

  • Hybrid Cloud Media Aggregation from Cantemo at NAB 2017

    Hybrid Cloud Media Aggregation from Cantemo at NAB 2017

  • Elemental Technologies cloud innovations at NAB 2016

    Elemental Technologies cloud innovations at NAB 2016

  • FORSCENE Cloud Editing at NAB 2015

    FORSCENE Cloud Editing at NAB 2015

  • ERA - Cloud Services - at BVE 2015

    ERA - Cloud Services - at BVE 2015

  • Aframe Cloud Video at IBC 2013

    Aframe Cloud Video at IBC 2013

  • Haivision: Video Cloud at NAB 2013

    Haivision: Video Cloud at NAB 2013

  • Be More with Clear from Prime Focus Technologies at NAB 2017

    Be More with Clear from Prime Focus Technologies at NAB 2017

  • Object Based Storage Solutions from Object Matrix at NAB 2017

    Object Based Storage Solutions from Object Matrix at NAB 2017

  • New CEO and news update from TMD at NAB 2017

    New CEO and news update from TMD at NAB 2017

  • Prime Focus Technologies at IBC 2016

    Prime Focus Technologies at IBC 2016

  • Prime Focus Technologies at NAB 2016

    Prime Focus Technologies at NAB 2016

  • Playbox at IBC 2015

    Playbox at IBC 2015

  • ERA - Adobe Anywhere - at BVE 2015

    ERA - Adobe Anywhere - at BVE 2015

  • Grass Valley at BVE 2015

    Grass Valley at BVE 2015

  • NETIA at BVE 2015

    NETIA at BVE 2015

  • Forscene at IBC 2014

    Forscene at IBC 2014

  • Thomson Video Networks at IBC 2014

    Thomson Video Networks at IBC 2014

  • Comigo at IBC 2014

    Comigo at IBC 2014

  • ChyronHego Metacast at IBC 2014

    ChyronHego Metacast at IBC 2014

  • Elemental Technologies Software-Defined Video at NAB 2014

    Elemental Technologies Software-Defined Video at NAB 2014

  • Elemental Technologies HEVC solutions at NAB 2014

    Elemental Technologies HEVC solutions at NAB 2014

  • Elemental Technologies Multiscreen Solutions at NAB 2014

    Elemental Technologies Multiscreen Solutions at NAB 2014

  • ERA at BVE 2014

    ERA at BVE 2014

  • ERA Avere at BVE 2014

    ERA Avere at BVE 2014

  • Forbidden Technologies FORscene at BVE 2014

    Forbidden Technologies FORscene at BVE 2014

  • Forbidden Technologies FORscene App at BVE 2014

    Forbidden Technologies FORscene App at BVE 2014

  • Haivision on BroadcastShow LIVE at IBC 2013

    Haivision on BroadcastShow LIVE at IBC 2013

  • Front Porch Digital on BroadcastShow LIVE at IBC 2013

    Front Porch Digital on BroadcastShow LIVE at IBC 2013

  • Forbidden Technologies on BroadcastShow LIVE at IBC 2013

    Forbidden Technologies on BroadcastShow LIVE at IBC 2013

  • Cambridge Imaging Systems on BroadcastShow LIVE at IBC 2013

    Cambridge Imaging Systems on BroadcastShow LIVE at IBC 2013

  • Digital Vision on BroadcastShow LIVE at IBC 2013

    Digital Vision on BroadcastShow LIVE at IBC 2013

  • Haivision live encoding HEVC at IBC 2013

    Haivision live encoding HEVC at IBC 2013

  • Tedial at NAB 2013

    Tedial at NAB 2013

  • Haivision at NAB 2012

    Haivision at NAB 2012

  • Chyron at NAB 2012

    Chyron at NAB 2012

  • TSL at BVE 2012

    TSL at BVE 2012


Related Shows
  • Den Lennie and Larry Jordan - Cloud Editing BVE 2015

    Den Lennie and Larry Jordan - Cloud Editing BVE 2015


Articles
AI in Media and Entertainment
David Candler Artificial Intelligence (AI) is a term appearing everywhere these days. What is happening in media and entertainment (M&E) that makes the industry ripe for AI? In other words, why does the M&E industry need AI?
Tags: iss134 | AI | wazee | David Candler
Contributing Author David Candler Click to read or download PDF
An Obituary to Timecode
Bruce Devlin - new A stoic and persistent character that stubbornly refused to change with the times, Timecode has finally passed on, but no-one has noticed. A long-lasting industry veteran, Timecode was brought into this world at an uncertain date in the late 1960s due to the needs of analogue tape workflows and the demand for synchronisation between audio and video devices. A joint activity between SMPTE and the EBU led to the work on Time and Control codes starting its journey to standardisation in the early 1970s.
Tags: iss134 | timecode | smpte | ebu | edit | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read
Giving Welsh sport a global audience
Adam Amor From the Ospreys Rugby Union team, to the Football Association of Wales, as well as national cycling, swimming and boxing coverage, Port Talbot based Buffoon Film and Media has been heavily involved in putting Welsh sports on the world stage.
Tags: iss134 | blackmagic | atem | buffoon | micro studio camera | Adam Amor
Contributing Author Adam Amor Click to read or download PDF
Keeping it remotely real
Reuben Such Everyone wants to do more with less. Always have, although it could be argued that doing more with more is something to aspire to, not many have that luxury. So let’s stick with the prevailing winds of doing more with less, and not just doing more, but doing it remotely, particularly in terms of production. Remote production, in particular, is getting a lot of attention in the field these days, but not so much in terms of the remote operation of fixed studios.
Tags: iss134 | remote control | IPE | IDS | Reuben Such
Contributing Author Reuben Such Click to read or download PDF
Accelerated Workflows with eGPU
Mike Griggs From the UK’s National Trust to magazine publishers to manufacturers, digital content creator Mike Griggs has a wide and varied portfolio of clients for whom he creates 3D art, motion graphics and multimedia exhibits. A typical day might involve sampling birdsong near Virginia Woolf’s country estate or creating 3D animations for VR. To keep on top of these demands, Griggs wanted to take the full power of the GPU computing revolution on the road.
Tags: iss134 | sonnet | egpu | amd | post production | editing | Mike Griggs
Contributing Author Mike Griggs Click to read or download PDF