Parting the Cloud


TV-Bay Magazine
Read ezine online
Every so often a trend looms over the broadcast horizon that gathers pace so quickly it soon becomes the buzzword at every launch and trade show. A few years ago it was MAM and more recently stereoscopic; now the big buzz in town is the cloud. But despite its recent rise to fame in the broadcast sector there’s still a lot of confusion regarding how manufacturers can develop and manage cloud computing technologies. The change in workflow appears to be driven by metadata and graphics but as more content is created and consumed the requirement for longer term, more generic repositories increases.
Segmenting the archive in the cloud
Not so long ago, a broadcast archive was bespoke. It could only hold certain types of files, and the archive and restore processes were hard coded between each system connected to it. It was not uncommon for only one system (e.g. playout automation) to be connected to the archive. Recently, a more distributed approach is being adopted. Those building an archive for playout are over-specifying the hardware required, not just to cope with normal organic growth, but also with a view to opening up the archive to other departments. One reason for this shift is the implementation of improved mechanisms that exist within archive management software for content organisation. Now virtual partitions can be created within different tiers of storage, each assigned to different systems. For example, it’s now relatively common for one archive to service playout transmission, production, news and graphics. All departments have their own specific workflows and tools, but through careful planning and versatile interfaces all this can easily be achieved under the same private cloud.
Physical storage media have also become more diverse. Today’s choice of disk storage is massive, and tape libraries are highly scalable. However, none of these individual storage solutions alone can form a true broadcast archive that can grow and be widely shared. This remit falls firmly on the shoulders of the archive management solution, commonly referred to as middleware. Without this layer a cloud for long-term storage simply cannot form.
Why form an archive cloud?
There are significant advantages to adding a tape library to archive disk storage, whether locally or remotely to provide system resilience. However this only works when heterogeneous storage can be presented to the outside world as one virtual storage entity. This is where cloud storage comes in. With the application of simple web-style APIs content can be moved into a generic ‘archive’ without the controlling system having to know if it’s going to disk or tape, locally or remotely. It’s still important that the API supports the concept of specific storage locations within the archive, but these archive groups can be used as virtual containers to segregate different content, and different migration rules can be applied to them. The value of the archive management system is the automatic migration of content between storage tiers.
Bandwidth
Not all facilities own dark fibre capable of faster-than-real-time transfers right up to the doorstep. Obviously for hosted services (the remote cloud) video tapes can be transferred. However, this still requires that the service provider has the infrastructure and skillset required to ingest and tag the content, and introduces another level of complexity when ensuring that remotely ingested content can be accessed through its corresponding metadata.
From a disaster recovery perspective this approach duplicates effort. However, the technology does exist to move bulk quantities of content plus metadata as files relatively inexpensively. One such technology is LTFS. This standardised approach of writing data to LTO-5 (and upwards) tape provides a viable method of transferring bulk content into and out of a storage cloud. For example, a playout facility migrates content into the archive on site as normal i.e. ingest from video tape and QC before moving to online playout storage or copying directly to the archive. Once in the conventional archive domain, migration rules copy the content to an LTFS ‘export’ tape (or group of tapes, where required). Any metadata is archived along with the content. Alternatively, MXF wrappers like AS03 or AS11 (AS02 etc. for production-related workflows) can be used to encapsulate the content and its metadata, ensuring safe passage of all necessary information. Once full, the LTFS export tape is removed from the library and posted to the remote cloud storage facility.
On arrival in the ‘cloud’ the LTFS export tape is inserted into the library. The archive management system scans the index at the header of the tape and populates the archive management software database with the necessary information about the content. Now that the content is available, any systems connected to the archive cloud can query the archive database to find out what is new (or receive ‘push’ notifications of new arrivals) and access the content. This approach ensures that the systems closer to the business process rules remain in control of the content.

Tags: iss069 | sgl | cloud | archive | mam | N/A
Contributing Author N/A

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • SGL Broadcast at IBC 2015

    SGL Broadcast at IBC 2015

  • SGL at NAB 2014

    SGL at NAB 2014

  • SGL at NAB 2013

    SGL at NAB 2013

  • SGL at NAB 2012

    SGL at NAB 2012

  • SGL at NAB 2015

    SGL at NAB 2015

  • Object Based Storage Solutions from Object Matrix at NAB 2017

    Object Based Storage Solutions from Object Matrix at NAB 2017

  • ERA - Cloud Services - at BVE 2015

    ERA - Cloud Services - at BVE 2015

  • Cloud Media Management with Medway from Marquis Broadcast at IBC 2017

    Cloud Media Management with Medway from Marquis Broadcast at IBC 2017

  • Hybrid Cloud Media Aggregation from Cantemo at NAB 2017

    Hybrid Cloud Media Aggregation from Cantemo at NAB 2017

  • The Teracue Application Cloud show at IBC 2018 (German version)

    The Teracue Application Cloud show at IBC 2018 (German version)

  • The Teracue Application Cloud show at IBC 2018

    The Teracue Application Cloud show at IBC 2018

  • Blue Lucy with BLAM3 and their very own cloud at IBC 2018

    Blue Lucy with BLAM3 and their very own cloud at IBC 2018

  • Playbox Cloud Air at IBC 2107

    Playbox Cloud Air at IBC 2107

  • Elemental Technologies cloud innovations at NAB 2016

    Elemental Technologies cloud innovations at NAB 2016

  • FORSCENE Cloud Editing at NAB 2015

    FORSCENE Cloud Editing at NAB 2015

  • Aframe Cloud Video at IBC 2013

    Aframe Cloud Video at IBC 2013

  • Haivision: Video Cloud at NAB 2013

    Haivision: Video Cloud at NAB 2013

  • New CEO and news update from TMD at NAB 2017

    New CEO and news update from TMD at NAB 2017

  • Digital Vision on BroadcastShow LIVE at IBC 2013

    Digital Vision on BroadcastShow LIVE at IBC 2013

  • Be More with Clear from Prime Focus Technologies at NAB 2017

    Be More with Clear from Prime Focus Technologies at NAB 2017

  • Prime Focus Technologies at IBC 2016

    Prime Focus Technologies at IBC 2016

  • NETIA at BVE 2015

    NETIA at BVE 2015

  • Prime Focus Technologies at NAB 2016

    Prime Focus Technologies at NAB 2016

  • Playbox at IBC 2015

    Playbox at IBC 2015

  • ERA - Adobe Anywhere - at BVE 2015

    ERA - Adobe Anywhere - at BVE 2015

  • Grass Valley at BVE 2015

    Grass Valley at BVE 2015

  • Forscene at IBC 2014

    Forscene at IBC 2014

  • Thomson Video Networks at IBC 2014

    Thomson Video Networks at IBC 2014

  • Comigo at IBC 2014

    Comigo at IBC 2014

  • ChyronHego Metacast at IBC 2014

    ChyronHego Metacast at IBC 2014

  • Elemental Technologies Software-Defined Video at NAB 2014

    Elemental Technologies Software-Defined Video at NAB 2014

  • Elemental Technologies HEVC solutions at NAB 2014

    Elemental Technologies HEVC solutions at NAB 2014

  • Elemental Technologies Multiscreen Solutions at NAB 2014

    Elemental Technologies Multiscreen Solutions at NAB 2014

  • ERA at BVE 2014

    ERA at BVE 2014

  • ERA Avere at BVE 2014

    ERA Avere at BVE 2014

  • Forbidden Technologies FORscene at BVE 2014

    Forbidden Technologies FORscene at BVE 2014

  • Forbidden Technologies FORscene App at BVE 2014

    Forbidden Technologies FORscene App at BVE 2014

  • Haivision on BroadcastShow LIVE at IBC 2013

    Haivision on BroadcastShow LIVE at IBC 2013

  • Front Porch Digital on BroadcastShow LIVE at IBC 2013

    Front Porch Digital on BroadcastShow LIVE at IBC 2013

  • Forbidden Technologies on BroadcastShow LIVE at IBC 2013

    Forbidden Technologies on BroadcastShow LIVE at IBC 2013

  • Cambridge Imaging Systems on BroadcastShow LIVE at IBC 2013

    Cambridge Imaging Systems on BroadcastShow LIVE at IBC 2013

  • Haivision live encoding HEVC at IBC 2013

    Haivision live encoding HEVC at IBC 2013

  • Tedial at NAB 2013

    Tedial at NAB 2013

  • Haivision at NAB 2012

    Haivision at NAB 2012

  • Chyron at NAB 2012

    Chyron at NAB 2012

  • TSL at BVE 2012

    TSL at BVE 2012

  • NOA Archive Solutions at IBC 2014

    NOA Archive Solutions at IBC 2014

  • Primestream on BroadcastShow LIVE at IBC 2013

    Primestream on BroadcastShow LIVE at IBC 2013

  • Cinegy: Multiviewer at NAB 2013

    Cinegy: Multiviewer at NAB 2013

  • Editshare at NAB 2012

    Editshare at NAB 2012

  • Netia at IBC2011

    Netia at IBC2011

  • Softron Media Services on BroadcastShow LIVE at IBC 2013

    Softron Media Services on BroadcastShow LIVE at IBC 2013

  • TMD talk asset management solutions on BroadcastShow LIVE at IBC 2013

    TMD talk asset management solutions on BroadcastShow LIVE at IBC 2013

  • NOA Audio Solutions at IBC 2013

    NOA Audio Solutions at IBC 2013

  • Cinegy at IBC 2013

    Cinegy at IBC 2013

  • Facilis Technology at BVE 2013

    Facilis Technology at BVE 2013

  • Nexsan at NAB 2012

    Nexsan at NAB 2012

  • Arkivum at BVE 2012

    Arkivum at BVE 2012

  • TMD at BVE 2012

    TMD at BVE 2012

  • FOR-A at IBC2011

    FOR-A at IBC2011

  • Metus MAM and Ingest at IBC 2013

    Metus MAM and Ingest at IBC 2013

  • Workflow Solutions from Pronology at NAB 2017

    Workflow Solutions from Pronology at NAB 2017

  • Media Asset Management Software from Blue Lucy at NAB 2017

    Media Asset Management Software from Blue Lucy at NAB 2017

  • Mediaflex UMS Platform from TMD at NAB 2017

    Mediaflex UMS Platform from TMD at NAB 2017

  • Blue Lucy at IBC 2015

    Blue Lucy at IBC 2015

  • EditShare at BVE 2015

    EditShare at BVE 2015

  • Dalet at IBC 2014

    Dalet at IBC 2014

  • Tedial at IBC 2014

    Tedial at IBC 2014

  • Pronology at IBC 2014

    Pronology at IBC 2014

  • TMD summarises their work this year at IBC 2014

    TMD summarises their work this year at IBC 2014

  • Metus at IBC 2014

    Metus at IBC 2014

  • Metus at NAB 2014

    Metus at NAB 2014

  • Dalet at NAB 2014

    Dalet at NAB 2014

  • Nexidias Drew Lanham on BroadcastShow LIVE at IBC 2013

    Nexidias Drew Lanham on BroadcastShow LIVE at IBC 2013

  • EditShare on BroadcastShow LIVE at IBC 2013

    EditShare on BroadcastShow LIVE at IBC 2013

  • Dalet at IBC 2013

    Dalet at IBC 2013

  • Dalet at NAB 2013

    Dalet at NAB 2013

  • TMD at NAB 2013: MediaFlex Reporting Module

    TMD at NAB 2013: MediaFlex Reporting Module

  • TMD at NAB 2013: MediaFlex Systems

    TMD at NAB 2013: MediaFlex Systems

  • TMD at NAB 2013: Content Intelligence

    TMD at NAB 2013: Content Intelligence

  • Dalet at NAB 2012

    Dalet at NAB 2012

  • Broadway Systems at NAB 2012

    Broadway Systems at NAB 2012

  • VIZRT at BVE 2012

    VIZRT at BVE 2012

  • PlayBox Technology at BVE North 2011

    PlayBox Technology at BVE North 2011

  • Globecast at IBC2011

    Globecast at IBC2011

  • IPV at IBC2011

    IPV at IBC2011


Related Shows
  • Den Lennie talks Archive and Storage

    Den Lennie talks Archive and Storage


Articles
The Pace of Change
Dick Hobbs - new

The youngest human to stand on the moon (so far) was Charles Moss, the lunar module pilot of Apollo 16. Charlie had a wonderful claim: his father witnessed the Wright Brothers’ first flight at Kitty Hawk, and lived to see his son on the moon.

Does anything capture the speed of technological advance better than that? The whole of the history of powered flight in one lifetime.

Tags: iss133 | state of the nation | st2110 | st2110-10 | Dick Hobbs - new
Contributing Author Dick Hobbs - new Click to read or download PDF
Trade shows and their role in the wired world
Richard Baker Historically trade shows afforded an opportunity to collect the latest brochures relevant to the visitor's chosen industry or career path. Today there seems little reason to store data of any kind, let alone paper brochures, when information is so easily accessible online. Brochure back-packing at exhibitions has become a rare sight, rarer still since the security clampdown on visitor luggage at exhibitions. Today's efficient show delegate need only carry a mobile phone and, in deference to tradition, a bundle of business cards. The phone doubles as a snapshot camera, video camera, dictaphone, email reader, internet browser, Skype communicator, and so on.
Tags: iss133 | finepoint | ibc | nab | kitplus show | bve | Richard Baker
Contributing Author Richard Baker Click to read or download PDF
How todays technology platforms can make AMAZING seem mundane
Bruce Devlin - new Some things never change. It's September and it's time for another IBC. Maybe I'm getting old and maybe I have selective memory about the past, but recently there hasn't been the buzz of years gone by. Sure, as you wander around the vast halls there will be lots of enthusiastic sales people trying to give you the best demo possible, but something has changed and to survive, I believe that vendors and customers need to change too.
Tags: iss133 | ibc | class | vulture | imf user group | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read or download PDF
Fast-moving productions need multi-cam RF reliability
Darren Bilton Wireless acquisition creates a level of freedom not possible with any other form of filming yet only a decade ago the technique was barely possible. The technology enabling live real-time connections over radio frequencies has advanced leaps and bounds such that there is barely an entertainment, documentary, sports or news format today that doesn’t benefit from at least one link system. That means the demands on the kit continues to rise and includes the need for fail safe multi-camera operation, ease of use and backwards compatibility all within a small, lightweight and budget-friendly package.
Tags: iss133 | boxx tv | wireless | mpeg-4 | multicam | rf | multi-cam | Darren Bilton
Contributing Author Darren Bilton Click to read or download PDF
Peli Air 1507 Review
Phil Vinter Originally named after a bird that carries its precious cargo through the skies, it was, perhaps, only a matter of time before Peli released its Air range.
Tags: iss133 | peli | peli air 1507 | trekpak | Phil Vinter
Contributing Author Phil Vinter Click to read or download PDF