Redefining the archive with Raj Patel


Raj Patel TV-Bay Magazine
Read ezine online
by Raj Patel
Issue 80 - August 2013
The entire broadcast workflow has changed dramatically in recent years. Predictably, its been a slow-process. The enormity of transitioning from an analogue to a digital workflow is huge for a variety of reasons - planning, testing, implementation and budget, can mean some installations taking up to two years to complete. There are instances where a new digital infrastructure is in place but the facility continues to use tried and tested analogue workflows, somehow unaware of the potential thats now available to them. Almost as if there is a fear of embracing change or lack of understanding as to how they can fully utilise the system to create new workflows.

However, as broadcasters and content facilities make this transition, opportunities do arise for new ways of working, ways that take time to evolve. One of the biggest evolutions happening at the moment in the industry is in the role of the archive. For many years a last thought for broadcasters, the archive is often envisaged as the dusty, musty element at the end of the broadcast chain where material ends up once all the bells and whistles have been added and its been aired. Archived material sits there quietly in the background until someone needs to use it again after which its put back on the shelf. Until recently, like many other elements of the broadcast chain the archive was a fairly closed system: data was written to the media archive in a proprietary format, which meant there was no interoperability between systems from different vendors. Additionally, archive libraries could generally only be controlled by archive management systems.
Not any more. With the successful take-up of LTFS, broadcasters and content owners have true interoperability between what were once disparate systems. Now material can be acquired directly to disk and then dragged and dropped to data tape and transported back to the facility. This removes the need to re-ingest content to the archive and also enables large amounts of data to be transported and archived on a single LTO tape. This type of workflow is just as valid on location as it is in a production facility. To banish the end of the line archive message, once the tape has been loaded into the archive, duplicate copies can be made automatically to back-up the valuable material. The archive system can also automatically copy the content to a disk portion of the archive so that craft editors can start working with the material as swiftly as possible.

This places the archive much further forward in the production process alongside the ingest element of the chain. Instead of ingesting in the traditional sense, the material can now be moved directly into the LTFS archive. We can see how the archive begins to shake off the dusty tag, to create a more cool way of working.

So how did we get to this point? How did the archive leap from the back to the front of the broadcast chain and how does the MAM system know whats been ingested into the archive?
LTO has grown to become one of, if not the de-facto tape format installed in tape libraries by broadcast-centric organisations implementing tape (and disk)-based archives. What has to be kept in mind is that LTFS is not a file format or even a wrapper. Its a way of writing data to standard, off-the-shelf IT storage media. It presents an open standard for broadcasters to provide real interoperability between systems. Any tape written according to the LTFS specification can be read by any other system using the same specification.

As for the MAM system knowing whats arrived, intelligent archives can quickly read the index information from an LTFS-formatted tape (that may, for example, have been used on location to capture material directly from HD camera or intermediate disks) and directly assign UIDs to the content, populate the archive database and generate a low-resolution proxy (used for editing). Using a simple subscription setup, a Notification Service then announces the arrival of the new material to the controlling MAM system and pushes relevant data to the MAM describing the archived material based on rules selected by the broadcaster.

With all this in mind perhaps an archive really is no longer just an archive but what name should we give it? Answers on a tweet please @SGLFlashNet.


Tags: iss080 | sgl | product manager | redefining the archive | archive system | files | protection | data | workflow | Raj Patel
Contributing Author Raj Patel

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • SGL at NAB 2012

    SGL at NAB 2012

  • SGL Broadcast at IBC 2015

    SGL Broadcast at IBC 2015

  • SGL at NAB 2015

    SGL at NAB 2015

  • SGL at NAB 2014

    SGL at NAB 2014

  • SGL at NAB 2013

    SGL at NAB 2013

  • Object Based Storage Solutions from Object Matrix at NAB 2017

    Object Based Storage Solutions from Object Matrix at NAB 2017

  • TMD talk workflow on BroadcastShow LIVE at IBC 2013

    TMD talk workflow on BroadcastShow LIVE at IBC 2013

  • Viaccess-Orca at IBC 2016

    Viaccess-Orca at IBC 2016

  • Sennheiser HDM Pro at BVE 2014

    Sennheiser HDM Pro at BVE 2014

  • Petrol at NAB 2012

    Petrol at NAB 2012

  • Petrol at IBC2011

    Petrol at IBC2011

  • Atomos with the Datacolor Spyder on BroadcastShow LIVE at IBC 2013

    Atomos with the Datacolor Spyder on BroadcastShow LIVE at IBC 2013

  • Datacolor Spyder on the Atomos stand at IBC 2013

    Datacolor Spyder on the Atomos stand at IBC 2013

  • Datavideo on the Holdan stand at BVE 2013

    Datavideo on the Holdan stand at BVE 2013

  • Datavision at BVE 2012

    Datavision at BVE 2012

  • Datavideo at IBC2011

    Datavideo at IBC2011

  • Telestream Vantage support for DPP at IBC 2014

    Telestream Vantage support for DPP at IBC 2014

  • Prime Focus Technologies at IBC 2016

    Prime Focus Technologies at IBC 2016

  • EBS at IBC 2015

    EBS at IBC 2015

  • EBS at IBC 2014

    EBS at IBC 2014

  • Clear-Com ProGrid at NAB 2014

    Clear-Com ProGrid at NAB 2014

  • Clear-Com HelixNet Partyline at NAB 2014

    Clear-Com HelixNet Partyline at NAB 2014

  • Atomos with the Samurai Blade on BroadcastShow LIVE at IBC 2013

    Atomos with the Samurai Blade on BroadcastShow LIVE at IBC 2013

  • Primestream on BroadcastShow LIVE at IBC 2013

    Primestream on BroadcastShow LIVE at IBC 2013

  • Object Matrix at BVE 2013

    Object Matrix at BVE 2013

  • Root6 at BVE 2012

    Root6 at BVE 2012

  • MOG Technologies at BVE 2012

    MOG Technologies at BVE 2012

  • Holdan and Teradek at BVE North 2011

    Holdan and Teradek at BVE North 2011

  • Cooke at IBC2011

    Cooke at IBC2011

  • Sensio at IBC2011

    Sensio at IBC2011

  • Radiant Grid at IBC2011

    Radiant Grid at IBC2011

  • ChyronHego show their PRIME Workflow at IBC 2018

    ChyronHego show their PRIME Workflow at IBC 2018

  • All IP Workflow from Quantum with Xcellis Workflow Storage solutions at NAB 2018

    All IP Workflow from Quantum with Xcellis Workflow Storage solutions at NAB 2018

  • Object Matrix Hybrid Workflow and Artifical Intelligence at NAB 2018

    Object Matrix Hybrid Workflow and Artifical Intelligence at NAB 2018

  • Workflow Solutions from Pronology at NAB 2017

    Workflow Solutions from Pronology at NAB 2017

  • Snell Advanced Media (SAM) 4k workflow at IBC 2015

    Snell Advanced Media (SAM) 4k workflow at IBC 2015

  • LIVEU Workflow solutions at NAB 2015

    LIVEU Workflow solutions at NAB 2015

  • Quantels Stream-based Workflows at IBC 2013

    Quantels Stream-based Workflows at IBC 2013

  • Streaming Media with Interra Systems at NAB 2017

    Streaming Media with Interra Systems at NAB 2017

  • New CEO and news update from TMD at NAB 2017

    New CEO and news update from TMD at NAB 2017

  • Tiger Technology at BVE 2015

    Tiger Technology at BVE 2015

  • ERA - Adobe Anywhere - at BVE 2015

    ERA - Adobe Anywhere - at BVE 2015

  • NETIA at BVE 2015

    NETIA at BVE 2015

  • Dalet at IBC 2014

    Dalet at IBC 2014

  • Pronology at IBC 2014

    Pronology at IBC 2014

  • Quantel LiveTouch at IBC 2014

    Quantel LiveTouch at IBC 2014

  • Quantel deal with AFP at IBC 2014

    Quantel deal with AFP at IBC 2014

  • Snell Kahuna Production Switcher at IBC 2014

    Snell Kahuna Production Switcher at IBC 2014

  • Telestream Wirecast and Switch at IBC 2014

    Telestream Wirecast and Switch at IBC 2014

  • Broadstream Solutions at NAB 2014

    Broadstream Solutions at NAB 2014

  • Telestream Enterprise at NAB 2014

    Telestream Enterprise at NAB 2014

  • Telestream Switch at NAB 2014

    Telestream Switch at NAB 2014

  • Dalet at NAB 2014

    Dalet at NAB 2014

  • ERA at BVE 2014

    ERA at BVE 2014

  • ERA Avere at BVE 2014

    ERA Avere at BVE 2014

  • Pixel Power on BroadcastShow LIVE at IBC 2013

    Pixel Power on BroadcastShow LIVE at IBC 2013

  • Atomos talking 4K on BroadcastShow LIVE at IBC 2013

    Atomos talking 4K on BroadcastShow LIVE at IBC 2013

  • Metus on BroadcastShow LIVE at IBC 2013

    Metus on BroadcastShow LIVE at IBC 2013

  • Volicon on BroadcastShow LIVE at IBC 2013

    Volicon on BroadcastShow LIVE at IBC 2013

  • Broadstream Solutions on the Oasys stand at IBC 2013

    Broadstream Solutions on the Oasys stand at IBC 2013

  • Oasys Chameleon at IBC 2013

    Oasys Chameleon at IBC 2013

  • Loft London Solutions with Cubix on the Oasys stand at IBC 2013

    Loft London Solutions with Cubix on the Oasys stand at IBC 2013

  • Tony Taylor from TMD talks about LTFS at IBC 2013

    Tony Taylor from TMD talks about LTFS at IBC 2013

  • Tony Taylor from TMD talks about Mediaflex CI

    Tony Taylor from TMD talks about Mediaflex CI

  • Tony Taylor from TMD talks about Post Production

    Tony Taylor from TMD talks about Post Production

  • Facilis at IBC 2013

    Facilis at IBC 2013

  • Telestream with Wirecast version five at IBC 2013

    Telestream with Wirecast version five at IBC 2013

  • Telestream with Post Producer at IBC 2013

    Telestream with Post Producer at IBC 2013

  • Yospace: Advert Insertion at NAB 2013

    Yospace: Advert Insertion at NAB 2013

  • Vimond Control Center at NAB 2013

    Vimond Control Center at NAB 2013

  • Telestream Vantage v5 at NAB 2013

    Telestream Vantage v5 at NAB 2013

  • TMD at NAB 2013: MediaFlex Reporting Module

    TMD at NAB 2013: MediaFlex Reporting Module

  • TMD at NAB 2013: MediaFlex Systems

    TMD at NAB 2013: MediaFlex Systems

  • TMD at NAB 2013: Content Intelligence

    TMD at NAB 2013: Content Intelligence

  • Telestream at BVE 2013

    Telestream at BVE 2013

  • Guntermann and Drunck GmbH at BVE 2013

    Guntermann and Drunck GmbH at BVE 2013

  • Tedial at NAB 2012

    Tedial at NAB 2012

  • Marquis Broadcast at NAB 2012

    Marquis Broadcast at NAB 2012

  • Root6 at NAB 2012

    Root6 at NAB 2012

  • Editshare at NAB 2012

    Editshare at NAB 2012

  • TMD at NAB 2012

    TMD at NAB 2012

  • PlayBox Technology at BVE 2012

    PlayBox Technology at BVE 2012

  • Suitcase TV at IBC2011

    Suitcase TV at IBC2011

  • Net Insight at IBC2011

    Net Insight at IBC2011

  • Tedial at IBC2011

    Tedial at IBC2011

  • IPV at IBC2011

    IPV at IBC2011

  • TSL at IBC2011

    TSL at IBC2011


Related Shows
  • Bubble and Squeak: Live and Loud from Monday at IBC 2013

    Bubble and Squeak: Live and Loud from Monday at IBC 2013


Articles
Living LIVE at BVE with Ross Video
Jon Pratchett KitPlus’ Jon Pratchett chats to Stuart Russell, Ross Video, in the BVE studio. Covering customer partnerships and loyalty, pain points, growth, industry trends, pace of IP adoption, 12g SDI technologies, UHD / HDR, 8k, AI and we try to get a hint of new products on the horizon...
Tags: iss136 | ross video | 12g sdi | uhd | hdr | ip | bve 2019 | bvexpo | Jon Pratchett
Contributing Author Jon Pratchett Click to read or download PDF
NAB Intelligence
Bruce Devlin - new It's that time of year again. 06:30 on road bikes on the Las Vegas Strip with a merry bunch of folks who believe they look good in lycra. As we pedal West up the hill towards Red Rock there will be stories of the year just gone and questions about what to look for at the show. I, for one, will be attending the Devoncroft event to check up on who is spending what and where. I will then look forward to the topics that might be buzzing around the halls. I predict there will be many displays of Machine Learning hiding under the banner of Artificial Intelligence. Some of these will show better picture quality, others will show personalisation engines, some will be improved search tools and yet more will be synthesising pictures and motions to replace reality with and Artificial reality that's more compelling for the viewer.
Tags: iss136 | nab | class | ai | smpte | st2110 | imf | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read or download PDF
Keeping Your Post Prodction on Track with Subclips and Search Bins
Alex Macleod

For my 2nd Kit Plus article I thought I’d try and build on the theme of my first, and that’s one of making sure things are organised at all levels of your post production projects.

Last time I talked about trying as best as you can to stick to the ‘two week rule’, making sure that the names & locations of every asset you import, and every bin & sequence that you create in your project - will make sense to you regardless of how long it is you spend away from it.

Tags: iss136 | mediacity training | subclip | premiere pro | gvs | bve | bve2019 | Alex Macleod
Contributing Author Alex Macleod Click to read or download PDF
BSC Expo 2019 Report
Paul MacKenzie BSC Expo returned to the Battersea Evolution on Friday February 1st and Saturday 2nd. It is a busy and friendly event though this year in need of some temperature control: exhibitors around the entrance area were uncomfortably aware of the wintry conditions outside and the main hall was in need of cooling.
Tags: iss136 | bsc | cinematography | canon | c700 | c200 | cartoni | holdan | blackmagic | peli | panasonic | sennheiser | sony | fs5 | teradek | viten | flowtech | Paul MacKenzie
Contributing Author Paul MacKenzie Click to read or download PDF
Painting Performance Analytics with ChyronHego
KitPlus By now, most people are familiar with the sport of mixed martial arts (MMA) and its leading organization – UFC (Ultimate Fighting Championship). And while the sport and its leading promotion are only 25 years old, a great deal has changed in those 25 years, including the training of UFC athletes.
Tags: iss136 | paint | telestrator | ufc | chyron | chyronhego | KitPlus
Contributing Author KitPlus Click to read or download PDF