Green storage Fat wallets


Ben Pearce TV-Bay Magazine
Read ezine online
by Ben Pearce
Issue 91 - July 2014

Its not just eco campaigners that want to reduce their carbon footprint. Its also the financial director.

Whether youre a small company or a transnational enterprise, you run the risk of losing control of your data and buying more and more disk space. You may be storing many copies of each file on multiple external drives, possibly in several locations. You may be clogging up your fast tier 1 storage with completed projects. Put aside the data security issues for a moment and consider the practicalities of keeping thousands of hours of content on fast spinning disks, running 24/7: every drive independently powered and individually backed up. Its incredibly inefficient.

Even big data centres suffer. Reports by Gartner and by McKinsey & Company have shown that most data servers sit idle; they are rarely used to process files. Requiring cooling, maintenance and back-up generators, data centres can be massively wasteful of electricity. According to JISC, data centres in UK universities use around 8% of the institutions entire electricity consumption. And according to its 2012 report, the BBCs average footprint is 8.3 tonnes of CO2; per production hour, a figure that could be reduced by getting to grips with its media storage.

850 Metres of Tape

The simple answer is perhaps to shift data to tape. Our Space LTO-6 systems can copy files fast (an aggregate speed of 620MB/s) giving a durable and very energy efficient archive. The benefit of LTO is that it is highly expandable: drives can be added to a network to meet the facilitys needs. Each tape is also scalable: files and projects can be spanned over multiple tapes, meaning that theres no limit to the capacity that libraries can hold. Nevertheless, tape storage is an incomplete answer. Its linear, delivers comparatively low file access speeds and often involves a manual process. Therefore, its perfect for deep archive but too slow for time pressured environments such as breaking news, sports or live TV.

Dynamic Capacity

The fundamental issue for broadcasters and media organizations, however, is that they require very high performance storage platforms for HD and 4K editing. These tier 1 systems will necessarily be power hungry. The key therefore is to maximize the efficiency of these devices, which can be achieved by using asset management tools to identify unwanted duplicate files, migrating completed projects to tape and shifting old files onto economical archive storage. With GB Labs Space, these processes can be automatically handled according to rules the user sets: data is dynamically moved from tier 1 Space, to tier 2 Echo and off to Space LTO for deep archive.

Avoiding the Dead Parrot

Many system administrators fall foul of the temptation of simply moving files to external hard drives for deep archive. Not only does that make file management difficult, but it jeopardizes the data: hard disks unused for prolonged periods of time can develop mechanical faults, rendering them useless. We advise customers NEVER to leave valuable archive content on unpowered external drives. LTO tape with its 30 year archival life span is far preferable and much more energy efficient.

For archived content that you need to access regularly, an archive server is ideal. It is safe and can double as a complete back up system for your tier 1 editing platform. Recent developments in disk technology means that 6TB drives are now available for archive systems: their huge capacity means that a single RAID server, such as our Echo 36, can host as much as 192TB. Running one large appliance, rather than multiple low capacity units is very energy efficient in itself. Plus, improvements in system architecture mean that we have been able to make an overall reduction in power consumption of up-to 45%.

Mo Farrah doesnt race in flip flops

It is possible to reduce power requirements even further. However, a balance needs to be struck: a nearline archive should be instantly accessible, ready to play back HD files and to serve multiple users concurrently. It should even double up as a failover editing platform in the event of failure elsewhere in the facility. Sacrificing speed is could be a big sacrifice.

Cloud Cuckoo Land?

Many of our customers are investigating cloud storage. A note of caution: the huge file sizes we routinely deal with in the video and film industry makes online editing over global networks an incredibly ambitious task. With 10Gb networks now available, its not impossible but the costs are stratospherically high. In the meantime, proxy editing is a viable option for remote, collaborative editing.

More realistic in todays market is the concept of remote user access to archive storage and as standard, GB Labs Space and Space Echo systems are cloud-ready. Space Echo (our tier 2 system) can be configured to give remote users access to archived files in any location and at any time. For acceptable performance, it is reliant on the central facility and each user enjoying very fast fibre broadband connectivity.

Remote file replication is another viable option for connected facilities with multiple office locations. Space and Echo storage can be configured to be synchronized according to a schedule, allowing users to each site to have access to the organizations full data set. That said, we advise that the initial synchronization take place over a fast local network or by using LTO-6 tape.


Tags: iss091 | GB Labs | Green Storage | Ben Pearce
Contributing Author Ben Pearce

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • GB Labs Space at NAB 2014

    GB Labs Space at NAB 2014


Related Shows
  • BVE 2013 Day 3

    BVE 2013 Day 3


Articles
Grading BBC Sounds
Simone Grattarola

The BBC has launched its new personalised music, radio and podcast app with a campaign that follows one listener’s journey from meeting Kylie Minogue in a lift to Idris Elba on a bus. 

BBC Sounds offers a single home for the BBC’s thousands of hours of audio content, including live and on-demand shows and special music mixes curated by artists.

BBC Creative, the broadcaster’s in-house creative division, took the brief to agency Riff Raff Films and Megaforce directing duo of Charles Brisgand and Raphaël Rodriguez who in turn brought on board regular collaborators Time Based Arts.

Tags: iss135 | bbc | grading | bbc sounds | davinici | resolve | blackmagic | editing | Simone Grattarola
Contributing Author Simone Grattarola Click to read or download PDF
Switching to Internet Based Distribution
Chris Clark

"An IP status check for the broadcast industry", "Resistance is futile", "IP points the way forward for the broadcast industry"...

Yes, we've read the headlines too. But rather than force you into submission, scare you, or leave you feeling like you have no other choice, we want to give you the information that helps you to make a sensible decision about Internet-based distribution.

So what’s stopping you from making the switch right now?

Tags: iss135 | ip | internet | distribution | cerberus | Chris Clark
Contributing Author Chris Clark Click to read or download PDF
Test, Measurement and Standards
Alan Wheable The Alliance for IP Media Solutions (AIMS), is a non-profit trade alliance that fosters the adoption of one set of common, ubiquitous, standards-based protocols for interoperability over IP in the media and entertainment, and professional audio/video industries.
Tags: iss135 | omnitek | aims | SNMP | hdr | ai | Alan Wheable
Contributing Author Alan Wheable Click to read or download PDF
21st Century Technology for 20th Century Content
James Hall A big challenge facing owners of legacy content is rationalising and archiving their tape and film-based media in cost effective and efficient ways, whilst also adding value. Normally the result of this is to find a low cost means of digitising the content – usually leaving them with a bunch of assets on HDD. But then what? How can content owners have their cake and eat it?
Tags: iss135 | legacy | digitising | digitizing | archive | James Hall
Contributing Author James Hall Click to read or download PDF
Future proofing post production storage
Josh Goldenhar Advancements in NVMe (Non-Volatile Memory Express), the storage protocol designed for flash, are revolutionising data storage. According to G2M Research, the NVMe market will grow to $60 billion by 2021, with 70 percent of all-flash arrays being based on the protocol by 2020. NVMe, acting like steroids for flash-based storage infrastructures, dynamically and dramatically accelerates data delivery.
Tags: iss135 | nvme | sas | sata | it | storage | post production | Josh Goldenhar
Contributing Author Josh Goldenhar Click to read or download PDF