The world is not flat


David Schleifer TV-Bay Magazine
Read ezine online

The world is all around us. We have a lot of cues that make us aware of how we fit into a 3D space. Many of these cues, senses and reactions are survival instincts. For example, the ability to hear someone walk up behind us, to see movement in our peripheral vision, a sense of how we are oriented when we move our bodies or swivel our head. All of this creates an overwhelming amount of data that we seamlessly interpret as we go around our day getting our morning coffee, driving, walking through crowds, diving into pools, and everything that we as people do in our lives.

As movies and television have evolved, we've learnt a new language, a new way to interpret the world around us based on a window into another world, the screen. What we've now become accustomed to via that 'screen' is jumps in location, perspective time and space. The screen is sometimes supplemented with surround sound, but usually we're just left to our imagination to weave the data we get into human stories.

Close ups, wide shots, panning, zooming, and many other devices are all an established part of the storyteller's toolkit. Then along comes Virtual Reality (VR) and 360, and suddenly we have a tendency to fall over reaching out for things that aren't there. We lose perspective, and even though this world, like ours, is not flat, we are lost!

There are differences between VR and 360-degree images, but what they both share is an immersive environment and the ability to represent, like reality does, what is going on all around you. Despite both VR and 360-degree images being more like reality, we find ourselves struggling to know how to use it.

There are several disconnects for us as viewers. I think a major one is that we do not physically navigate our way through the world in the viewer, we can spin around and look up or down, but we don't have all of the normal cues leading up to this. We didn't walk into a town square or into the theatre, so we immediately look around to get our bearings as if just teleported in. Then we can't really move around in 3D space, we are restricted to rotating to see what is next to us. In VR environments you can navigate through space, but generally not in the normal way like walking over to something you see. So basically, we're a little lost and as a result it takes us time to orient ourselves into what is a static scene with action someplace that we have to find.

Throughput the whole VR/360-degree experience, the director, can't guide you through the story in the same way as a 2D film. They no longer have the fast cuts, the zooming, the pacing they are accustomed to using to move you through the story. As a result, there is a focus on the novelty as opposed to an improvement in how we can tell the story.

There is a lot of experimentation going on today, and a lot of it is on the capture side. How to we grab better immersive images and stitch them together. Primestream is dedicated to managing those files. Images are captured, metadata is then added and managed around those files, and ultimately, the workflow is organised around them. This puts us right in the middle of the efforts to better understand how to tell stories with these new assets, pulling us into discussions around the creative process. As creative tools like Premier evolve to meet the needs of editors using them, we too are evolving how to manage the data and metadata that adds value to those captured images in the process. We're no longer engaged in tracking content segments with time-based markers, but rather content that needs to be marked up in time and space with directional data. Not only when, but also where the interesting content is.

We fully expect the requirements for VR/360 asset management to continue to evolve as people figure out how to use it to perfect their techniques over time, and we know that all the creative tools will need to move quickly to keep up with that innovative re-imagining of how we tell stories. We are not there yet, but you can already see the early signs that we are creating an exciting new creative narrative.


Tags: iss120 | vr | 3d | primestream | David Schleifer
Contributing Author David Schleifer

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Sennheiser VR at IBC 2016

    Sennheiser VR at IBC 2016

  • Elemental Technologies VR at NAB 2016

    Elemental Technologies VR at NAB 2016

  • Virtual and Augmented Reality support with the Arrow Fx7 from Miller at NAB 2017

    Virtual and Augmented Reality support with the Arrow Fx7 from Miller at NAB 2017

  • Ross Video at BVE 2017

    Ross Video at BVE 2017

  • 3D Storm, Newtek partners for 20yrs, shares the latest from the VIZRT acquisition at IBC2019

    3D Storm, Newtek partners for 20yrs, shares the latest from the VIZRT acquisition at IBC2019

  • 3D Storm show the new NDI to HDMI decoder at NAB 2019

    3D Storm show the new NDI to HDMI decoder at NAB 2019

  • 3D Storm presents LiveXpert and NewTek products at IBC 2018

    3D Storm presents LiveXpert and NewTek products at IBC 2018

  • 3D Storm discuss IP and NDI for Live Media Server and Live CG Broadcast at NAB 2018

    3D Storm discuss IP and NDI for Live Media Server and Live CG Broadcast at NAB 2018

  • LiveCG Broadcast and LiveMedia Server from 3D Storm at BVE 2018

    LiveCG Broadcast and LiveMedia Server from 3D Storm at BVE 2018

  • NDI and Newtek Products from 3D Storm at IBC 2017

    NDI and Newtek Products from 3D Storm at IBC 2017

  • LiveMedia Server and Live Xpert from 3D Storm at NAB 2017

    LiveMedia Server and Live Xpert from 3D Storm at NAB 2017

  • 3D Storm with LiveXpert at BVE 2017

    3D Storm with LiveXpert at BVE 2017

  • 3D Storm at IBC 2016

    3D Storm at IBC 2016

  • 3D Storm at BVE 2016

    3D Storm at BVE 2016

  • 3D Storm at IBC 2015

    3D Storm at IBC 2015

  • Brainstorm Multimedia: Aston3D at NAB 2013

    Brainstorm Multimedia: Aston3D at NAB 2013

  • Brainstorm Multimedia at IBC 2015

    Brainstorm Multimedia at IBC 2015

  • BRAINSTORM VIRTUAL SETS at NAB 2015

    BRAINSTORM VIRTUAL SETS at NAB 2015

  • Brainstorm Multimedia at BVE 2015

    Brainstorm Multimedia at BVE 2015

  • Brainstorm on BroadcastShow LIVE at IBC 2013

    Brainstorm on BroadcastShow LIVE at IBC 2013

  • Brainstorm with Aston demonstration at IBC 2013

    Brainstorm with Aston demonstration at IBC 2013

  • Brainstorm at IBC 2013

    Brainstorm at IBC 2013

  • Featured Clip: Geoff Boyle comments on NAB 2012

    Featured Clip: Geoff Boyle comments on NAB 2012

  • Brainstorm at NAB 2012

    Brainstorm at NAB 2012

  • VIZRT at BVE 2012

    VIZRT at BVE 2012

  • Newtek at BVE 2012

    Newtek at BVE 2012

  • Sony at ProVideo2011

    Sony at ProVideo2011

  • Sisvel Technology at IBC2011

    Sisvel Technology at IBC2011

  • Sensio at IBC2011

    Sensio at IBC2011

  • Panasonic at IBC2011

    Panasonic at IBC2011

  • Doremi at IBC2011

    Doremi at IBC2011

  • Matrox at IBC2011

    Matrox at IBC2011

  • Blackmagic at IBC2011

    Blackmagic at IBC2011

  • SGO at IBC2011

    SGO at IBC2011

  • Marshall Electronics at IBC2011

    Marshall Electronics at IBC2011

  • Primestream on BroadcastShow LIVE at IBC 2013

    Primestream on BroadcastShow LIVE at IBC 2013


Related Shows
  • Day 3 of BroadcastShow at IBC

    Day 3 of BroadcastShow at IBC


Articles
Working with Remote Workflows
Alex Macleod At the time of me writing this article there is literally no other subject of conversation going on at the moment. The creative industries are on the verge of a complete shutdown, and it’s a seriously scary prospect. The fear & uncertainty is very real.
Tags: iss142 | mediacity training | premier pro | nle | editing | motion templates | Alex Macleod
Contributing Author Alex Macleod Click to read or download PDF
Accurate Ad Tracking with OTT
Tim Armstrong As viewers embrace and transition to OTT, the opportunities and flexibility provided to advertisers are growing fast. However, like all technology shifts, this transition hasn’t come without challenges. Some technology used to monetise video over the years has resulted in a less-than-ideal viewing experience, with disruptive transitions and buffering two of the main issues. The good news is that advances in ad insertion technology mean content providers can now deliver a seamless OTT viewing experience, as well as addressable advertising options. This paves the way for the delivery of high-quality ad viewing while growing the advertiser's ROI.
Tags: iss142 | ott | switch media | vast | ssai | sdk | om sdk | Tim Armstrong
Contributing Author Tim Armstrong Click to read or download PDF
How to engage students with live projects
Martin Andrews For many employers, how and what we teach at university is sometimes considered to be very mysterious. The responsibility for creating the structure and content within the curriculum is the responsibility of academics. In my experience, the best method for making sure that students and staff are kept up to date with current working practices is to regularly engage with ‘Live’ projects and ‘Real’ clients.
Tags: iss142 | ccitv | university portsmouth | charles haskell | vlogs | Martin Andrews
Contributing Author Martin Andrews Click to read or download PDF
TVFutures My Dive in to Learning
Lucy Crow In 2014 I had my first taste of underwater diving. I was on a family holiday and I happened across the experience of a lifetime. Within the first few minutes of that adventure I had decided that I wanted to be part of the diving world going forward. After countless dives and extensive training to become a scuba diving instructor, I made the decision to attend university. I knew that whatever I was going to study, I wanted it to involve my passion for Scuba.
Tags: iss142 | ccitv | university portsmouth | scuba | go-pro | blue planet | Lucy Crow
Contributing Author Lucy Crow Click to read or download PDF
The Importance of Audio Production Systems
Tom Knowles Large-scale entertainment programming presents a unique set of challenges for broadcasters. Often extremely high-profile keystones of a broadcaster’s schedule and increasingly billed as live ‘event television’, as well as delivering the very best audio quality they demand a huge degree of flexibility and agility in terms of their production. With music being such a core component of their appeal to growing audiences, in both linear broadcast and online, nowhere is that more important than their audio production systems.
Tags: iss142 | ssl | solid state logic | system T | tempest engine | binaural encoder | Tom Knowles
Contributing Author Tom Knowles Click to read or download PDF